The info storage panorama is present process a transformational change. AI is altering how programs must deal with each giant quantities of knowledge and the pace at which that knowledge will be processed. The place enterprise organizations as soon as relied on conventional SAN/NAS architectures, the explosive development of unstructured knowledge, now measured in petabytes, has made one factor clear – object storage has develop into the dominant know-how for enterprise storage wants.
To assist higher perceive how IT leaders are leveraging object storage, MinIO, Inc., the corporate behind the favored open-source cloud storage software program MinIO, has introduced the findings of its Object Storage and AI Report. The report additionally reveals how AI is reshaping adoption and workload patterns.
The findings of the report have been primarily based on a survey of 600+ IT and software program improvement leaders on storage, AI, workloads, and infrastructure. The survey was carried out by MinIO in partnership with UserEvidence.
The MinIO report reveals that greater than 70% of enterprises’ cloud-native knowledge was in object storage, and this proportion is predicted to develop. Enterprise leaders forecast that 75% of their cloud-native knowledge might be in goal storage inside two years.
The highest three elements for this explosive development embrace the assist provided by AI, efficiency necessities, and scalability. These three causes are interlinked, as AI initiatives demand efficiency at scale, making object storage the best answer to deal with giant volumes of knowledge effectively.
So how precisely do enterprises use object storage? The survey reveals that the highest three use circumstances embrace superior analytics, AI mannequin coaching, and knowledge lakehouse storage.
“This analysis confirms what MinIO, AWS, Azure, and Google already know – that object storage is the storage know-how of the cloud – public, non-public, or edge,” mentioned Jonathan Symonds, Chief Advertising Officer, MinIO.
“What’s extra attention-grabbing, nevertheless, is the anticipated acceleration of adoption, pushed by GenAI workloads. Trendy object shops are uniquely certified to fulfill the calls for of those workloads – specifically throughput efficiency, immutability, and exascale. We’re eager to observe this analysis evolve as enterprises construct new storage architectures to assist their AI ambitions.”
Whereas AI assist has been very important to the expansion of object storage, 96% of the respondents shared that they’re going through challenges on account of AI. These challenges largely stem from the necessity to handle huge volumes of unstructured knowledge and guarantee constant efficiency at scale, each of that are essential for supporting AI workloads successfully.
IT leaders cited safety and privateness (44%), knowledge governance (27%), and cloud-native storage (25%) because the three greatest challenges to AI success of their group.
The report signifies a rising pattern towards a hybrid cloud method for AI and machine studying (ML) workloads. Whereas the general public cloud stays common, 68% of the respondents shared that they’re involved about the price of operating AI workloads, and they’re contemplating a hybrid cloud method.
This pattern aligns immediately with MinIO’s capabilities, as its object storage is designed to assist each private and non-private cloud environments. Nonetheless, organizations might want to rigorously assess methods to steadiness value and efficiency on this evolving panorama.
“This work represents one of the complete seems on the AI storage panorama and there are some eye-opening findings”, famous Ray Rhodes, co-founder at UserEvidence. “IT leaders are clear of their desire for object storage – a discovering that transcended firm measurement or geography. We stay up for partnering with MinIO on extra analysis on this key space.”
Earlier this yr, MinIO shifted its focus from a general-purpose storage answer to an AI-centric platform with the launch of AIStor. The platform included options equivalent to promptObject API, enabling pure language queries of unstructured knowledge, and high-speed RDMA assist for seamless GPU integration.
MinIO was launched in 2014 to handle the calls for of unstructured knowledge development. From zero traces of code in 2014, to 1.5 billion docker downloads with deployments throughout the globe, it’s now a well-liked selection for open-source object storage. MinIO co-founder and CEO, Anand Babu (AB) Periasamy, is a BigDataWire Individuals to Watch 2018.
The AIStor launch immediately aligns with the themes in MinIO’s Object Storage and AI Report, as each emphasize the important position of object storage in supporting AI workloads. With AI adoption accelerating and enterprises rethinking storage, the report’s findings recommend object storage might be essential for assembly the size and efficiency wants of recent AI.
Associated Objects
Are Databases Turning into Simply Question Engines for Huge Object Shops?
Object Storage a ‘Complete Cop Out,’ Hammerspace CEO Says. ‘You All Acquired Duped’
Why Object Storage Is the Reply to AI’s Largest Problem