The Wayback Machine - https://web.archive.org/web/20241225164656/https://blog.min.io/
Product
AiStor Logo
Overview
What is AIStor?
Features
Replication Replication Versioning Versioning Observability Observability Encryption Encryption Key Management Server Key Management Server S3 Compatibility S3 Compatibility Object Immutability Object Immutability Catalog Catalog Object Prompt Object Prompt xxx Identity + Access Mgt Firewall Firewall AIHub AIHub Lifecycle Lifecycle Cache Cache Events and Lambdas Events and Lambdas Console Console
Tools
Erasure Code Calculator Erasure Code Calculator Determine your raw and usable capacity across a range of erasure coding settings. Reference Hardware Reference Hardware MinIO’s recommended Configuration and reference hardware for building large scale data infrastructure.
Solutions
AI Storage Learn how MinIO is leading the AI storage market from its exclusive features to performance at scale. HDFS Migration Modernize and simplify your big data storage infrastructure with cloud native storage with AIStor. Snowflake Learn how to leverage Snowflake external tables to query data without having to move it.
Integrations Integrations with MinIO Browse our expansive list of
integrations with links to the relevant
documentation.
Veeam Learn how MinIO and Veeam have partnered deliver superior RTO and RPO. Modern Datalakes Learn how modern, multi-engine data lakeshouses depend on MinIO's AIStor. Equinix Repatriate your data onto the cloud you control with MinIO and Equinix. SQL Server Learn how to leverage SQL Server 2022 with MinIO to run queries on your data without having to move it. Commvault Learn how Commvault and MinIO are partnered to deliver performance at scale for mission critical backup and restore workloads. Hybrid Cloud Learn how enterprises use MinIO to build AI data infrastructure that runs on any cloud - public, private or colo. Splunk Find out how MinIO is delivering performance at scale for Splunk SmartStores. VMware Discover how MinIO integrates with VMware across the portfolio from the Persistent Data platform to TKG and how we support their Kubernetes ambitions.
Open Source
Github Community Explore, experiment, ask questions and contribute. Docs Development guides. Slack Channel Open Forum for discussing topics related to MinIO.
Download MinIO Object Store Download MinIO Object Store Get MinIO's open source server, client, and SDK.
Resources
Resources Home Browse our library of white papers, solution briefs, benchmarks and videos. Blog Product updates, company news, and educational content. Training Learn the MinIO Way and Become a Data Infrastructure Expert.
Events Events Join us to take advantage to meet with MinIO partners, employees, and subject-matter experts.
Partner Pricing
Login Download

Iterable-Style Datasets using Amazon’s S3 Connector for PyTorch and MinIO

Keith Pijanowski Keith Pijanowski on AI/ML
Iterable-Style Datasets using Amazon’s S3 Connector for PyTorch and MinIO

In November of 2023 Amazon announced the S3 Connector for PyTorch. The Amazon S3 Connector for PyTorch provides implementations of PyTorch's dataset primitives (Datasets and DataLoaders) that are purpose-built for S3 object storage. It supports map-style datasets for random data access patterns and iterable-style datasets for streaming sequential data access patterns.  In a previous post, I introduced the

Read more...

Revolutionizing Mobile Testing with Big Data and AI

Keith Pijanowski Keith Pijanowski on Case Study
Revolutionizing Mobile Testing with Big Data and AI

A mobile application is a company's brand available on demand. It is a window into any service or product an organization offers. At Kobiton, they understand this—it is their mission to improve mobile applications through testing.  Kobiton is a mobile testing platform that allows customers to perform manual and automated testing on real mobile devices from anywhere

Read more...

MinIO’s S3 over RDMA Initiative: Setting New Standards in Object Storage for High-Speed AI Data Infrastructure

Rakshith Venkatesh Rakshith Venkatesh on AIStor
MinIO’s S3 over RDMA Initiative: Setting New Standards in Object Storage for High-Speed AI Data Infrastructure

As the demands of AI and machine learning continue to accelerate, data center networking is evolving rapidly to keep pace. For many enterprises, 400GbE and even 800GbE are becoming standard choices, driven by the need for high-speed, low-latency data transfer for AI workloads that are both data-intensive and time-sensitive. AI models for tasks like large language processing, real-time analytics, and

Read more...

A Redesigned Global Console for AI-Centric Workloads

AJ AJ on AIStor
A Redesigned Global Console for AI-Centric Workloads

The MinIO Console has been an evolving product for several years now. Every time we learn, we think about how to improve this incredibly important part of our interaction framework. First came the Console, which saw massive adoption within a year of its introduction. More than 10K organizations to be more specific.Next came the enterprise Console. That moved from

Read more...