2025-01-02 21:34:47 -08:00
2021-06-18 10:41:54 -07:00
2021-06-18 10:34:28 -07:00
2025-03-12 22:29:51 -07:00
2026-03-09 23:27:26 -07:00
2021-04-23 11:58:53 -07:00
2023-02-19 00:03:50 +05:30

Hanzo Storage

GitHub Stars License Go Version

High-performance, S3-compatible object storage for AI workloads, built on S3 and optimized for the Hanzo ecosystem.

Features

  • S3 API Compatible -- Drop-in replacement for Amazon S3; works with any S3 client or SDK
  • Built for AI & Analytics -- Optimized for large-scale model artifacts, training datasets, and data pipelines
  • High Performance -- Designed to saturate modern NVMe and network hardware
  • Erasure Coding -- Data protection with configurable redundancy across drives and nodes
  • Bucket Policies -- Fine-grained access control with S3-compatible policy documents
  • Object Lifecycle Management -- Automated expiration, transition, and tiering rules
  • Encryption -- Server-side encryption (SSE-S3, SSE-KMS) for data at rest and in transit
  • Multi-Tenancy -- Isolated namespaces and access boundaries for teams and services

Quick Start

Docker

Build and run a standalone Hanzo Storage server:

docker build -t hanzo-storage .
docker run -p 9000:9000 -p 9001:9001 \
  hanzo-storage server /data --console-address :9001

The web console is available at http://127.0.0.1:9001. Default credentials are minioadmin:minioadmin -- change these immediately in production.

Install from Source

Requires Go 1.24 or later.

git clone https://github.com/hanzoai/storage.git
cd storage
go build -o hanzo-storage .
./hanzo-storage server /data --console-address :9001

Cross-compile for a specific target:

GOOS=linux GOARCH=arm64 go build -o hanzo-storage .

Verify Connectivity

Use any S3-compatible client. With the S3 Client (mc):

mc alias set hanzo http://localhost:9000 minioadmin minioadmin
mc admin info hanzo
mc mb hanzo/my-bucket
mc cp ~/data/model.safetensors hanzo/my-bucket/
mc ls hanzo/my-bucket/

SDKs

Hanzo Storage is fully S3-compatible. Use any S3 SDK, or the purpose-built S3 SDKs:

Language Package
Go github.com/minio/minio-go/v7
JavaScript / TypeScript minio
Python minio

Standard AWS SDKs (aws-sdk-go, boto3, @aws-sdk/client-s3) also work without modification.

Documentation

Full documentation is available at docs.hanzo.ai.

Attribution

Based on S3. See the upstream LICENSE for attribution.

License

Copyright (c) Hanzo AI Inc. Licensed under the GNU Affero General Public License v3.0.

S
Description
Hanzo tenant service — sourced from hanzoai/s3
Readme Apache-2.0
251 MiB
Languages
Go 83.9%
Rust 6.1%
templ 3.4%
Java 2.3%
Shell 1.6%
Other 2.5%