Skip to main content
An Aria model bundle is a directory that contains everything needed to run a device-native foundation model on your hardware. Each bundle is named by combining the model slug with its quantization level, such as gemma-4-e2b-it_q4 or qwen3.5-2b_q8. This naming convention makes it easy to identify the exact model and precision you are deploying.

​
Bundle contents

Every bundle contains at least the following files: Optional tokenizer sidecars such as tokenizer.json may also be included, depending on the model architecture.

​
Quantization levels

Aria Compute supports three quantization values for model weights: Choose int4 when storage is limited, int8 for balanced quality, and int326 for advanced language and vision models that require higher precision.

​
SDK versioning

When you download a bundle, you can specify an SDK version with the sdk parameter (for example, sdk=v1.0). This ensures that you receive a bundle that is compatible with the Aria SDK you are using in your application. If you omit the parameter, the server returns the latest compatible bundle.

​
Download and registry

Model bundles are hosted on a private S3 registry. Authenticated download requests return a short-lived S3 presigned URL. You can authenticate with either a session JWT or an API key in the Authorization: Bearer header. Read the Downloading models guide for step-by-step instructions, or see the GET /api/models/{slug}/download reference for query parameters and response formats.

​
Public mirrors

Aria Compute also maintains public mirrors on Hugging Face (ariacompute/*) and ModelScope (AriaCompute/*) for users who prefer to download through those platforms.