Installation
Install Mono Quant via pip:
Requirements
- Python: 3.11 or higher
- PyTorch: 2.0 or higher
- NumPy: 1.24 or higher
Mono Quant requires torch and numpy as dependencies. All other features are optional or use standard library.
Optional Dependencies
For additional functionality, you can install optional dependencies:
# Safetensors format support
pip install mono-quant[safetensors]
# Development dependencies (testing, building)
pip install mono-quant[dev]
# Documentation dependencies
pip install mono-quant[docs]
Optional Dependencies Breakdown
| Feature | Package | Install |
|---|---|---|
| Safetensors format | safetensors |
pip install safetensors |
| CLI progress bars | tqdm |
Included in main package |
| Click framework | click>=8.1 |
Included in main package |
Verify Installation
# Check package version
python -c "import mono_quant; print(mono_quant.__version__)"
# Test CLI
monoquant --version
# Run quick test
python -c "from mono_quant import quantize; print('Mono Quant ready!')"
Development Installation
If you want to contribute or run from source:
# Clone repository
git clone https://github.com/thatAverageGuy/mono-quant.git
cd mono-quant
# Install in editable mode
pip install -e ".[dev,docs]"
# Run tests
pytest
Next Steps
- Quick Start - Your first quantization
- Basic Usage - Common patterns and examples