Zach Kelling
fc84b98274
- Add Default implementation for PerplexityBenchmark - Add #[allow(dead_code)] to FileLogger struct - Fix remaining hanzo_examples -> hanzo_ml_examples references in example files
hanzo-ml-mamba: Mamba implementation
ML implementation of Mamba [1] inference only. Mamba is an alternative to the transformer architecture. It leverages State Space Models (SSMs) with the goal of being computationally efficient on long sequences. The implementation is based on mamba.rs.
Compared to the mamba-minimal example, this version is far more efficient but would only work for inference.
Running the example
$ cargo run --example mamba --release -- --prompt "Mamba is the"