hanzo-ml-falcon
Falcon is a general large language model.
Running an example
Make sure to include the --use-f32 flag if using CPU, because there isn't a BFloat16 implementation yet.
cargo run --example falcon --release -- --prompt "Flying monkeys are" --use-f32