Zach Kelling
fc84b98274
- Add Default implementation for PerplexityBenchmark - Add #[allow(dead_code)] to FileLogger struct - Fix remaining hanzo_examples -> hanzo_ml_examples references in example files
hanzo-ml-mixtral: 8x7b LLM using a sparse mixture of experts.
Mixtral-8x7B-v0.1 is a pretrained generative LLM with 56 billion parameters.
- Blog post from Mistral announcing the model release.
- Model card on the HuggingFace Hub.
Running the example
$ cargo run --example mixtral --release -- --prompt "def print_prime(n): "
def print_prime(n): # n is the number of prime numbers to be printed
i = 2
count = 0
while (count < n):
if (isPrime(i)):
print(i)
count += 1
i += 1
def isPrime(n):
for x in range(2, int(n**0.5)+1):
if (n % x == 0):
...