Description: Zephyr beta is a fine-tuned 7B version of mistral that was trained on on a mix of publicly available, synthetic datasets.
Additional Information: Zephyr is a 7 billion parameter model, fine-tuned on Mistral to achieve results similar to Llama 2 70B Chat in several benchmarks (ARC, HellaSwag, MMLU, TruthfulQA). It was fine-tuned using Direct Performance Optimization This model has the built-in alignment of its source datasets removed. Updated on October 26, 2023, Zephyr Beta is the second version of the model in the series. It’s trained on a distilled dataset, improving grammar and yielding even better chat results.