Hugging Face's logo
Jeffrey Magder's picture
14 4

Jeffrey Magder

jmagder
Mi6paulino's profile picture
·

AI & ML interests

None yet

Recent Activity

upvoted an article 19 days ago
The Large Language Model Course
reacted to danielhanchen's post with 🔥 29 days ago
🦥 Introducing Unsloth Dynamic v2.0 GGUFs! Our v2.0 quants set new benchmarks on 5-shot MMLU and KL Divergence, meaning you can now run & fine-tune quantized LLMs while preserving as much accuracy as possible. Llama 4: https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF DeepSeek-R1: https://huggingface.co/unsloth/DeepSeek-R1-GGUF-UD Gemma 3: https://huggingface.co/unsloth/gemma-3-27b-it-GGUF We made selective layer quantization much smarter. Instead of modifying only a subset of layers, we now dynamically quantize all layers so every layer has a different bit. Now, our dynamic method can be applied to all LLM architectures, not just MoE's. Blog with Details: https://docs.unsloth.ai/basics/dynamic-v2.0 All our future GGUF uploads will leverage Dynamic 2.0 and our hand curated 300K–1.5M token calibration dataset to improve conversational chat performance. For accurate benchmarking, we built an evaluation framework to match the reported 5-shot MMLU scores of Llama 4 and Gemma 3. This allowed apples-to-apples comparisons between full-precision vs. Dynamic v2.0, QAT and standard iMatrix quants. Dynamic v2.0 aims to minimize the performance gap between full-precision models and their quantized counterparts.
liked a Space 6 months ago
HuggingFaceH4/blogpost-scaling-test-time-compute
View all activity

Organizations

None yet

jmagder's activity

upvoted an article 19 days ago
upvoted a paper 9 months ago
upvoted 12 papers 11 months ago