18 33 62

PenutChen

penut85420

penut85420

AI & ML interests

LLM, Quantization

Recent Activity

updated a Space about 7 hours ago

DaOppaiLoli/JpVocab

commented on an article 10 days ago

🐯 Liger GRPO meets TRL

upvoted an article 10 days ago

🐯 Liger GRPO meets TRL

View all activity

Organizations

penut85420's activity

commented a paper 5 months ago

Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens

Paper • 2411.17691 • Published Nov 26, 2024 • 13 •

commented a paper 7 months ago

Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMs

Paper • 2410.10739 • Published Oct 14, 2024 • 2 •

New activity in yentinglin/Llama-3-Taiwan-8B-Instruct 8 months ago

請問是有重新訓練過tokenizer嗎?

#9 opened 11 months ago by

tedslin

commented a paper 8 months ago

Instruction Following without Instruction Tuning

Paper • 2409.14254 • Published Sep 21, 2024 • 31 •

commented a paper 9 months ago

A Comprehensive Evaluation of Quantized Instruction-Tuned Large Language Models: An Experimental Analysis up to 405B

Paper • 2409.11055 • Published Sep 17, 2024 • 17 •

commented a paper 10 months ago

Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems

Paper • 2404.01616 • Published Apr 2, 2024 •

commented 3 papers 11 months ago

commented a paper 12 months ago

In-Context Editing: Learning Knowledge from Self-Induced Distributions

Paper • 2406.11194 • Published Jun 17, 2024 • 15 •

commented a paper about 1 year ago

Let's Fuse Step by Step: A Generative Fusion Decoding Algorithm with LLMs for Multi-modal Text Recognition

Paper • 2405.14259 • Published May 23, 2024 • 2 •

New activity in BUAADreamer/Yi-VL-6B-hf about 1 year ago

ValueError: Trying to set a tensor of shape torch.Size([4096]) in "weight" (which has shape torch.Size([4096, 4096])), this look incorrect.

#4 opened about 1 year ago by

penut85420

commented a paper over 1 year ago

Fast Vocabulary Transfer for Language Model Compression

Paper • 2402.09977 • Published Feb 15, 2024 • 2 •

New activity in TheBloke/Falcon-180B-Chat-GPTQ over 1 year ago

Brilliant!

#1 opened almost 2 years ago by

shafiqalibhai

New activity in yentinglin/Taiwan-LLaMa2 almost 2 years ago

拿鐵跟摩鐵的差別

#2 opened almost 2 years ago by

allen7575