Necessary transformers version
After running into weird problems and trying to fix my project for five hours straight I found out this model only works if you use transformers==4.49.0. It will not work with any other transformers version, since Qwen2_5_VLForConditionalGeneration was only added in 4.49.0 and in 4.50 something changed and the triton compiler will throw errors if you try to use the model.
I am also using autoawq==0.2.7.post3 and torch>=2.7.0 if anyone is interested. Sadly autoawq also is deprecated now as well. But yeah, that's about it.
Same issue encountered. I was using this model with transformers==4.51.3, autoawq==0.2.9, triton==3.2.0, torch==2.6.0+cu124, and error occured:
IncompatibleTypeErrorImpl('invalid operands of type triton.language.float32 and triton.language.float32')
Then I downgraded to transformers==4.49.0 and autoawq==0.2.8, it finally worked.