Just thank you for great model!

#7
by Phaser69 - opened

It’s very impressive model in IQ3_M gguf. It keeps coherency in polish language, it fits in iPhone 14 with 32k context (Q4 context quantizantion) and keeps to be very coherent with long context (I haven’t yet tried full 32k). Just thank you! Perfect setup for low end edge.

Sign up or log in to comment