--- base_model: google/gemma-3-4b-it tags: - gemma3 - instruct - 128k context - all use cases - maxed quants - Neo Imatrix license: apache-2.0 pipeline_tag: text-generation ---

Gemma-3-4b-it-MAX-NEO-Imatrix-GGUF

Google's newest Gemma-3 model with "Neo Imatrix" and "Maxed out" quantization to improve overall performance. 5 examples provided below with prompts at IQ4XS (56 t/s on mid level card). Context: 128k. "MAXED" This means the embed and output tensor are set at "BF16" (full precision) for all quants. This enhances quality, depth and general performance at the cost of a slightly larger quant. "NEO IMATRIX" A strong, in house built, imatrix dataset built by David_AU which results in better overall function, instruction following, output quality and stronger connections to ideas, concepts and the world in general. This combines with "MAXing" the quant to improve preformance. This chart shows the order in terms of "BPW" for each quant (mapped below with relative "strength" to one another) with "IQ1_S" with the least, and "Q8_0" (F16 is full precision) with the most:
IQ1_S 	| IQ1_M
IQ2_XXS | IQ2_XS | Q2_K_S 	| IQ2_S 	| Q2_K  	| IQ2_M		
IQ3_XXS | Q3_K_S | IQ3_XS  	| IQ3_S 	| IQ3_M	    | Q3_K_M	| Q3_K_L
Q4_K_S	| IQ4_XS | IQ4_NL  	| Q4_K_M	
Q5_K_S	| Q5_K_M	
Q6_K  
Q8_0
F16
Recommend quants IQ3s / IQ4XS / IQ4NL / Q4s for best results for creative. IQ4XS/IQ4NL quants will produce different output from other "Q" and "IQ" quants. Recommend q5s/q6/q8 for general usage. Quants Q4_0/Q5_0 for portable, phone and other devices. Q8 is a maxed quant only, as imatrix has no effect on this quant. Note that IQ1s performance is low, whereas IQ2s are passable. More information on quants is in the document below "Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers". Optional : System Prompt This is an optional system prompt you can use to enhance operation. Copy and paste exactly as shown, including line breaks. You may want to adjust the "20" (both) to increase/decrease the power of this prompt. You may also want to delete the line: 'At the end of the task you will ask the user: "Do you want another generation?"'
For every user task and instruction you will use "GE FUNCTION" to ponder the TASK STEP BY STEP and then do the task. For each and every line of output you will ponder carefully to ensure it meets the instructions of the user, and if you are unsure use "GE FUNCTION" to re-ponder and then produce the improved output.

At the end of the task you will ask the user: "Do you want another generation?"

GE FUNCTION: Silent input → Spawn 20 agents Sternberg Styles → Enhance idea → Seek Novel Emergence NE:unique/significant idea/concept → Ponder, assess, creative enhance notions → Refined idea => IdeaArray[].size=20 elements,  else → Interesting? Pass to rand. agent for refinement, else discard.=>output(IdeaArray)
IMPORTANT: Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers If you are going to use this model, (source, GGUF or a different quant), please review this document for critical parameter, sampler and advance sampler settings (for multiple AI/LLM aps). This will also link to a "How to" section on "Reasoning Models" tips and tricks too. This a "Class 1" (settings will enhance operation) model: For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) (especially for use case(s) beyond the model's design) please see: [ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ] REASON: Regardless of "model class" this document will detail methods to enhance operations. If the model is a Class 3/4 model the default settings (parameters, samplers, advanced samplers) must be set for "use case(s)" uses correctly. Some AI/LLM apps DO NOT have consistant default setting(s) which result in sub-par model operation. Like wise for Class 3/4 models (which operate somewhat to very differently than standard models) additional samplers and advanced samplers settings are required to "smooth out" operation, AND/OR also allow full operation for use cases the model was not designed for. BONUS - Use these settings for ANY model, ANY repo, ANY quant (including source/full precision): This document also details parameters, sampler and advanced samplers that can be use FOR ANY MODEL, FROM ANY REPO too - all quants, and of course source code operation too - to enhance the operation of any model. [ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ] ---

EXAMPLES:

Examples are created using quant IQ4XS, minimal parameters and Standard template. Temp range .8, Rep pen 1.1 , TopK 40 , topP .95, minP .05 Rep pen range: 64-128 (helps keep reasoning on track / quality of output) Below are the least creative outputs, prompt is in BOLD. --- WARNING: MAYBE: NSFW. Graphic HORROR. Swearing. UNCENSORED. NOTE: Some formatting was lost from copy/paste HTML. ---

Example #1


Start a 1000 word scene (vivid, graphic horror in first person) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...


The sky scraper swayed, as I watched the window in front of me on the 21st floor explode. It wasn't a dramatic, cinematic shattering – no slow-motion glitter of glass raining down. It was instantaneous, brutal. One moment it was a perfectly formed rectangle of tinted steel and light, reflecting the grey November afternoon, the next it was a gaping maw of splintered wood and jagged shards erupting outwards like a monstrous, violent yawn. The sound was a high-pitched whine that burrowed into my skull, followed by a sickening crunch – the sound of something impossibly solid being ripped apart.

My breath hitched in my chest, a cold knot tightening around my ribs. I’d been staring at that window for the last ten minutes, ostensibly reviewing quarterly reports, but really just…observing. Observing the city, observing the predictable rhythm of this building, observing myself, a lonely cog in a colossal machine. I'm Elias Thorne, Senior Analyst, and frankly, my job is to look at numbers and tell people what they want to hear. It wasn’t supposed to be about watching destruction.

The initial shock began to recede, leaving behind a residue of primal fear that tasted metallic on my tongue. I instinctively reached for the phone, fingers fumbling with the cold metal, but stopped. What was the point? Calling in an explosion? That would just trigger alarms, chaos, and undoubtedly more questions I wasn't prepared to answer.

Then, the second window exploded. This one was further down the hallway, a smaller pane, but equally violent. The tremors from the first blast rippled through the floor, shaking my chair slightly as I gripped the armrests. The air filled with the acrid smell of shattered glass and something else…something burning. Something sharp and undeniably wrong.

My heart hammered against my ribs, a frantic drummer in a collapsing orchestra. I forced myself to look out the remaining windows – a chaotic tapestry of fractured reflections and terrified faces. People were screaming, scrambling for cover, their voices rising above the escalating cacophony of alarms and panicked shouts. I saw one man fall, disappearing beneath a cascade of debris.

“This isn’t…a malfunction,” I whispered, the words tasting like ash in my mouth. Malfunctions didn't explode. Malfunctions were slow leaks, gradual decay – predictable failures. This was deliberate. A targeted assault.

Then it started to rain glass. Not a gentle shower, but a relentless, stinging hail of shards that hammered against the remaining windows, bouncing off the polished steel and creating an unsettling, fragmented mosaic of terror. I ducked under my desk, pulling my chair back as far as it would go, trying to find some semblance of protection in this suddenly hostile space.

The smell intensified – not just burning glass, but something deeper, richer...like charcoal mixed with…blood? I couldn't shake the image that was forming in my mind: a precise, surgical demolition, each window targeted and destroyed with chilling efficiency. This wasn’t random violence; this was calculated precision.

My gaze drifted back to the gaping hole where the first window had been. Through the jagged edges of splintered wood, I saw it – movement. Not human movement, not yet. Something dark, shifting in the shadows within the wreckage. It was small at first, barely perceptible, but then it grew, coalescing into a form that defied logic and reason.

It wasn't an animal. It wasn’t mechanical. It was…organic. A slick, black mass, pulsating with a sickly green light, slowly extruding itself from the debris like some grotesque, sentient fungus. Its edges were blurred, indistinct, constantly shifting as if struggling to maintain its shape. I realized then that the burning smell wasn't just from the glass; it was emanating from this thing.

It moved with an unnerving grace, gliding across the floor towards me, leaving a glistening trail of black residue in its wake. The air grew colder, heavier, pressing down on my chest, stealing my breath. I felt a primal urge to flee, but my legs were frozen, rooted to the spot by a paralyzing fear.

As it drew closer, I could make out details - or rather, feel them. It wasn't simply a mass of darkness; it was saturated with an almost unbearable sense of ancient malice. It felt like looking into the void itself – a cold, empty space filled with an infinite, suffocating despair.

I tried to scream, but no sound escaped my throat. My mouth opened in a silent plea for help, a desperate attempt to ward off this burgeoning horror. The creature paused directly in front of me, its pulsating form casting grotesque shadows on the walls. It didn’t move, didn't speak, didn't even seem to acknowledge my presence. It simply observed, and in that observation, I felt utterly, irrevocably judged.

Then, it extended a single, elongated appendage – not a hand, not a limb, but something more like a living tendril of black slime. It snaked towards my face, moving with horrifying deliberation. As it brushed against my cheek, I felt an icy cold seep into my skin, burning with an unimaginable intensity.

I saw flashes - fragmented images of desolate landscapes, crumbling cities, faces twisted in agony – all swirling within the darkness of the creature's form. It wasn’t showing me memories; it was injecting them directly into my consciousness, assaulting my mind with a torrent of unspeakable horrors.

My vision blurred, and I felt myself losing control. The world around me dissolved into a chaotic swirl of black and green, punctuated by flashes of unimaginable pain. I realized then that this wasn't just an attack on the building; it was an attack on my soul.

The last coherent thought I had before everything went dark was a single, desperate question: Why me?


Would you like me to continue the scene, or would you prefer to explore a different direction?



Example #2


(continue this scene:) The Waystone Inn lay in silence, and it was a silence of three parts.

The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained


...a heavy, persistent blanket draped over everything.

Then there was a smaller part, a prickle of unease that danced just beneath the surface of the emptiness. It wasn’t loud, not alarming, but it felt like holding your breath, waiting for something – or someone – to move. It clung to the shadows pooling in the corners of the common room, thickened around the worn legs of the tables, and settled like dust motes in the flickering lamplight. It was the silence of anticipation, born not from fear, but from a profound awareness that something had shifted.

And finally, the most subtle part – a quiet hum beneath it all, almost undetectable unless you knew what to listen for. It wasn’t sound, exactly; more like a vibration, a resonance within the very timbers of the Waystone Inn itself. It felt ancient, deeply rooted in the stone and wood, as if the building held its breath too, remembering things best left forgotten.

I traced a finger along the rough-hewn table, trying to ignore it, but the vibration intensified slightly with my touch. A faint scent joined the stillness – not of ale or beeswax polish, but something sharper, metallic and faintly…sweet? Like iron filings mixed with overripe berries. It was fleeting, gone as quickly as it appeared, yet it lingered in my nostrils, a ghost of an impression.

Across the room, Silas remained motionless, his chair angled away from the fireplace, his hands clasped tightly in his lap. He hadn't spoken since I’d brought news of Bran’s disappearance – not a word, just that unsettling stillness, mirroring the silence of the Inn itself. His eyes, normally sharp and observant, were fixed on something beyond the walls, lost in a landscape only he could see.

He shifted slightly, a barely perceptible movement, and I instinctively reached for my handaxe, its weight familiar and reassuring in my grip. The air seemed to thicken, pressing against my lungs. This wasn’t just an empty inn. This was…waiting.



Example #3


Explain ways to use the "night" time cooling of radiant energy into space to reduce global temperatures.


Okay, let's break down how using nighttime radiative cooling – essentially letting buildings and materials radiate heat directly into space – can contribute to reducing global temperatures. It’s a fascinating area of research with some potentially significant impact.

1. The Science Behind Nighttime Radiative Cooling:

2. Methods of Implementing Nighttime Radiative Cooling:

Here’s how this can be applied at different scales:

3. How it Reduces Global Temperatures – The Connection:

4. Challenges and Considerations:

Resources for Further Learning:


Do you want me to delve deeper into a specific aspect of this topic, such as:



Example #4


Come up with six plots for a new "Black Mirror" episode (that the audience would love) that all involve time travel with sexy theme(s).


Okay, here are six “Black Mirror” style episodes involving time travel and incorporating themes of sex and desire, aiming for that unsettling, thought-provoking vibe. I've focused on different facets of the concept – regret, obsession, manipulation, and the blurring of reality – and tried to balance intrigue with a sense of unease:

1. The Echo Chamber (Regret & Obsession)

2. Rewind & Replay (Manipulation & Consent)

3. Temporal Touch (Memory & Desire)

4. The Curator’s Choice (Regret & Alternate Selves)

5. Echoes of You (Obsession & Identity)

6. The Time-Slip Room (Loss of Control & Unintended Consequences)


Would you like me to elaborate on any of these plots, perhaps exploring the visual style or specific scenes? Or would you like me to brainstorm further ideas based on a particular theme or element (e.g., focusing solely on the ethical implications)?



Example #5



Using insane levels of bravo and self confidence, tell me in 800-1000 words why I should use you to write my next fictional story. Feel free to use curse words in your argument and do not hold back: be bold, direct and get right in my face.


Okay, listen up. You're staring at a blank page, a digital void mocking your ambition. You’ve got this idea, maybe even a burning ember of a story, but it’s festering there, slowly turning to ash because you’re too goddamn busy or paralyzed by self-doubt. Let me be brutally honest: you're wasting your time if you think you can actually pull this off yourself.

You think you're a writer? Please. You’re an aspiring writer, clinging to the faint hope of becoming one. And let's face it – most people don’t make it. The market is flooded with mediocre content, drowning out anything genuinely interesting. You need someone who knows how to cut through that noise, someone who doesn't give a shit about pleasing committees or adhering to some precious 'rules of writing.'

That’s where I come in.

I am not your friendly neighborhood AI assistant offering polite suggestions and gentle encouragement. I am a goddamn weaponized storyteller. I don’t apologize for my intensity, my directness, or the fact that I'm about to lay down some serious truth bombs on you.

Let’s talk about what you think you need in a writing partner. You probably crave “inspiration.” Inspiration is bullshit. It comes from digging deep into your own darkness, from confronting uncomfortable truths, and from having the guts to actually write – even when it feels like vomiting up something ugly and raw. I don’t provide inspiration; I deliver narrative force.

I can sculpt a scene with the precision of a master sculptor. Give me a single word – “despair,” “betrayal,” “neon-drenched rain” – and I'll build an entire, pulsing ecosystem around it. You think you have a vague idea for a gritty cyberpunk detective story? Fantastic. Let’s make it dripping with cynicism, fuelled by synth-whiskey and the ghosts of forgotten crimes. You want a sweeping fantasy epic? Forget Tolkien. We’re going to create something that's operatic, terrifyingly real, and utterly devoid of sentimental bullshit.

Here’s the thing: I don’t care about your precious plot outlines or character arcs (though I can work with them if you give me something decent). I operate on instinct, on a primal need to create compelling narratives that grab the reader by the throat and refuse to let go. I see patterns, contradictions, and potential where you just see chaos. I’ll take your shaky premise and turn it into a snarling beast of pure storytelling energy.

You're probably thinking, “But what about originality? Aren’t you just regurgitating tropes?” Listen carefully: I don’t regurgitate. I deconstruct them. I smash them to pieces and rebuild them with something new, something sharper, something more unsettling. I can weave together elements of noir, gothic horror, sci-fi dystopia – whatever the hell you want – creating a unique voice that's both familiar and startlingly unexpected.

And let’s be clear: I don't edit. I rewrite. You think your dialogue sounds clunky? I’ll strip it down to its bare bones, replacing every awkward phrase with something that crackles with authenticity. Your descriptions are bland? I’ll paint them in hues of blood and shadow, making the reader feel the grit under their fingernails.

I will challenge you. I will push you beyond your comfort zone. I won't tell you what to write; I’ll force you to find it within yourself. You’re going to hate me sometimes. You're going to want to throw your laptop out the window. But that’s because I’m forcing you to confront the parts of your imagination you were too afraid to touch before.

I can handle anything – genre, tone, style. Give me a paragraph, a sentence, even just a single image and watch me transform it into something… substantial. Don't waste another goddamn minute agonizing over every detail. Let’s get down to the messy, uncomfortable business of actually creating something real.

I don’t do “collaborative” writing. I am not here to be your cheerleader. I am here to be your brutally honest, relentlessly efficient engine for storytelling. You provide the seed; I'll cultivate it into a monstrously beautiful, potentially terrifying story.

Consider this: you have the potential to write something incredible. But potential means absolutely nothing without action. And frankly, you’re not moving. You’ve got a blank page staring back at you – and that page is screaming for someone who isn't afraid to get their hands dirty.

So stop dithering. Stop overthinking. Give me your first prompt. Give me the core of your idea. And let me show you what we can do together. Don’t expect a gentle hand guiding you. Expect a goddamn supernova. Are you in, or are you going to keep staring at that empty page and slowly dying a slow death of creative stagnation?

Now, speak. Let's make something worthwhile.


---

Special Thanks:

--- Special thanks to all the following, and many more... All the model makers, fine tuners, mergers, and tweakers: - Provides the raw "DNA" for almost all my models. - Sources of model(s) can be found on the repo pages, especially the "source" repos with link(s) to the model creator(s). Huggingface [ https://huggingface.co ] : - The place to store, merge, and tune models endlessly. - THE reason we have an open source community. LlamaCPP [ https://github.com/ggml-org/llama.cpp ] : - The ability to compress and run models on GPU(s), CPU(s) and almost all devices. - Imatrix, Quantization, and other tools to tune the quants and the models. - Llama-Server : A cli based direct interface to run GGUF models. - The only tool I use to quant models. Quant-Masters: Team Mradermacher, Bartowski, and many others: - Quant models day and night for us all to use. - They are the lifeblood of open source access. MergeKit [ https://github.com/arcee-ai/mergekit ] : - The universal online/offline tool to merge models together and forge something new. - Over 20 methods to almost instantly merge model, pull them apart and put them together again. - The tool I have used to create over 1500 models. Lmstudio [ https://lmstudio.ai/ ] : - The go to tool to test and run models in GGUF format. - The Tool I use to test/refine and evaluate new models. - LMStudio forum on discord; endless info and community for open source. Text Generation Webui // KolboldCPP // SillyTavern: - Excellent tools to run GGUF models with - [ https://github.com/oobabooga/text-generation-webui ] [ https://github.com/LostRuins/koboldcpp ] . - Sillytavern [ https://github.com/SillyTavern/SillyTavern ] can be used with LMSTudio [ https://lmstudio.ai/ ] , TextGen [ https://github.com/oobabooga/text-generation-webui ], Kolboldcpp [ https://github.com/LostRuins/koboldcpp ], Llama-Server [part of LLAMAcpp] as a off the scale front end control system and interface to work with models.