diffusers
/

FLUX.1-dev-torchao-int8

Model card Files Files and versions Community

marcsun13 HF Staff commited on 21 days ago

Commit

bb5f850

·

verified ·

1 Parent(s): 39a22b3

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -32,11 +32,11 @@ After installing the required library, you can run the following script:
 from diffusers import FluxPipeline
 pipe = FluxPipeline.from_pretrained(
-    "diffusers/FLUX.1-dev-torchao-int4",
     torch_dtype=torch.bfloat16,
-    use_safetensors=False
 )
-pipe.to("cuda")
 prompt = "Baroque style, a lavish palace interior with ornate gilded ceilings, intricate tapestries, and dramatic lighting over a grand staircase."

 from diffusers import FluxPipeline
 pipe = FluxPipeline.from_pretrained(
+    "diffusers/FLUX.1-dev-torchao-int8",
     torch_dtype=torch.bfloat16,
+    use_safetensors=False,
+    device_map="balanced"
 )
 prompt = "Baroque style, a lavish palace interior with ornate gilded ceilings, intricate tapestries, and dramatic lighting over a grand staircase."