Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Llama-4-Scout-17B-16E-Instruct-FP8-dynamic
like
20
Follow
Red Hat AI
1.07k
Image-Text-to-Text
Safetensors
PyTorch
12 languages
vllm
llama4
facebook
meta
llama
neuralmagic
redhat
llmcompressor
quantized
FP8
conversational
compressed-tensors
License:
llama4
Model card
Files
Files and versions
xet
Community
5
VLLM launch parametrs
#3
by
Clutchkin
- opened
Apr 17
Discussion
Clutchkin
Apr 17
What are recommended vllm launch parametrs for 8xL40S.
See translation
👍
3
3
+
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
