rryisthebest commited on
Commit
64d54d0
·
verified ·
1 Parent(s): fe11b54

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -40,7 +40,7 @@ More details can be found in the paper.
40
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
41
  We forward here an excerpt from the [Zephyr-7B-β model card](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta/blob/main/README.md#bias-risks--limitations):
42
 
43
- > Zephyr-7B-β has not been aligned to human preferences for safety within the RLHF phase or deployed with in-the-loop filtering of responses like ChatGPT, so the model can produce problematic outputs (especially when prompted to do so). It is also unknown what the size and composition of the corpus was used to train the base model ([mistralai/Mistral-7B-v0.1]), however it is likely to have included a mix of Web data and technical sources like books and code. See the [Falcon 180B model card](https://huggingface.co/tiiuae/falcon-180B#training-data) for an example of this.
44
 
45
  FIRST is trained specifically on monolingual English data, effectiveness on multilingual sets is not guaranteed.
46
 
 
40
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
41
  We forward here an excerpt from the [Zephyr-7B-β model card](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta/blob/main/README.md#bias-risks--limitations):
42
 
43
+ > Zephyr-7B-β has not been aligned to human preferences for safety within the RLHF phase or deployed with in-the-loop filtering of responses like ChatGPT, so the model can produce problematic outputs (especially when prompted to do so). It is also unknown what the size and composition of the corpus was used to train the base model (mistralai/Mistral-7B-v0.1), however it is likely to have included a mix of Web data and technical sources like books and code. See the [Falcon 180B model card](https://huggingface.co/tiiuae/falcon-180B#training-data) for an example of this.
44
 
45
  FIRST is trained specifically on monolingual English data, effectiveness on multilingual sets is not guaranteed.
46