Spaces:
Sleeping
Sleeping
Update Operational_Instructions/Submission_Instructions.md
Browse files
Operational_Instructions/Submission_Instructions.md
CHANGED
@@ -1,4 +1,4 @@
|
|
1 |
-
We use the HuggingFace submission mechanism:
|
2 |
1. Go to the [LiveRAG Challenge HuggingFace page](https://huggingface.co/spaces/LiveRAG/Challenge)
|
3 |
2. Login by clicking the blue bar on the left rail says "Login with Hugging Face"
|
4 |
3. Click "New submission" on the left rail
|
@@ -8,7 +8,7 @@ We use the HuggingFace submission mechanism:
|
|
8 |
6. If the Answer file was successfully uploaded, you will see the message: "Success! You have 4 submissions remaining today"
|
9 |
7. To view your submission information, click "Cancel" in the pop-up window and then click "My submission" in the left rail\
|
10 |
7.1 The submission "Status" shows "Success" if your Answer file is a valid JSONL file and all Answers are valid (i.e., comply with the [Answer schema](Answer.json.schema))\
|
11 |
-
7.2
|
12 |
8. You may submit up to 5 Answer files, and optionally select the one you'd like to be evaluated by checking its “Selected” box in the “My submission” tab
|
13 |
9. The evaluated Answer file will be the last selected valid submission made before the session end time. In case no selected valid submission is made before session end time, we’ll evaluate the last valid submission made in time
|
14 |
10. We accept partial submissions where not all questions are answered due to time limitation or any other reason
|
|
|
1 |
+
We use the HuggingFace Competition submission mechanism:
|
2 |
1. Go to the [LiveRAG Challenge HuggingFace page](https://huggingface.co/spaces/LiveRAG/Challenge)
|
3 |
2. Login by clicking the blue bar on the left rail says "Login with Hugging Face"
|
4 |
3. Click "New submission" on the left rail
|
|
|
8 |
6. If the Answer file was successfully uploaded, you will see the message: "Success! You have 4 submissions remaining today"
|
9 |
7. To view your submission information, click "Cancel" in the pop-up window and then click "My submission" in the left rail\
|
10 |
7.1 The submission "Status" shows "Success" if your Answer file is a valid JSONL file and all Answers are valid (i.e., comply with the [Answer schema](Answer.json.schema))\
|
11 |
+
7.2 In case the submission "Status" shows "Success", the "Public score" shows the number of valid Answers included in the submitted Answer file
|
12 |
8. You may submit up to 5 Answer files, and optionally select the one you'd like to be evaluated by checking its “Selected” box in the “My submission” tab
|
13 |
9. The evaluated Answer file will be the last selected valid submission made before the session end time. In case no selected valid submission is made before session end time, we’ll evaluate the last valid submission made in time
|
14 |
10. We accept partial submissions where not all questions are answered due to time limitation or any other reason
|