Orensomekh commited on
Commit
491a2cb
·
verified ·
1 Parent(s): bc4d3b1

Create Submission_Instructions.md

Browse files
Operational_Instructions/Submission_Instructions.md ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ We use the HuggingFace submission mechanism:
2
+ 1. Go to the [LiveRAG Challenge HuggingFace page](https://huggingface.co/spaces/LiveRAG/Challenge)
3
+ 2. Login by clicking the blue bar on the left rail says "Login with Hugging Face"
4
+ 3. Click "New submission" on the left rail
5
+ 4. In the pop-up window click "Choose File" and choose your Answer file\
6
+ 4.1 You may add a submission description (optional)
7
+ 5. Click "Submit" to submit your Answer file
8
+ 6. If the Answer file was successfully uploaded, you will see the message: "Success! You have 4 submissions remaining today"
9
+ 7. To view your submission information, click "Cancel" in the pop-up window and then click "My submission" in the left rail\
10
+ 7.1 The submission "Status" shows "Success" if your Answer file is a valid JSONL file\
11
+ 7.2 The submission "Public score" shows the percentage of valid Answers (i.e., those that comply with the [Answer schema](Answer.json.schema))
12
+ 8. You may submit up to 5 Answer files, and optionally select the one you'd like to be evaluated by checking its “Selected” box in the “My submission” tab
13
+ 9. The evaluated Answer file will be the last selected valid submission made before the session end time. In case no selected valid submission is made before session end time, we’ll evaluate the last valid submission made in time
14
+ 10. We accept partial submissions where not all questions are answered due to time limitation or any other reason