Orensomekh commited on
Commit
b9c85af
·
verified ·
1 Parent(s): 49df78d

Delete Operational_Instructions/DM_Sandbox.md

Browse files
Operational_Instructions/DM_Sandbox.md DELETED
@@ -1,45 +0,0 @@
1
- # DataMorgana Sandbox
2
-
3
- 1. Sign in to the [AI71 website](https://platform.ai71.ai/login)
4
-
5
- 2. Click on "DataMorgana" at the left rail, and then click "New test" to start generating Q&A pairs
6
-
7
- 3. Question/User Categorizations\
8
- 3.1 Each Categorization includes a Name\
9
- 3.2 You may use the default Categorizations or add new ones\
10
- 3.3 You can choose multiple Categorization (e.g., choosing "Factuality" and "Formulation" Question Categorizations)\
11
- 3.4 Categorizations includes multiple Categories (e.g., "User-Expertise" includes two categories, "Expert" and "Novice")\
12
- 3.4.1 Expand a Categorization by clicking the caret icon on its right-hand side to reveal its Categories
13
-
14
- 4. Question Categories\
15
- 4.1 Each Category includes a Name, a Description, and a "Multi-doc" checkbox\
16
- 4.2 You may use the default Categories or add new ones\
17
- 4.3 Each Categorization allows only one selected Category (e.g., "Factoid" or "Open-ended" under "Factuality" Categorization)\
18
- 4.3.1 In case at least one selected Question Categorization includes a selected Question Category which is checked for "Multi-doc", the generated Q&A will consider exactly two docs (i.e., "Multi-doc" request). Otherwise, it considers only one doc (i.e., "Single-doc" request)
19
-
20
- 5. User Categories\
21
- 5.1 Each Category includes a Name and a Description\
22
- 5.2 You may use the default Categories or add new ones\
23
- 5.3 Each Categorization allows only one selected Category (e.g., "Expert" or "Novice" under "User-Expertise" Categorization)
24
-
25
- 6. Once you set the Question/User Categorizations and their Categories:\
26
- 6.1 For "Multi-doc" requests you may enter **two** FineWeb document IDs (e.g., "\<urn:uuid:d69cbebc-133a-4ebe-9378-68235ec9f091\>") or **none**, in the respective box\
27
- 6.2 For "Single-doc" requests you may enter **one** FineWeb document ID or **none**, in the respective box\
28
- 6.1 If you leave the document ID field(s) empty, a random document(s) will be assigned automatically
29
-
30
- 7. Click the "Generate" black button on the top right to generate a DataMorgana synthetic Q&A pair\
31
- 7.1 The results (i.e., question, answer, doc(s), doc ID(s), and Question/User Categorizations information) will appear momentarily in a new page\
32
- 7.2 You may copy the results to the clipboard by clicking the "Copy to Clipboard" button, or return to the setting page by clicking the "Clear" button\
33
- 7.3 You may find Q&A pair examples [here](https://docs.google.com/spreadsheets/d/1rWzRiFVRWHUruP5vK4P6PNxgZgpi9OLX5YRi5Kc7k4g/edit?usp=sharing)
34
-
35
- 8. Your remaining Q&A pairs budget is displayed by a counter at the top center
36
-
37
- 9. You may use JSON mode for entering and editing Question/User Categorizations/Categories, by sliding the knob at the top to "JSON Editor"\
38
- 9.1 Follow the JSON Schema on the bottom right for correct Categorizations/Categories setting\
39
- 9.2 In case your resulting JSON is correct, it will be reflected in the "Visual Editor" once the knob at the top is shifted left
40
-
41
- 10. The default Categorizations/Categories settings may be restored by refreshing the page
42
-
43
-
44
-
45
-