Spaces:
Running
Running
Delete Operational_Instructions/DM_Sandbox.md
Browse files
Operational_Instructions/DM_Sandbox.md
DELETED
@@ -1,45 +0,0 @@
|
|
1 |
-
# DataMorgana Sandbox
|
2 |
-
|
3 |
-
1. Sign in to the [AI71 website](https://platform.ai71.ai/login)
|
4 |
-
|
5 |
-
2. Click on "DataMorgana" at the left rail, and then click "New test" to start generating Q&A pairs
|
6 |
-
|
7 |
-
3. Question/User Categorizations\
|
8 |
-
3.1 Each Categorization includes a Name\
|
9 |
-
3.2 You may use the default Categorizations or add new ones\
|
10 |
-
3.3 You can choose multiple Categorization (e.g., choosing "Factuality" and "Formulation" Question Categorizations)\
|
11 |
-
3.4 Categorizations includes multiple Categories (e.g., "User-Expertise" includes two categories, "Expert" and "Novice")\
|
12 |
-
3.4.1 Expand a Categorization by clicking the caret icon on its right-hand side to reveal its Categories
|
13 |
-
|
14 |
-
4. Question Categories\
|
15 |
-
4.1 Each Category includes a Name, a Description, and a "Multi-doc" checkbox\
|
16 |
-
4.2 You may use the default Categories or add new ones\
|
17 |
-
4.3 Each Categorization allows only one selected Category (e.g., "Factoid" or "Open-ended" under "Factuality" Categorization)\
|
18 |
-
4.3.1 In case at least one selected Question Categorization includes a selected Question Category which is checked for "Multi-doc", the generated Q&A will consider exactly two docs (i.e., "Multi-doc" request). Otherwise, it considers only one doc (i.e., "Single-doc" request)
|
19 |
-
|
20 |
-
5. User Categories\
|
21 |
-
5.1 Each Category includes a Name and a Description\
|
22 |
-
5.2 You may use the default Categories or add new ones\
|
23 |
-
5.3 Each Categorization allows only one selected Category (e.g., "Expert" or "Novice" under "User-Expertise" Categorization)
|
24 |
-
|
25 |
-
6. Once you set the Question/User Categorizations and their Categories:\
|
26 |
-
6.1 For "Multi-doc" requests you may enter **two** FineWeb document IDs (e.g., "\<urn:uuid:d69cbebc-133a-4ebe-9378-68235ec9f091\>") or **none**, in the respective box\
|
27 |
-
6.2 For "Single-doc" requests you may enter **one** FineWeb document ID or **none**, in the respective box\
|
28 |
-
6.1 If you leave the document ID field(s) empty, a random document(s) will be assigned automatically
|
29 |
-
|
30 |
-
7. Click the "Generate" black button on the top right to generate a DataMorgana synthetic Q&A pair\
|
31 |
-
7.1 The results (i.e., question, answer, doc(s), doc ID(s), and Question/User Categorizations information) will appear momentarily in a new page\
|
32 |
-
7.2 You may copy the results to the clipboard by clicking the "Copy to Clipboard" button, or return to the setting page by clicking the "Clear" button\
|
33 |
-
7.3 You may find Q&A pair examples [here](https://docs.google.com/spreadsheets/d/1rWzRiFVRWHUruP5vK4P6PNxgZgpi9OLX5YRi5Kc7k4g/edit?usp=sharing)
|
34 |
-
|
35 |
-
8. Your remaining Q&A pairs budget is displayed by a counter at the top center
|
36 |
-
|
37 |
-
9. You may use JSON mode for entering and editing Question/User Categorizations/Categories, by sliding the knob at the top to "JSON Editor"\
|
38 |
-
9.1 Follow the JSON Schema on the bottom right for correct Categorizations/Categories setting\
|
39 |
-
9.2 In case your resulting JSON is correct, it will be reflected in the "Visual Editor" once the knob at the top is shifted left
|
40 |
-
|
41 |
-
10. The default Categorizations/Categories settings may be restored by refreshing the page
|
42 |
-
|
43 |
-
|
44 |
-
|
45 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|