01Yassine commited on
Commit
609e630
·
verified ·
1 Parent(s): ad22150

Update index.html

Browse files
Files changed (1) hide show
  1. index.html +1 -64
index.html CHANGED
@@ -56,69 +56,6 @@
56
  This task helps diagnose and localize pronunciation errors, enabling educational feedback in applications like Qur’anic tutoring or speech evaluation tools.
57
  </p>
58
 
59
- <!-- <h2>Task Description</h2>
60
- <p>
61
- The Iqra’Eval shared task focuses on automatic mispronunciation detection and diagnosis in Qur’anic recitation. Given:
62
- </p>
63
- <ol>
64
- <li>A speech segment (an audio clip of a Qur’anic verse recitation), and</li>
65
- <li>A fully vowelized reference transcript (the corresponding Qur’anic text, fully diacritized),</li>
66
- </ol>
67
- <p>
68
- the goal is to identify any pronunciation errors, localize them within the phoneme sequence, and classify the type of error based on Tajweed rules.
69
- </p>
70
- <p>
71
- Each participant’s system must predict the sequence of phonemes that the reciter actually produced. A standardized phonemizer (Nawar Halabi’s phonetizer) will be used to generate the “gold” phoneme sequence from the reference transcript for comparison.
72
- </p>
73
- <p>
74
- <strong>Key subtasks:</strong>
75
- </p>
76
- <ul>
77
- <li>Compare predicted phoneme sequence vs. gold reference.</li>
78
- <li>Detect substitutions (e.g., pronouncing /q/ as /k/), deletions (e.g., dropping a hamza), or insertions (e.g., adding an extra vowel) of phonemes.</li>
79
- <li>Localize the error to a specific phoneme index in the utterance.</li>
80
- <li>Classify what type of mistake occurred based on Tajweed (e.g., madd errors, ikhfa, idgham, etc.).</li>
81
- </ul> -->
82
-
83
- <!-- Example & Illustration -->
84
- <!-- <h2>Example</h2>
85
- <p>
86
- Suppose the reference verse (fully vowelized) is:
87
- </p>
88
- <blockquote>
89
- <p>
90
- إِنَّ اللَّهَ عَلَىٰ كُلِّ شَيْءٍ قَدِيرٌ
91
- <br />
92
- (inna l-lāha ʿalā kulli shay’in qadīrun)
93
- </p>
94
- </blockquote>
95
- <p>
96
- The gold phoneme sequence (using the standard phonemizer) might be:
97
- </p>
98
- <pre>
99
- inna l l aa h a ʕ a l a k u l l i ʃ a y ’ i n q a d i r u n
100
- </pre>
101
- <p>
102
- If a reciter mispronounces “قَدِيرٌ” (qadīrun) as “كَدِيرٌ” (kadīrun), that corresponds to a substitution at the very start of that word: phoneme /q/ → /k/.
103
- </p>
104
- <p>
105
- A well-trained system should:
106
- </p>
107
- <ol>
108
- <li>Flag the pronunciation of “قَدِيرٌ” as erroneous,</li>
109
- <li>Identify that the first phoneme in that word was substituted (“/q/” → “/k/”), and</li>
110
- <li>Classify it under the Tajweed error category “Ghunnah/Qaf vs. Kaf error.”</li>
111
- </ol>
112
- <div style="text-align: center; margin: 1em 0;">
113
- <img src="images/pronunciation_assessment_arabic.png" alt="Pronunciation Assessment in Arabic" style="max-width: 100%; height: auto;" />
114
- <p style="font-size: 0.9em; color: #555;">
115
- <em>Figure: Example of a phoneme-level comparison between reference vs. predicted for an Arabic Qur’anic recitation.</em>
116
- </p>
117
- </div> -->
118
-
119
- <!-- Evaluation Criteria -->
120
-
121
- <!-- Dataset Description -->
122
  <h2>Dataset Description</h2>
123
  <p>
124
  All data are hosted on Hugging Face. Two main splits are provided:
@@ -163,7 +100,7 @@ inna l l aa h a ʕ a l a k u l l i ʃ a y ’ i n q a d i r u n
163
 
164
  <h2>Test Data QuranMB</h2>
165
  <p>
166
- To construct a reliable test set, we select 98 verses from the Qur’an, which are read aloud by 18 native Arabic speakers (14 females, 4 males), resulting in approximately 2 hours of recorded speech. The speakers were instructed to read the text in MSA at their normal tempo, disregarding Qur’anic tajweed rules, while deliberately producing the specified pronunciation errors. To ensure consistency in error production, we developed a custom recording tool that highlighted the modified text and displayed additional instructions specifying the type of error (Figure <em>fig:recording</em>). Before recording, speakers were required to silently read each sentence to familiarize themselves with the intended errors before reading them aloud. After recording, three linguistic annotators verified and corrected the transcriptions, and flagged all pronunciation errors for evaluation.
167
  </p>
168
  <ul>
169
  <li><code>df_test = load_dataset("IqraEval/Iqra_QuranMB_v2")</code></li>
 
56
  This task helps diagnose and localize pronunciation errors, enabling educational feedback in applications like Qur’anic tutoring or speech evaluation tools.
57
  </p>
58
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
59
  <h2>Dataset Description</h2>
60
  <p>
61
  All data are hosted on Hugging Face. Two main splits are provided:
 
100
 
101
  <h2>Test Data QuranMB</h2>
102
  <p>
103
+ To construct a reliable test set, we select 98 verses from the Qur’an, which are read aloud by 18 native Arabic speakers (14 females, 4 males), resulting in approximately 2 hours of recorded speech. The speakers were instructed to read the text in MSA at their normal tempo, disregarding Qur’anic tajweed rules, while deliberately producing the specified pronunciation errors. To ensure consistency in error production, we developed a custom recording tool that highlighted the modified text and displayed additional instructions specifying the type of error. Before recording, speakers were required to silently read each sentence to familiarize themselves with the intended errors before reading them aloud. After recording, three linguistic annotators verified and corrected the phoneme sequence and flagged all pronunciation errors for evaluation.
104
  </p>
105
  <ul>
106
  <li><code>df_test = load_dataset("IqraEval/Iqra_QuranMB_v2")</code></li>