Update index.html
Browse files- index.html +12 -5
index.html
CHANGED
@@ -110,8 +110,9 @@
|
|
110 |
<ul>
|
111 |
<li><strong>June 1, 2025</strong>: Official announcement</li>
|
112 |
<li><strong>June 10, 2025</strong>: Release of training data, dev set, phonetizer, baselines</li>
|
113 |
-
<li><strong>July
|
114 |
-
<li><strong>July
|
|
|
115 |
<li><strong>July 30, 2025</strong>: Final results released</li>
|
116 |
<li><strong>August 15, 2025</strong>: System description papers due</li>
|
117 |
<li><strong>August 22, 2025</strong>: Notification of acceptance</li>
|
@@ -228,8 +229,8 @@ ID,Labels
|
|
228 |
|
229 |
<h2>Evaluation Criteria</h2>
|
230 |
<p>
|
231 |
-
Leaderboard based on phoneme-level F1-score
|
232 |
-
We use a hierarchical evaluation (detection + diagnostic) per
|
233 |
</p>
|
234 |
<ul>
|
235 |
<li><em>What is said</em>: annotated phoneme sequence</li>
|
@@ -267,7 +268,13 @@ ID,Labels
|
|
267 |
|
268 |
<h2>Future Updates</h2>
|
269 |
<p>
|
270 |
-
Detailed scoring weights, submission templates, and clarifications will be posted on the shared task site
|
|
|
|
|
|
|
|
|
|
|
|
|
271 |
</p>
|
272 |
|
273 |
<h2>References</h2>
|
|
|
110 |
<ul>
|
111 |
<li><strong>June 1, 2025</strong>: Official announcement</li>
|
112 |
<li><strong>June 10, 2025</strong>: Release of training data, dev set, phonetizer, baselines</li>
|
113 |
+
<li><strong>July 20, 2025</strong>: Registration deadline</li>
|
114 |
+
<li><strong>July 24, 2025</strong>: QuranMB test data release</li>
|
115 |
+
<li><strong>July 29, 2025</strong>: Test set submission closes</li>
|
116 |
<li><strong>July 30, 2025</strong>: Final results released</li>
|
117 |
<li><strong>August 15, 2025</strong>: System description papers due</li>
|
118 |
<li><strong>August 22, 2025</strong>: Notification of acceptance</li>
|
|
|
229 |
|
230 |
<h2>Evaluation Criteria</h2>
|
231 |
<p>
|
232 |
+
IqraEval Leaderboard is based on phoneme-level <strong>F1-score</strong>.
|
233 |
+
We use a hierarchical evaluation (detection + diagnostic) per <a href="https://arxiv.org/pdf/2310.13974" target="_blank">MDD Overview</a>.
|
234 |
</p>
|
235 |
<ul>
|
236 |
<li><em>What is said</em>: annotated phoneme sequence</li>
|
|
|
268 |
|
269 |
<h2>Future Updates</h2>
|
270 |
<p>
|
271 |
+
Detailed scoring weights, submission templates, and clarifications will be posted on the shared task site (June 15, 2025).
|
272 |
+
</p>
|
273 |
+
|
274 |
+
<h2>Contact and Support</h2>
|
275 |
+
<p>
|
276 |
+
For inquiries and support, reach out to the task coordinators at
|
277 |
+
<a href="mailto:iqraeval@googlegroups.com">iqraeval@googlegroups.com</a>.
|
278 |
</p>
|
279 |
|
280 |
<h2>References</h2>
|