Submission FAILED - how to debug this?

#4
by ajuric - opened

What can I do if my submissions fails?

I just see message FAILED :/
Is there a way to debug this? Can I get info why it FAILED?

Urban Scene Modeling Competition CVPR 2025 (Image Track) org

Do you know your submission id?

Hi! Thank you for picking this up :)

These two:
894a9dc2efcf59ecd0f39a2d78bf8b5738230982__6fde0bcc-4859-4d14-88d8-00c2a509a8ed
65f131e412b21102c09ba56867a872a4e521a52a__e607f55e-0ea2-40f6-b80f-fa57b2bb67f4

Hi @dmytromishki, any news? :)

Sorry for bothering this late, the deadline is close, as you know :D

Urban Scene Modeling Competition CVPR 2025 (Image Track) org

@ajuric well, one could start a bit earlier as well :)

Regarding the submission error - here it is

  File "/tmp/model/script.py", line 18, in <module>
    from example_solutions import predict_wireframe
  File "/tmp/model/example_solutions.py", line 1015, in <module>
    gestalt_segmentations: List[PImage],
  File "/app/env/lib/python3.10/typing.py", line 312, in inner
    return func(*args, **kwds)
  File "/app/env/lib/python3.10/typing.py", line 1143, in __getitem__
    params = tuple(_type_check(p, msg) for p in params)
  File "/app/env/lib/python3.10/typing.py", line 1143, in <genexpr>
    params = tuple(_type_check(p, msg) for p in params)
  File "/app/env/lib/python3.10/typing.py", line 176, in _type_check
    raise TypeError(f"{msg} Got {arg!r:.100}.")
TypeError: Parameters to generic types must be types. Got <module 'PIL.Image' from '/app/env/lib/python3.10/site-packages/PIL/Image.py'>.

I have submitted the baseline submission myself to just check if that error is caused by the some sudden change in HF configuration, or it is in your submission.
Baseline submission is going fine, so there is some problem with your file indeed.

Urban Scene Modeling Competition CVPR 2025 (Image Track) org

And for another it is similar

File "/tmp/model/script.py", line 18, in
from example_solutions import predict_wireframe
File "/tmp/model/example_solutions.py", line 1015, in
gestalt_segmentations: List[PImage],
File "/app/env/lib/python3.10/typing.py", line 312, in inner
return func(*args, **kwds)
File "/app/env/lib/python3.10/typing.py", line 1143, in getitem
params = tuple(_type_check(p, msg) for p in params)
File "/app/env/lib/python3.10/typing.py", line 1143, in
params = tuple(_type_check(p, msg) for p in params)
File "/app/env/lib/python3.10/typing.py", line 176, in _type_check
raise TypeError(f"{msg} Got {arg!r:.100}.")

Urban Scene Modeling Competition CVPR 2025 (Image Track) org

@dmytromishkin @ajuric I am online and can grab logs for the reat of the day. I'm in PST.

Thanks a lot! :)

Oh no, never thought I'd be here a couple of hours before the deadline. My latest submission failed after an hour, @dmytromishkin , has the deadline stopped new submissions from being run already?

Urban Scene Modeling Competition CVPR 2025 (Image Track) org

@donquicode what is the submission id?

Urban Scene Modeling Competition CVPR 2025 (Image Track) org

maybe this means it was an HF failure? either that or your alg is too slow? I can click restart on the job or you can resub as you prefer.

2025-06-06 20:36:38.269 | ERROR | competitions.utils:wrapper:241 - run has failed due to an exception: Traceback (most recent call last): File "/app/competitions/utils.py", line 238, in wrapper return func(*args, **kwargs) File "/app/competitions/evaluate.py", line 124, in run evaluation = compute_metrics(params) File "/app/competitions/compute_metrics.py", line 20, in compute_metrics evaluation = metric.compute(params) File "/app/.cache/hub/datasets--usm3d--S23DR2025/snapshots/186e808c8f56676430dc7ecadd81b50ffac04d90/metric.py", line 100, in compute results = Parallel(n_jobs=num_cores, timeout=200)(delayed(process_sample)(sample, submission, WORST_SCORE) for sample in tqdm(dataset)) File "/app/env/lib/python3.10/site-packages/joblib/parallel.py", line 2007, in __call__ return output if self.return_generator else list(output) File "/app/env/lib/python3.10/site-packages/joblib/parallel.py", line 1650, in _get_outputs yield from self._retrieve() File "/app/env/lib/python3.10/site-packages/joblib/parallel.py", line 1772, in _retrieve batched_results = batched_results.get_result(self.timeout) File "/app/env/lib/python3.10/site-packages/joblib/parallel.py", line 745, in get_result return self._return_or_raise() File "/app/env/lib/python3.10/site-packages/joblib/parallel.py", line 763, in _return_or_raise raise self._result multiprocessing.context.TimeoutError

@jacklangerman a7ac9e061b86acc7c964fdd1ff388ced31959611__5a660934-74ad-4c1b-8c8d-85b077430275
Thanks for looking into this!

Urban Scene Modeling Competition CVPR 2025 (Image Track) org

see above: posted error.

Sorry for the delay, HF rate-limited me lol
This could be a HF fail, as they were offline for half an hour today. Please, restart the job if you can, as I already used my submissions for the day
Thank you again!

Urban Scene Modeling Competition CVPR 2025 (Image Track) org

done

Sign up or log in to comment