Skip to content

a64e4611 is almost 100x slower than any other test #26

@cirosantilli

Description

@cirosantilli

https://arcprize.org/play?task=a64e4611

This suggests that there is something missing in the DSL to better account for that example, and which could be used for other examples as well.

The slowest solvers are:

b775ac94 5.623
b527c5c6 5.646                                                                                                                                                               
5daaa586 5.74                                                                                                                                                                
91714a58 6.227                                                                                                                                                               
50846271 7.112                                                                                                                                                               
c3f564a4 7.158                                                                                                                                                               
83302e8f 7.176                                                                                                                                                               
ef135b50 8.269                                                                                                                                                               
3631a71a 8.536                                                                                                                                                               
db3e9e38 10.587                                                                                                                                                              
caa06a1f 10.66                                                                                                                                                               
06df4c85 10.923                                                                                                                                                              
6a1e5592 11.76                                                                                                                                                               
0e206a2e 15.301                                                                                                                                                              
7df24a62 16.034                                                                                                                                                              
36fdfd69 16.216                                                                                                                                                              
97a05b5b 16.466                                                                                                                                                              
3eda0437 17.651                                                                                                                                                              
29ec7d0e 17.812                                                                                                                                                              
264363fd 17.934                                                                                                                                                              
36d67576 18.919                                                                                                                                                              
0dfd9992 24.388                                                                                                                                                              
6aa20dc0 27.99                                                                                                                                                               
484b58aa 56.837                                                                       
d22278a0 79.392                                                                       
a64e4611 4788.938

so we see that a64e4611 is far far worse than any other.

Looking at the task immediately suggests why, ass it appears to require very high resolution visual processing comparing to other tasks:

Image

Benchmarked with this: https://github.com/arc-dsl-2/arc-dsl-2/blob/1e1b66eea1e6c3986469438ea4a1d76d0eb5b7a8/main.py#L126

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions