This repository contains the ARC task data, as well as a browser-based interface for humans to try their hand at solving the tasks manually. Additionally, we have added 7 tasks to the original ARC tasks based on the Core Knowledge priors of sequence generation, iteration, hierarchy, recursion and the notion of "us vs. them". These tasks are placed in the additions folder inside the data folder.
As a reminder, a test-taker is said to solve a task when, upon seeing the task for the first time, they are able to produce the correct output grid for all test inputs in the task (this includes picking the dimensions of the output grid). For each test input, the test-taker is allowed 3 trials (this holds for all test-takers, either humans or AI).
The testing interface is located at apps/testing_interface.html. Open it in a web browser (Chrome recommended). It will prompt you to select a task JSON file.
After loading a task, you will enter the test space, which looks like this:
On the left, you will see the input/output pairs demonstrating the nature of the task. In the middle, you will see the current test input grid. On the right, you will see the controls you can use to construct the corresponding output grid.