This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

Could an example task.json be provided #113

Open

walterwang opened this issue Sep 28, 2021 · 1 comment

Assignees

walterwang commented Sep 28, 2021

For TaskIO, I was wondering what should the task.json file look like for the existing tasks. Thanks

mazhiyi assigned TristanThrush

Contributor

TristanThrush commented Sep 28, 2021

The task.json is not something that Dynalab users have to define themselves. It is provided by the task owner and loaded by Dynalab automatically. For any dynabench task, you should be able to inspect the task IO by following this README: https://github.com/facebookresearch/dynalab/blob/37b61e54dcbf43f76a447b290c44c1d5244ca1a7/dynalab/tasks/README.md

If you want even more info about task IO, feel free to read this too:
https://github.com/facebookresearch/dynabench/blob/main/docs/owners.md#annotation-configs

Let me know if there are issues with these documents.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.