Skip to content

Commit bc8ac55

Browse files
author
Ashkan Vedadi Gargary
committed
add meta-json readme
1 parent fdfa66c commit bc8ac55

File tree

2 files changed

+15
-3
lines changed

2 files changed

+15
-3
lines changed

dataset/readme.md

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,4 +7,14 @@ Two sample datasets are included in `dataset` folder. Large datasets (used in pe
77

88
### Scalability
99

10-
The scalability folder is only for reproduced use of Scalability Result of our paper.
10+
The scalability folder is only for reproduced use of Scalability Result of our paper.
11+
12+
13+
### MetaJSON
14+
Since metaJSON will work only for branchless json files with pre-defined schema, we modify three of our datasets (Walmart, Bestbuy, Twitter) and store them into the `meta_json` directory from https://drive.google.com/drive/folders/1PkDEy0zWOkVREfL7VuINI-m9wJe45P2Q?usp=sharing link.
15+
16+
It contatins:
17+
- 3 .JSON files
18+
- 3 .cuh files
19+
20+
Per each dataset, you should replace the `data_def.cuh` with the requested dataset .cuh file (from the metaJSON files), later follow the running and compiling commands of meta-json repository (https://github.com/mis-wut/meta-json-parser).

paper_reproduced/scripts/README.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -89,6 +89,9 @@ If you'd like to run both methods together, use the following:
8989
run_all_fig11.sh
9090
```
9191

92+
> **Note**: MetaJSON is not included in performance tests as it requires very huge compile time and only works for a few simplified test cases without branches. We include it only to show that our proposed method outperforms it. MetaJSON discusses how to parse JSON objects with a fixed JSON schema, which greatly simplifies the task of data de-serialization. However, if you want to test meta-json, you can follow their github repository: https://github.com/mis-wut/meta-json-parser . For datasets, please refer to our `dataset` folder and its corresponding `readme` since we have specific json files the preprocessed for `meta-json`.
93+
94+
9295
#### Results Location:
9396
- All method results are stored in `scripts/results/fig11_data.csv`.
9497
- Individual results can be found in `scripts/results/` under:
@@ -124,7 +127,7 @@ To run all methods together:
124127
./run_all_fig12.sh
125128
```
126129

127-
> **Note**: MetaJSON is not included in performance tests as it requires very huge compile time and only works for a few simplified test cases without branches. We include it only to show that our proposed method outperforms it.
130+
> **Note**: MetaJSON is not included in performance tests as it requires very huge compile time and only works for a few simplified test cases without branches. We include it only to show that our proposed method outperforms it. MetaJSON discusses how to parse JSON objects with a fixed JSON schema, which greatly simplifies the task of data de-serialization. However, if you want to test meta-json, you can follow their github repository: https://github.com/mis-wut/meta-json-parser . For datasets, please refer to our `dataset` folder and its corresponding `readme` since we have specific json files the preprocessed for `meta-json`.
128131
129132
#### Results Location:
130133
- All method results are stored in `scripts/results/fig12_data.csv`.
@@ -284,7 +287,6 @@ For running the cuJSON make sure to edit the `-gencode=arch=compute_61,code=sm_6
284287
- For running the cuJSON make sure to edit the `-gencode=arch=compute_61,code=sm_61` in the compile line of the scripts based on your GPU compatibilty version.
285288

286289

287-
288290
---
289291

290292
## Figures Generator

0 commit comments

Comments
 (0)