Question about the reproducibility of ScanQA baseline

[tengfeixue-victor]

Hi,

Thanks a lot for sharing your amazing dataset and code. Much appreciated!!
I tried to run the ScanQA baseline using your code. The highest accuracy I could get is 45.8 (got an average accuracy of ~44), which is still a tiny gap to the reported accuracy (47.2) in your paper. I am wondering if there are some potential reasons leading to this performance drop on my end. BTW, I ran the test code using your pre-trained weight, which gave me the reported accuracy (47.2).

[venom12138]

The same question, have you solved that?

[LZ-CH]

The same question, have you solved that?