Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add training with similar data to paper #13

Open
jacobbieker opened this issue Feb 9, 2022 · 3 comments
Open

Add training with similar data to paper #13

jacobbieker opened this issue Feb 9, 2022 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@jacobbieker
Copy link
Member

Detailed Description

MetNet was trained on GOES and MRMS data, and MetNet-2 on that plus some NWP initialization parameters. All that data is publicly accessible with no restrictions from NOAA, so adding that to HF datasets to make it easy to ideally, reproduce the paper would be great.

Context

This would add GOES-16/17 and MRMS precipitation data to HF Datasets, along with probably the HRRR NWP model for high-resolution data over the US. The data for GOES and HRRR is all available through Amazon open datasets, while the MRMS data has been archived and is fairly easily accessible.

Possible Implementation

@jacobbieker jacobbieker added the enhancement New feature or request label Feb 9, 2022
@jacobbieker jacobbieker self-assigned this Feb 9, 2022
@tarunluthra
Copy link

Hi jacob, what's the best place to source MRMS data?
I am extracting precipitation rate files from here, https://mrms.ncep.noaa.gov/data/2D/PrecipRate/
is there a better source for getting similar data?

@jacobbieker
Copy link
Member Author

The best is probably the archive here: https://mrms.agron.iastate.edu which is a mix of on AWS and on a university's servers. The one you link to is only the near-realtime archive, so older things are deleted fairly quickly (I think a week?)

@tarunluthra
Copy link

Thanks, Jacob. For an initial baseline test of the model, how far back in time do I need to retrieve radar and GOES data? I also noticed that the model takes elevation as an input, so does the DEM need to be patched for the continental US region as some of the precipitation data isn't region specific.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants