This script fetches a a dataset from a link then performs a cleaning operation using pyspark and returns the result in json This is a flask app which uses pyspark library to perform cleaning operations on on a web fetched dataset which is in json format. After fetching the data it converts it into a Pyspark dataframe.
-
Notifications
You must be signed in to change notification settings - Fork 0
ghollah/Psyspark_Cleaning_Script
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This script fetches a a dataset from a link then performs a cleaning operation using pyspark and returns the result in json
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published