ipfs-crawl

Crawl DHT logs for requested files, primitively check if the file is ASCII.

python3 crawler.py

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
myipfsapi		myipfsapi
.gitignore		.gitignore
IPFS Analysis.ipynb		IPFS Analysis.ipynb
README.md		README.md
crawler.py		crawler.py
google-search-results.txt		google-search-results.txt
google_crawler.py		google_crawler.py
ipfs_dht_results.txt		ipfs_dht_results.txt
ipfs_hashes.txt		ipfs_hashes.txt
ipfs_web_crawl_hashes.txt		ipfs_web_crawl_hashes.txt
ipfs_web_crawl_results.txt		ipfs_web_crawl_results.txt
ls.py		ls.py
process_web_crawl_results.py		process_web_crawl_results.py
web_crawler		web_crawler
web_crawler.go		web_crawler.go
web_crawler.py		web_crawler.py
wikipedia_results.txt		wikipedia_results.txt

Provide feedback