Skip to content

keithwoody/kwrawler-python

Folders and files

NameName
Last commit message
Last commit date

Latest commit

91cb4d9 · Jan 29, 2014

History

14 Commits
Jan 27, 2014
Jan 29, 2014
Jan 29, 2014
Jan 27, 2014
Jan 27, 2014
Jan 27, 2014
Jan 24, 2014
Jan 27, 2014
Jan 25, 2014
Jan 27, 2014

Repository files navigation

# Kwrawler

Pronounced "crawler" but I shoe-horned my initials in there, how clever.

Requires nokogiri and ruby-graphviz during runtime.

Crawls a single domain without traversing external links and outputs a sitemap
showing:

1. which static assets each page depends on (imgs, script srcs, and stylesheets)
2. the links between pages

Sitemap can be exported as :png, :jpg, :dot or any GraphViz supported format


About

python implementation of my kwrawler gem

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published