A Webcrawler written in Golang

Crawls a single domain, printing out a list of assets and links for each new page that it finds.

Crawl and Scan

Clone the repo into $GOPATH/src and do the following:

get deps:

  # inside the repo
  $ go get

build:

  # inside the repo
  $ go build

crawl and scan:

  python3 scan.py <link>

Output