Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 10, 2019

• Merge pull request gocolly#412 from soulbird/master

  Show description for cb6f0ac
  asciimoo

  authored
  cb6f0ac

  Copy full SHA for cb6f0ac

• Update go.mod github.com/gocolly/colly/v2

  sky126

  committed
  b83ae6d

  Copy full SHA for b83ae6d

Commits on Dec 6, 2019

• add depth for Marshal

  

  zhaoshirui

  committed
  403d4e6

  Copy full SHA for 403d4e6

Commits on Nov 15, 2019

• Merge pull request gocolly#277 from propertechnologies/master

  Show description for 190354a
  asciimoo

  authored
  190354a

  Copy full SHA for 190354a

• Merge pull request gocolly#295 from llonchj/redirect-handler-bugfix

  Show description for 152334a
  asciimoo

  authored
  152334a

  Copy full SHA for 152334a

• Merge pull request gocolly#382 from husniadil/patch-1

  Show description for a20f330
  asciimoo

  authored
  a20f330

  Copy full SHA for a20f330

Commits on Nov 10, 2019

• adding ability to check if a URL has been visited.

  alejandro-carstens

  committed
  01d4d92

  Copy full SHA for 01d4d92

Commits on Sep 22, 2019

• Fix MAX_DEPTH variable assignment

  Show description for ade4a0e
  husniadil

  authored
  ade4a0e

  Copy full SHA for ade4a0e

Commits on Aug 12, 2019

• Factor out CollectorOption type

  twpayne

  committed
  f580b06

  Copy full SHA for f580b06

Commits on May 6, 2019

• remove Scheme default for better error message

  Show description for a3d6529
  

  Joshua Crowgey

  committed
  a3d6529

  Copy full SHA for a3d6529

Commits on Apr 8, 2019

• Merge pull request gocolly#296 from JohnZhao1208/fix-runtime-error-when-proxy-is-empty

  Show description for b3d9910
  asciimoo

  authored
  b3d9910

  Copy full SHA for b3d9910

• Merge pull request gocolly#311 from vosmith/old_cookies

  Show description for 71caaa2
  asciimoo

  authored
  71caaa2

  Copy full SHA for 71caaa2

Commits on Apr 1, 2019

• Fix memory leaks via not closing http.Response.Body.

  Show description for 4748610
  

  example

  committed
  4748610

  Copy full SHA for 4748610

Commits on Mar 18, 2019

• Remove code that copies headers on redirect

  Show description for 387623b
  vosmith

  committed
  387623b

  Copy full SHA for 387623b

Commits on Mar 13, 2019

• Merge pull request gocolly#306 from jredl-va/gzip-sitemaps

  Show description for 9192be9
  asciimoo

  authored
  9192be9

  Copy full SHA for 9192be9

• [fix] using URL.Hostname() instead of URL.Host when calling Collector.isDomainAllowed

  nange

  committed
  2751692

  Copy full SHA for 2751692

Commits on Mar 12, 2019

• Decompress if content-type is set to gzip instead of content encoding.

  Show description for 14aea00
  jredl-va

  committed
  14aea00

  Copy full SHA for 14aea00

Commits on Mar 6, 2019

• Update colly.go

  letum

  authored
  db1acfd

  Copy full SHA for db1acfd

Commits on Mar 4, 2019

• Fix checkRobots ignoring query parameters

  

  Anssi Junnola

  committed
  1ebddaf

  Copy full SHA for 1ebddaf

Commits on Feb 26, 2019

• Update colly.go

  JohnZhao1208

  authored
  33cbcd0

  Copy full SHA for 33cbcd0

Commits on Feb 23, 2019

• SetRedirectHandler bugfix (breaking changes)

  llonchj

  committed
  cb07e6d

  Copy full SHA for cb07e6d

Commits on Feb 21, 2019

• [fix] clone CheckHead attribute too

  asciimoo

  committed
  389bc3c

  Copy full SHA for 389bc3c

Commits on Feb 7, 2019

• if the Host header is set, then set the Host field on http.Request

  mmaxim

  committed
  9a56fbe

  Copy full SHA for 9a56fbe

Commits on Feb 4, 2019

• [fix] xpath tests

  asciimoo

  committed
  ca690f8

  Copy full SHA for ca690f8

• [fix] use latest htmlquery - closes gocolly#280

  asciimoo

  committed
  c64a584

  Copy full SHA for c64a584

Commits on Jan 26, 2019

• Add SetClient to set custom http client

  Show description for fce236d
  geertweening

  committed
  fce236d

  Copy full SHA for fce236d

Commits on Jan 21, 2019

• Merge pull request gocolly#262 from qianlei90/patch-1

  Show description for 85daab4
  asciimoo

  authored
  85daab4

  Copy full SHA for 85daab4

Commits on Dec 14, 2018

• fix proxy url empty when response error

  qianlei90

  authored
  7e95155

  Copy full SHA for 7e95155

Commits on Dec 7, 2018

• Check URL availability before visiting

  Show description for 186e34b
  iPhosgen

  committed
  186e34b

  Copy full SHA for 186e34b

Commits on Sep 17, 2018

• use iota as ProxyURLKey value

  pyjac

  committed
  d98253d

  Copy full SHA for d98253d

• Proxy URL for request

  Show description for 78b4030
  pyjac

  committed
  78b4030

  Copy full SHA for 78b4030

Commits on Aug 22, 2018

• [fix] golint

  asciimoo

  committed
  06fbb2c

  Copy full SHA for 06fbb2c

• [enh] add Index attribute to HTMLElement - closes gocolly#211

  asciimoo

  committed
  d4e95b5

  Copy full SHA for d4e95b5

Commits on Aug 7, 2018

• Make appengine func take context.Context rather than an *http.Request

  Show description for affa2bc
  peterellisjones

  committed
  affa2bc

  Copy full SHA for affa2bc

Commits on Jul 4, 2018

• Don't share wg field in Collector.Clone function

  nange

  committed
  6ddb8e2

  Copy full SHA for 6ddb8e2

Pagination

Previous

Next