Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 10, 2023

• Support websites redirecting to the same page

  Show description for b4ca6a7
  WGH-

  committed
  b4ca6a7

  Copy full SHA for b4ca6a7

Commits on Jan 16, 2023

• [fix] update MaxRequests docstring

  asciimoo

  committed
  f6c3125

  Copy full SHA for f6c3125

• Merge pull request gocolly#749 from WGH-/fix-ci

  Show description for e853c5b
  asciimoo

  authored
  e853c5b

  Copy full SHA for e853c5b

• Reformat source comments according to Go 1.19

  Show description for 739f165
  WGH-

  committed
  739f165

  Copy full SHA for 739f165

Commits on Aug 16, 2022

• feat: Add MaxRequests parameter

  Show description for 521f430
  guilhem

  committed
  521f430

  Copy full SHA for 521f430

Commits on Jul 6, 2022

• [fix] typo

  asciimoo

  committed
  947eeea

  Copy full SHA for 947eeea

• [fix] golint

  asciimoo

  committed
  9a6ffcc

  Copy full SHA for 9a6ffcc

Commits on Mar 10, 2022

• Fix redirects ignoring AllowURLRevisit=false

  Show description for 0be3b71
  WGH-

  committed
  0be3b71

  Copy full SHA for 0be3b71

Commits on Mar 8, 2022

• Merge pull request gocolly#678 from WGH-/code-cleanup

  Show description for b151a08
  asciimoo

  authored
  b151a08

  Copy full SHA for b151a08

• Merge pull request gocolly#691 from ErikOwen/feat/custom-header-support

  Show description for a611094
  asciimoo

  authored
  a611094

  Copy full SHA for a611094

• Merge pull request gocolly#675 from WGH-/single-percent-in-path

  Show description for f661193
  asciimoo

  authored
  f661193

  Copy full SHA for f661193

Commits on Mar 5, 2022

• add support for custom headers, specifically Host header

  

  Erik Owen

  authored and

  Erik Owen

  committed
  74665a0

  Copy full SHA for 74665a0

Commits on Feb 1, 2022

• Refactor body hashing

  Show description for 4e8e0d7
  WGH-

  committed
  4e8e0d7

  Copy full SHA for 4e8e0d7

• Use request.GetBody for request hashing

  Show description for e3a2307
  WGH-

  committed
  e3a2307

  Copy full SHA for e3a2307

• Use http.NewRequest instead of &http.Request{...}

  Show description for 83c6f80
  WGH-

  committed
  83c6f80

  Copy full SHA for 83c6f80

• Fix domain and other filters to handle HTTP redirects

  Show description for ef63c68
  joelazar

  authored
  ef63c68

  Copy full SHA for ef63c68

Commits on Jan 28, 2022

• Merge pull request gocolly#652 from lijingbo8119/master

  Show description for 50672b2
  WGH-

  authored
  50672b2

  Copy full SHA for 50672b2

Commits on Jan 12, 2022

• Work around invalid URL encoding in path

  Show description for 343a556
  WGH-

  committed
  343a556

  Copy full SHA for 343a556

Commits on Dec 29, 2021

• Use github.com/nlnwa/whatwg-url for URL parsing

  Show description for ae3b017
  WGH-

  committed
  ae3b017

  Copy full SHA for ae3b017

Commits on Sep 30, 2021

• Update colly.go

  Show description for 669abce
  ljbink

  authored
  669abce

  Copy full SHA for 669abce

Commits on Mar 10, 2021

• Fix default User-Agent when using custom headers

  Show description for 84585f9
  WGH-

  committed
  84585f9

  Copy full SHA for 84585f9

Commits on Dec 17, 2020

• SetProxyFunc: fix proxies rotation

  wowinter13

  committed
  9a7a996

  Copy full SHA for 9a7a996

Commits on Nov 30, 2020

• Fix race on count fields of Collector type

  Show description for ddc0839
  shubham14bajpai

  committed
  ddc0839

  Copy full SHA for ddc0839

Commits on Nov 24, 2020

• Fix handling of redirected URLs in OnResponseHeaders

  Show description for bc1e233
  WGH-

  committed
  bc1e233

  Copy full SHA for bc1e233

Commits on Oct 13, 2020

• Merge pull request gocolly#548 from WGH-/collector-context

  Show description for 8252c34
  asciimoo

  authored
  8252c34

  Copy full SHA for 8252c34

Commits on Oct 11, 2020

• fix invalid base url assignment

  

  Igor Vitcovschii

  committed
  17c98b1

  Copy full SHA for 17c98b1

Commits on Oct 9, 2020

• Add context.Context support

  Show description for b02f0ab
  WGH-

  committed
  b02f0ab

  Copy full SHA for b02f0ab

Commits on Apr 29, 2020

• Fix relative <base> URL

  Show description for 6058416
  WGH-

  committed
  6058416

  Copy full SHA for 6058416

Commits on Apr 26, 2020

• fix revisit detection and fixing/adding tests

  asalih

  committed
  adc32e2

  Copy full SHA for adc32e2

Commits on Apr 11, 2020

• Same request detection improvement

  Show description for caddf98
  asalih

  authored
  caddf98

  Copy full SHA for caddf98

Commits on Mar 15, 2020

• make async parameter optional

  zyt312074545

  committed
  103312b

  Copy full SHA for 103312b

Commits on Mar 9, 2020

• Async delete parameter

  zyt312074545

  committed
  129938c

  Copy full SHA for 129938c

Commits on Mar 7, 2020

• CollectorOption add CheckHead method

  zyt312074545

  committed
  e19453d

  Copy full SHA for e19453d

Commits on Mar 2, 2020

• Added Queue full error

  paulheijman

  authored
  dd6ec0f

  Copy full SHA for dd6ec0f

Commits on Feb 4, 2020

• Add OnResponseHeaders callback

  Show description for 6b290a1
  WGH-

  committed
  6b290a1

  Copy full SHA for 6b290a1

Pagination

Previous

Next