Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 19, 2023

• Cache redirected robots.txt for target host only if (apache#1057)

  Show description for 6dc24bd
  sebastian-nagel

  authored
  6dc24bd

  Copy full SHA for 6dc24bd

Commits on Apr 17, 2023

• Change HttpProtocol to defer to configured values for retryOnConnectionFailure and followRedirects (apache#1056)

  Show description for e473dea
  ndtreviv

  authored
  e473dea

  Copy full SHA for e473dea

Commits on Apr 6, 2023

• Update README.md

  Show description for fecdd06
  jnioche

  authored
  fecdd06

  Copy full SHA for fecdd06

Commits on Mar 28, 2023

• [maven-release-plugin] prepare for next development iteration

  jnioche

  committed
  632890c

  Copy full SHA for 632890c

• [maven-release-plugin] prepare release 2.8

  jnioche

  committed
  52d9c39

  Copy full SHA for 52d9c39

• Fixed Javadoc

  Show description for 4a4d326
  jnioche

  committed
  4a4d326

  Copy full SHA for 4a4d326

• pre 2.8 release

  Show description for 1571ced
  jnioche

  committed
  1571ced

  Copy full SHA for 1571ced

Commits on Mar 21, 2023

• Update NOTICE

  jnioche

  authored
  3c12bf1

  Copy full SHA for 3c12bf1

Commits on Feb 28, 2023

• Fix apache#1032: Catch the exception inside the loop to avoid breaking if one remote instance is misbehaving (apache#1047)

  Show description for 5573ed6
  rzo1

  authored
  5573ed6

  Copy full SHA for 5573ed6

• Fixes apache#1045. Remove range syntax from snakeyaml (apache#1046)

  Show description for 17fbc4f
  rzo1

  authored
  17fbc4f

  Copy full SHA for 17fbc4f

Commits on Feb 16, 2023

• More concise code for handling create value in Opensearch IndexerBolt

  Show description for 055fd2c
  jnioche

  committed
  055fd2c

  Copy full SHA for 055fd2c

Commits on Feb 14, 2023

• Allow override on HttpProtocol's method addHeadersToRequest (apache#1041)

  Show description for c021ca8
  Mikwiss

  authored
  c021ca8

  Copy full SHA for c021ca8

Commits on Feb 13, 2023

• Limit the amount of text to be returned by the text extraction, apache#1038 (apache#1039)

  Show description for 208735a
  jnioche

  authored
  208735a

  Copy full SHA for 208735a

Commits on Feb 9, 2023

• Status ES document id (apache#1036)

  Show description for 65727f9
  Mikwiss

  authored
  65727f9

  Copy full SHA for 65727f9

• Limit number of outlinks while filtering them, fixes apache#1037

  Show description for 010f924
  jnioche

  committed
  010f924

  Copy full SHA for 010f924

Commits on Feb 8, 2023

• Merge branch 'master' of github.com:DigitalPebble/storm-crawler

  jnioche

  committed
  3ec0764

  Copy full SHA for 3ec0764

• rely on URLUtil.resolveURL instead of JSOUP implementation; improvements to URLUtil.fixPureQueryTargets; optimisation of BasicURLNormalizer. Fixes apache#1035

  Show description for 78428b5
  jnioche

  committed
  78428b5

  Copy full SHA for 78428b5

Commits on Feb 7, 2023

• Create method to add SearchHit info to metadata (apache#1034)

  Show description for 888463b
  Mikwiss

  authored
  888463b

  Copy full SHA for 888463b

Commits on Feb 4, 2023

• Merge branch 'master' of github.com:DigitalPebble/storm-crawler

  jnioche

  committed
  7e75356

  Copy full SHA for 7e75356

• Dependency upgrades, fixes apache#1033

  Show description for b9d7e49
  jnioche

  committed
  b9d7e49

  Copy full SHA for b9d7e49

Commits on Feb 2, 2023

• JsoupFilter as Interface (apache#1026)

  Show description for ab7e77d
  Mikwiss

  authored
  ab7e77d

  Copy full SHA for ab7e77d

Commits on Jan 10, 2023

• Indexer ES document id (apache#1028)

  Show description for 9bc2be9
  Mikwiss

  authored
  9bc2be9

  Copy full SHA for 9bc2be9

• Fix apache#1027: Ensure SC can be build with Java 17 (apache#1030)

  Show description for a575df5
  rzo1

  authored
  a575df5

  Copy full SHA for a575df5

Commits on Jan 9, 2023

• Enforce Java 11 in archetypes (apache#1029)

  Show description for 2bf2a05
  msghasan

  authored
  2bf2a05

  Copy full SHA for 2bf2a05

Commits on Dec 22, 2022

• Minor changes to okhttp implementation e.g. final variables where possible

  Show description for bd84df5
  jnioche

  committed
  bd84df5

  Copy full SHA for bd84df5

Commits on Dec 20, 2022

• [maven-release-plugin] prepare for next development iteration

  jnioche

  committed
  ad3c8b2

  Copy full SHA for ad3c8b2

• [maven-release-plugin] prepare release 2.7

  jnioche

  committed
  d9ca991

  Copy full SHA for d9ca991

• Pre 2.7 release

  Show description for 318bc7e
  jnioche

  committed
  318bc7e

  Copy full SHA for 318bc7e

• Ignore empty fields indexer (apache#1019)

  Show description for 1025365
  jnioche

  authored
  1025365

  Copy full SHA for 1025365

Commits on Dec 16, 2022

• Fix agent description in OpenSearch archetype

  Show description for 53d91d5
  jnioche

  committed
  53d91d5

  Copy full SHA for 53d91d5

• Opensearch prevent multiple threads to check and create indices at the same time

  Show description for 7a43e0a
  jnioche

  committed
  7a43e0a

  Copy full SHA for 7a43e0a

Commits on Dec 15, 2022

• Exclude xml-apis from xerces dependency, fix apache#1021

  Show description for f68b5a5
  jnioche

  committed
  f68b5a5

  Copy full SHA for f68b5a5

• Handle single quotes in value of http-equiv=refresh, fix apache#1020

  Show description for 08f4b03
  jnioche

  committed
  08f4b03

  Copy full SHA for 08f4b03

Commits on Dec 14, 2022

• Opensearch : replace content of dashboards dir with link to the one in the archetype

  Show description for 9c2086c
  jnioche

  committed
  9c2086c

  Copy full SHA for 9c2086c

• Spouts should try to define the mapping for the status index if none exists, fix apache#1018

  Show description for 6466283
  jnioche

  committed
  6466283

  Copy full SHA for 6466283

Pagination

Previous

Next