Skip to content

Issues: bda-research/node-crawler

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
29 Open 277 Closed
29 Open 277 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Update documentation to reflect that node-crawler is based on request Documentation
#115 opened Sep 23, 2014 by ghost updated Sep 23, 2014
A way to set maximum number of links to follow Feature
#57 opened Jun 6, 2013 by geekyme updated Nov 8, 2014
1
pause / resume? Feature Question
#217 opened Jun 7, 2017 by petkovic43 updated Jul 17, 2017
robots.txt awareness Feature
#35 opened Dec 9, 2012 by reezer updated Apr 1, 2018
9
Catch an error: "invalid markup" Feature
#94 opened Mar 29, 2014 by isnolan updated Sep 19, 2018
1
Add ciphers into request options
#290 opened Sep 15, 2018 by nmhung109 updated Sep 19, 2018
1
Passing a crt with the proxy Unclear
#295 opened Nov 26, 2018 by kieranheadley updated Jan 23, 2019
1
How to disable injectableTypes filter ? Optimization
#299 opened Jan 9, 2019 by ayqy updated Apr 2, 2019
5
Pluggable cache Feature
#33 opened Dec 8, 2012 by sylvinus updated May 6, 2019
7
Integrate with ProxyCrawl crawler
#316 opened Jun 14, 2019 by rochenka updated Jun 14, 2019
Promise please Feature
#249 opened Dec 7, 2017 by lwyj123 updated Jul 29, 2019
14
tolerance for unknown/ bad charsets
#320 opened Aug 1, 2019 by cybergaukler updated Aug 26, 2019
1
whether supports promise feature?
#332 opened Nov 19, 2019 by bruceyee07 updated Feb 26, 2020
3
CRAWLER Error Error: tunneling socket could not be established
#342 opened Mar 13, 2020 by ariseven updated Apr 22, 2020
1
Way to add wait handle
#344 opened Apr 10, 2020 by jaekunchoi updated May 12, 2020
1
Crawl error causes skipDuplicates to be set to false
#345 opened May 2, 2020 by villesau updated May 12, 2020
1
Consideration to ditch Request dependency?
#350 opened May 17, 2020 by sbr2567 updated Jun 9, 2020
1
JavaScript support or integration of Zombie Feature
#103 opened Jul 23, 2014 by func0der updated Jul 9, 2020
14
Typescript and types Feature
#297 opened Dec 13, 2018 by chris74a updated Oct 13, 2020
14
Add support for use a list of proxy
#358 opened Jul 29, 2020 by rafamarts updated Oct 15, 2020
1
Documentation unclear; CRAWLER Error Error: incorrect header check when fetching
#365 opened Oct 26, 2020 by pate313373 updated Oct 26, 2020
jsdom.env is not defined
#366 opened Nov 13, 2020 by raphaelsoul updated Nov 20, 2020
1
Uncatchable error
#339 opened Jan 27, 2020 by ehystiv updated Dec 9, 2020
3
Some requests (stream based) never ends and block the queue
#371 opened Dec 20, 2020 by Verhov updated Mar 5, 2021
4
Inconsistent variable names across examples
#377 opened Apr 8, 2021 by icropper updated Nov 8, 2021
1
ProTip! no:milestone will show everything without a milestone.