Skip to content

Issues: scrapinghub/frontera

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
79 Open 77 Closed
79 Open 77 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Black list for hosts no need to deal with enhancement
#40 opened May 12, 2015 by sibiryakov
Document Fetcher/Downloader abstraction enhancement help wanted
#85 opened Dec 11, 2015 by sibiryakov
Kafka settings defaults and documentation beginners enhancement help wanted
#100 opened Jan 27, 2016 by sibiryakov
LRU cache for state cache in strategy worker beginners help wanted
#101 opened Jan 27, 2016 by sibiryakov
Support ip address instead of domain name in URLs bug help wanted
#103 opened Jan 27, 2016 by sibiryakov
Multiple strategy and DB workers for ZeroMQ message bus enhancement help wanted
#112 opened Feb 18, 2016 by sibiryakov
Enable ZeroMQ message bus tests for IPv6 enhancement
#114 opened Feb 19, 2016 by sibiryakov
Frontera Web UI enhancement help wanted
#115 opened Feb 19, 2016 by sibiryakov
Producer/Consumer architecture enhancement
#118 opened Mar 16, 2016 by sibiryakov
Reliable batch release in the queue needs design reliability
#120 opened Mar 17, 2016 by sibiryakov
urlparse result caching in Frontera needs design performance
#126 opened Mar 29, 2016 by sibiryakov
Second-level domain hostname partitioning option enhancement
#127 opened Mar 29, 2016 by sibiryakov
Use KafkaConsumer instead of obsolete KeyedConsumer/SimpleConsumer in Kafka message bus
#140 opened May 11, 2016 by sibiryakov
Document handlers, formatters and filters in frontera.logger beginners enhancement
#144 opened May 23, 2016 by sibiryakov
Kafka: When generating new batch, take number of partitions from Frontera beginners bug
#152 opened Jun 7, 2016 by sibiryakov
Store redirect chain in page_crawled() enhancement
#221 opened Oct 19, 2016 by sibiryakov
HBase queue get_next_requests operation is slow performance
#227 opened Nov 16, 2016 by sibiryakov
Component method request_error() possible documentation error.
#234 opened Dec 12, 2016 by IAlwaysBeCoding
no module named recording while trying to record the scrapy crawl
#285 opened Jul 4, 2017 by SharmaSushant19
Only half of spiders are crawling
#291 opened Sep 7, 2017 by colmex
Spider being cancelled (stalled)
#292 opened Sep 13, 2017 by ijharulislam
Help Wanted. Can not run example/scrapy_recording, NameError: global name 'graphs' is not defined
#294 opened Sep 23, 2017 by imfht
ERROR:sqlalchemy.queue:A transaction is already begun. Use subtransactions=True to allow subtransactions.
#378 opened Aug 26, 2019 by yevgenpapernyk
[BUG] Clear content and drop tables options are not working properly
#398 opened Jun 23, 2020 by Prometheus3375
The KeyError throw when running to to_fetch in StateContext class: b'fingerprint'
#404 opened Sep 4, 2020 by yujiaao
ProTip! What’s not been updated in a month: updated:<2025-01-02.