Skip to content

Issues: meilisearch/scrapix

Prepare scrapix for production use
#14 opened Jun 19, 2023 by bidoubiwa
Open
Scrapix V2
#111 opened Nov 9, 2024 by qdequele
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
38 Open 29 Closed
38 Open 29 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Create a console for starting the crawling enhancement New feature or request
#4 opened Feb 14, 2023 by qdequele updated Jun 4, 2023
@qdequele
Create custom scraper enhancement New feature or request
#18 opened Jun 20, 2023 by bidoubiwa updated Jun 20, 2023
Improve errors logs enhancement New feature or request
#34 opened Jun 21, 2023 by bidoubiwa updated Jun 21, 2023
Add basic tests maintenance Issue about maintenance (CI, tests, refacto...)
#16 opened Jun 19, 2023 by bidoubiwa updated Jun 22, 2023 Prepare Scrapix for production
Improvement the README maintenance Issue about maintenance (CI, tests, refacto...)
#21 opened Jun 20, 2023 by bidoubiwa updated Jun 22, 2023 Prepare Scrapix for production
Create CONTRIBUTING.md maintenance Issue about maintenance (CI, tests, refacto...)
#22 opened Jun 20, 2023 by bidoubiwa updated Jun 22, 2023 Prepare Scrapix for production
Adding a dependabot file maintenance Issue about maintenance (CI, tests, refacto...)
#25 opened Jun 20, 2023 by bidoubiwa updated Jun 22, 2023 Prepare Scrapix for production
Update the name of the tool maintenance Issue about maintenance (CI, tests, refacto...)
#26 opened Jun 20, 2023 by bidoubiwa updated Jun 22, 2023 Prepare Scrapix for production
3
Add route to empty the task queue enhancement New feature or request
#33 opened Jun 21, 2023 by bidoubiwa updated Jun 23, 2023
1
Prepare scrapix for production use enhancement New feature or request
#14 opened Jun 19, 2023 by bidoubiwa updated Jun 28, 2023
5 of 20 tasks
Prepare Scrapix for production
Throw error when redis server is not answering bug Something isn't working
#56 opened Jul 3, 2023 by bidoubiwa updated Jul 3, 2023
Retrieve page titles from meta tags enhancement New feature or request
#53 opened Jun 29, 2023 by Strift updated Jul 22, 2023
3
Where is only_type located in the schema settings option question Further information is requested
#30 opened Jun 21, 2023 by bidoubiwa updated Jul 23, 2023
1
Being able to follow the crawling process enhancement New feature or request
#5 opened Feb 14, 2023 by qdequele updated Jul 24, 2023
@qdequele
3
fix(crawler): fix failed webhook cloudboard
#80 opened Aug 22, 2023 by brunoocasali updated Aug 28, 2023
2
Document the purpose of hierarchy_radio_lvl
#90 opened Jan 18, 2024 by CaroFG updated Jan 18, 2024
Provide option to slow or rate limit requests enhancement New feature or request
#99 opened May 10, 2024 by klvs updated May 13, 2024
1
Cannot run under Windows (path contains invalid characters) bug Something isn't working
#98 opened May 9, 2024 by AXYZE9 updated May 13, 2024
1
Ensure same documents are not pushed more than once. enhancement New feature or request
#52 opened Jun 29, 2023 by bidoubiwa updated Nov 8, 2024
2
url_to_index does not work bug Something isn't working needs more info This issue needs a minimal complete and verifiable example
#49 opened Jun 28, 2023 by bidoubiwa updated Nov 8, 2024 Prepare Scrapix for production
1
Keep the previous settings enhancement New feature or request
#103 opened Nov 9, 2024 by qdequele updated Nov 9, 2024
Load the sitemap as starter point for crawling. enhancement New feature or request
#102 opened Nov 9, 2024 by qdequele updated Nov 9, 2024
Index the PDF files enhancement New feature or request
#104 opened Nov 9, 2024 by qdequele updated Nov 9, 2024
Detect/handle localized pages enhancement New feature or request
#105 opened Nov 9, 2024 by qdequele updated Nov 9, 2024
Add possibility to exclude selectors enhancement New feature or request
#93 opened Jan 23, 2024 by CaroFG updated Nov 9, 2024
@qdequele
ProTip! Exclude everything labeled bug with -label:bug.