Crawler is a web application with expressive, elegant syntax and powerfull fuctionality. We believe development must be an enjoyable and creative experience to be truly fulfilling. Crawler attempts to take the pain out of crawling by easing common tasks used in the majority of web projects. Laravel is accessible, yet powerful, providing tools needed for large, robust applications.
- elasticsearchCrawlerClient.put(key="https://malbaka.com/", data="Some data here!", date="2018.11.02", head="SuperHead", tags=["tag0", "tag1", "tag2"])
- elasticsearchCrawlerClient.contains(key="https://malbaka.com/")
Crawler has the most extensive and thorough documentation and video tutorial library of any modern Crawler, making it a breeze to get started learning the Crawler.
Thank you for considering contributing to the Crawler! The contribution guide can be found in the Crawler documentation.
If you discover a security vulnerability within Crawler, please send an e-mail to Andrey Emelyanenko via [email protected]. All security vulnerabilities will be promptly addressed.
The Crawler is open-sourced software licensed under the MIT license.