The new open-source standard to sync data from applications & databases to warehouses.
Dataline is on a mission to make data integration pipelines a commodity.
- Maintenance-free connectors you can use in minutes. Just authenticate your sources and warehouse, and get connectors that adapts to schema and API changes for you.
- On a mission to cover the long tail of integrations, as Dataline will be very active in maintaining the pipelines’ reliability.
- Building new integrations made trivial. We make it very easy to add new integrations that you need, by offering scheduling and orchestration.
- Your data stays in your cloud. Have full control over your data, and the costs of your data transfers.
- No more security compliance process to go through as self-hosted.
- No more pricing indexed on volume, as cloud-based solutions offer.
git clone [email protected]:datalineio/dataline.git
cd dataline
docker-compose upNow visit http://localhost:8000
- Normalized schemas: Elegant, entirely customizable and a fully extensible admin panel.
- Full-grade scheduler: Automate your replications with the frequency you need.
- Real-time Monitoring: We log all errors to let you know about them.
- Incremental updates: Automated replications are based on incremental updates to reduce your data transfer costs.
- Manual full refresh: Sometimes, you need to re-sync all your data to start again.
- Granular system logs: No opacity whatsoever to let you control and trust.
We love contributions to Dataline, big or small. See our Contributing Guide on how to get started. Not sure where to start? We’ve listed some good first issues to start with. You can also book a free, no-pressure pairing session with one of our core contributors.
For general help using Dataline, please refer to the official Dataline documentation. For additional help, you can use one of these channels to ask a question:
- Slack (For live discussion with the Community and Dataline team)
- GitHub (Bug reports, Contributions)
- Twitter (Get the news fast)
Check out our roadmap to get informed of the latest features released and the upcoming ones. You may also give us insights and vote for a specific feature. For our high-level roadmap and strategy, you can check our handbook.
Dataline is licensed under the MIT license. See the LICENSE file for licensing information.