Skip to content
/ dbnd Public
forked from databand-ai/dbnd

DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.

License

Notifications You must be signed in to change notification settings

Haoyu-Gao/dbnd

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

pipeline status

PyPI - Downloads PyPI PyPI - Python Version PyPI - License Code style:

DBND

DBND is an open-source framework for building and tracking data pipelines. It is used for processes ranging from data ingestion, preparation, machine learning model training, and production.

DBND includes a Python library, a set of APIs, and a CLI that enables you to collect metadata from your workflows, create a system of record for runs, and easily orchestrate complex processes.

Project Overview

DBND simplifies the process of building and running data pipelines:

from dbnd import task

@task
def say_hello(name: str = "databand.ai") -> str:
    value = "Hello %s!" % name
    return value

Additionally, DBND makes it easy to track your critical pipeline metadata:

from dbnd import log_metric, log_dataframe

log_dataframe("my_dataset", my_dataset)
log_metric("r2", r2)

Prerequisites

This project is built using Python. To ensure compatibility, use the recommended version of Python supported by DBND. Make sure you have the following installed before proceeding:

Installation Steps

Option 1: Using pip

To install DBND, run:

pip install dbnd

Verification

To verify the successful installation, import the library and run a simple task:

from dbnd import task
@task
def verify_installation() -> str:
    return "Installation successful!"

Getting Started

See our documentation with examples and quickstart guides to get up and running with DBND.

Help and Support

If you have any questions, feedback, or contributions, feel free to get in touch with us at [email protected], and open pull request and issues in this repository.

External Documents

Refer to additional documents for further guidance:

Version History

To stay updated with the latest features and improvements, ensure you update DBND regularly via pip install --upgrade dbnd.

About

DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 89.8%
  • Java 8.4%
  • C 0.8%
  • Jupyter Notebook 0.4%
  • Scala 0.3%
  • Makefile 0.2%
  • Other 0.1%