Skip to content
/ eva Public
forked from georgia-tech-db/evadb

AI-Relational Database System | SQL meets Deep Learning

License

Notifications You must be signed in to change notification settings

luoj1/eva

Folders and files

NameName
Last commit message
Last commit date

Latest commit

bf049f1 ยท Jan 16, 2023
Jan 14, 2023
Dec 30, 2022
Jan 7, 2023
Nov 7, 2022
Jan 16, 2023
Jan 14, 2023
Jan 16, 2023
Jan 20, 2020
Jan 15, 2023
Oct 30, 2022
Feb 21, 2021
Aug 13, 2022
Oct 16, 2022
Jan 14, 2023
Jan 2, 2023
Dec 30, 2022
Dec 30, 2022
Aug 11, 2022
Jan 7, 2023
Sep 29, 2022
Jan 26, 2022
Jan 26, 2022
Dec 9, 2022
Jan 7, 2023
Jul 31, 2022

Repository files navigation

EVA

Try It Out!

Open EVA on Colab Slack Discuss on Github! PyPI License Python Versions

EVA Multimedia Database System

EVA is a database system tailored for video analytics -- think PostgreSQL for videos. It supports a SQL-like language for querying videos like:

  • examining the movement of vehicles in a traffic video
  • finding touchdowns in a football game

EVA comes with a wide range of commonly used computer vision models. It written in Python, and it is licensed under the Apache license.

If you are wondering why you might need a video database system, start with page on Video Database Systems. It describes how EVA lets users easily make use of deep learning models and how they can reduce money spent on inference on large image or video datasets.

The Getting Started page shows how you can use EVA for different computer vision tasks: image classification, object detection, action recognition, and how you can easily extend EVA to support your custom deep learning model in the form of user-defined functions.

The User Guides section contains Jupyter Notebooks that demonstrate how to use various features of EVA. Each notebook includes a link to Google Colab, where you can run the code by yourself.

Why EVA?

Easily combine SQL and Deep Learning to build next-generation database applications Easily query videos in user-facing applications with a SQL-like interface for commonly used computer vision models.
Speed up queries and save money spent on model inference EVA comes with a collection of built-in sampling, caching, and filtering optimizations inspired by time-tested relational database systems.
Extensible by design to support custom deep learning models EVA has first-class support for user-defined functions that wrap around your deep learning models in PyTorch.

Links

Quick Start

  1. EVA supports Python versions 3.7 through 3.10. To install EVA, we recommend using the pip package manager.
pip install evadb
  1. EVA works on Jupyter notebooks -- illustrative notebooks are available in the Tutorials folder. EVA adopts a client-server architecture and comes with a terminal-based client. To start the EVA server and a terminal-based client, use the following commands:
eva_server &   # launch server
eva_client     # launch client
  1. Load a video onto the server using the client (we use ua_detrac.mp4 video as an example):
LOAD VIDEO "data/ua_detrac/ua_detrac.mp4" INTO MyVideo;
  1. That's it! You can now start running queries over the loaded video:
SELECT id, data FROM MyVideo WHERE id < 5;
  1. Search for frames in the video that contain a car
SELECT id, data FROM MyVideo WHERE ['car'] <@ FastRCNNObjectDetector(data).labels;
Source Video Query Result
Source Video Query Result
  1. Search for frames in the video that contain a pedestrian and a car
SELECT id, data FROM MyVideo WHERE ['pedestrian', 'car'] <@ FastRCNNObjectDetector(data).labels;
  1. Search for frames in the video with more than 3 cars
SELECT id, data FROM MyVideo WHERE Array_Count(FastRCNNObjectDetector(data).labels, 'car') > 3;
  1. You can create a new user-defined function (UDF) that wraps around your custom vision model or an off-the-shelf model like FastRCNN:
CREATE UDF IF NOT EXISTS MyUDF
INPUT  (frame NDARRAY UINT8(3, ANYDIM, ANYDIM))
OUTPUT (labels NDARRAY STR(ANYDIM), bboxes NDARRAY FLOAT32(ANYDIM, 4),
        scores NDARRAY FLOAT32(ANYDIM))
TYPE  Classification
IMPL  'eva/udfs/fastrcnn_object_detector.py';
  1. You can combine multiple user-defined functions in a single query to accomplish more complicated tasks.
   -- Analyse emotions of faces in a video
   SELECT id, bbox, EmotionDetector(Crop(data, bbox)) 
   FROM HAPPY JOIN LATERAL UNNEST(FaceDetector(data)) AS Face(bbox, conf)  
   WHERE id < 15;

Illustrative EVA Applications

๐Ÿ”ฎ Traffic Analysis (Object Detection Model)

Source Video Query Result
Source Video Query Result

๐Ÿ”ฎ MNIST Digit Recognition (Image Classification Model)

Source Video Query Result
Source Video Query Result

๐Ÿ”ฎ Movie Analysis (Face Detection + Emotion Classfication Models)

Source Video Query Result
Source Video Query Result

๐Ÿ”ฎ License Plate Recognition (Plate Detection + OCR Extraction Models)

Source Image Query Result
Source Image Query Result

๐Ÿ”ฎ Meme Toxicity Classification (OCR Extraction + Toxicity Classification Models)

Source Image Query Result
Source Image Query Result

Community

Join the EVA community on Slack to ask questions and to share your ideas for improving EVA.

EVA Slack Channel

Contributing to EVA

PyPI Version CI Status Coverage Status Documentation Status

To file a bug or request a feature, please use GitHub issues. Pull requests are welcome. For more information on installing from source and contributing to EVA, see our contributing guidelines.

License

Copyright (c) 2018-2022 Georgia Tech Database Group Licensed under Apache License.

About

AI-Relational Database System | SQL meets Deep Learning

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.1%
  • Other 0.9%