Skip to content

Horizontally scalable SQL Service built upon Chogori-Platform SKV storage

License

Notifications You must be signed in to change notification settings

daweilics/chogori-sql

This branch is up to date with futurewei-cloud/chogori-sql:master.

Folders and files

NameName
Last commit message
Last commit date
Jul 2, 2021
Jul 1, 2021
Jan 4, 2022
Jan 4, 2022
May 26, 2021
Jan 4, 2022
Jun 30, 2021
Jun 25, 2021
Jul 2, 2021
Mar 2, 2021

Repository files navigation

Project description

The Chogori-SQL project is a horizontally scalable SQL service with disaggregated storage provided by the Chogori-Platform(https://github.com/futurewei-cloud/chogori-platform) SKV storage service with focus on performance provided by in-memory data handling and fast, kernel bypass network processing. Our main achievement is that we were able to take the industry-standard SQL engine PostgreSQL and rewrite its storage layer to use our novel K23SI transaction protocol with our rich, schema-aware data model - SKV

Key features

  • Horizontally scalable multi-reader/multi-writer architecture
  • Industry-standard SQL support thanks to the PostgreSQL engine
  • Much improved consistency (Serializable Snapshot Isolation with External Causal Consistency to be more precise) is used in all transactions, thanks to the consistency guarantees provided by the Chogori-Platform SKV service
  • Full TPC-C compatibility for all transaction types with 1806.3 transactions per minute / per core(tpmc).
  • Performance more than 2x better than the nearest competitor (YugabyteDB) on the TPC-C suite
  • Initial Near-Data-Processing effort with computation push-down from SQL to SKV layer, including predicate filtering, projection, and scan prefix bounds.

Credits

Our work was made possible thanks to YugabyteDB's open source initiative Home | YugabyteDB . This project builds upon PostgreSQL and served as a great starting point to instruct us on how to integrate our custom storage engine with PostgreSQL.

Getting Started

We've provided a dockerfile which specifies all dependencies needed to build and run our code. Please see docker/README.md

About

Horizontally scalable SQL Service built upon Chogori-Platform SKV storage

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C 84.4%
  • PLpgSQL 6.7%
  • C++ 2.7%
  • Perl 2.0%
  • Yacc 1.5%
  • Makefile 0.8%
  • Other 1.9%