2. Kyuubi On Delta Lake¶
2.1. What is Delta Lake¶
Delta lake is an open-source project that enables building a Lakehouse Architecture on top of existing storage systems such as S3, ADLS, GCS, and HDFS.
This article assumes that you have mastered the basic knowledge and operation of Delta Lake.
For the knowledge about delta lake not mentioned in this article, you can obtain it from its official documentation.
2.2. Why Kyuubi on Delta Lake¶
As we know, Kyuubi provides a pure SQL gateway through Thrift JDBC/ODBC interface for end-users to manipulate large-scale data with pre-programmed and extensible Spark SQL engines. By using kyuubi, we can run SQL queries towards delta lake which is more convenient, easy to understand, and easy to expand than directly using spark to manipulate delta lake.