1. Building Kyuubi¶
1.1. Building Kyuubi with Apache Maven¶
Kyuubi is built based on Apache Maven,
./build/mvn clean package -DskipTests
This results in the creation of all sub-modules of Kyuubi project without running any unit test.
If you want to test it manually, you can start Kyuubi directly from the Kyuubi project root by running
bin/kyuubi start
1.2. Building a Submodule Individually¶
For instance, you can build the Kyuubi Common module using:
build/mvn clean package -pl kyuubi-common -DskipTests
1.3. Building Submodules Individually¶
For instance, you can build the Kyuubi Common module using:
build/mvn clean package -pl kyuubi-common,kyuubi-ha -DskipTests
1.4. Skipping Some modules¶
For instance, you can build the Kyuubi modules without Kyuubi Codecov and Assembly modules using:
mvn clean install -pl '!dev/kyuubi-codecov,!kyuubi-assembly' -DskipTests
1.5. Building Kyuubi against Different Apache Spark versions¶
Since v1.1.0, Kyuubi support building with different Spark profiles,
| Profile | Default | Since |
|---|---|---|
| -Pspark-3.0 | Yes | 1.0.0 |
| -Pspark-3.1 | No | 1.1.0 |
1.6. Defining the Apache Mirror for Spark or Flink¶
By default, we use https://archive.apache.org/dist/spark/ to download the built-in Spark or
use https://archive.apache.org/dist/flink/ to download the built-in Flink release package,
but if you find it hard to reach, or the downloading speed is too slow, you can define the spark.archive.mirror
or flink.archive.mirror property to a suitable Apache mirror site. For instance,
build/mvn clean package -Dspark.archive.mirror=https://mirrors.bfsu.edu.cn/apache/spark/spark-3.0.1
Visit Apache Mirrors and choose a mirror based on your region.
Specifically for developers in China mainland, you can use the pre-defined profile named mirror-cn
which use mirrors.bfsu.edu.cn to speed up Spark Binary downloading. For instance,
build/mvn clean package -Pmirror-cn