🦊 Welcome to Kyuubi’s online documentation ✨, v1.6.0-SNAPSHOT
logo
  • HOME

Admin Guide

  • Quick Start
    • Getting Started with Apache Kyuubi
    • Getting Started With Kyuubi on kubernetes
    • Getting Started With Hive JDBC
  • Deploying Kyuubi
    • Deploy Kyuubi On Kubernetes
    • Integration with Hive Metastore
    • Kyuubi High Availability Guide
    • Introduction to the Kyuubi Configurations System
    • Deploy Kyuubi engines on Yarn
    • Deploy Kyuubi engines on Kubernetes
    • The Share Level Of Kyuubi Engines
    • The TTL Of Kyuubi Engines
    • The Spark SQL Engine Configuration Guide
      • How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi
      • How To Use Spark Adaptive Query Execution (AQE) in Kyuubi
      • Solution for Big Result Sets
  • Security
    • Authentication
      • Configure Kyuubi to use Kerberos Authentication
      • Configure Kerberos for clients to Access Kerberized Kyuubi
      • Configure Kyuubi to use LDAP Authentication
      • Configure Kyuubi to use Custom Authentication
    • Authorization
      • Spark AuthZ Plugin
        • Overview
        • Building
        • Installing
    • Kinit Auxiliary Service
    • Hadoop Credentials Manager
  • Monitoring
    • 1. Monitoring Kyuubi - Logging System
    • 2. Monitoring Kyuubi - Server Metrics
    • 3. Trouble Shooting
  • Tools
    • Kubernetes Tools Spark Block Cleaner
    • Managing kyuubi servers and engines Tool
    • Kyuubi Administer Tool

User Guide

  • Clients & APIs
    • JDBC Drivers
      • Kyuubi Hive JDBC Driver
      • Hive JDBC Driver
      • MySQL Connectors
    • Command Line Interface(CLI)s
      • Kyuubi Beeline
      • Hive Beeline
    • Business Intelligence Tools and SQL IDEs
      • Apache Superset
      • Cloudera Hue
      • DataGrip
      • DBeaver
      • PowerBI
      • Tableau
    • ODBC Drivers
    • Thrift APIs
    • RESTful APIs and Clients
      • REST API v1
    • Web UI
    • Python DB-APIs
      • PyHive
    • Client Commons
      • Client Configuration Guide
      • Logging
      • Advanced Features
        • Using Different Kyuubi Engines
        • Sharing and Isolation for Kyuubi Engines
        • Setting Time to Live for Kyuubi Engines
        • Enabling Kyuubi Engine Pool
        • Running Scala Snippets
        • Plan Only Execution Mode

Extension Guide

  • Extensions
    • Server Side Extensions
      • Configure Kyuubi to use Custom Authentication
      • Inject Session Conf with Custom Config Advisor
      • Handle Events with Custom Event Handler
      • Manage Applications against Extra Cluster Managers
    • Engine Side Extensions
      • Extensions for Spark
        • Z-Ordering Support
        • Auxiliary Optimization Rules
        • Kyuubi Spark AuthZ Plugin
        • Auxiliary SQL Functions
        • Connectors for Spark SQL Query Engine
      • Extensions for Flink
        • Connectors For Flink SQL Query Engine
      • Extensions for Hive
        • Connectors for Hive SQL Query Engine
      • Extensions for Trino
        • Connectors For Trino SQL Engine

Connectors

  • Connectors
    • Connectors for Spark SQL Query Engine
      • Delta Lake
      • Delta Lake with Microsoft Azure Blob Storage
      • Hudi
      • Iceberg
      • Kudu
      • Flink Table Store
      • TiDB
      • TPC-DS
      • TPC-H
    • Connectors For Flink SQL Query Engine
      • Flink Table Store
      • Hudi
      • Iceberg
    • Connectors for Hive SQL Query Engine
    • Connectors For Trino SQL Engine
      • Flink Table Store
      • Iceberg

Kyuubi Insider

  • Overview
    • Architecture
    • Kyuubi v.s. HiveServer2
    • Kyuubi v.s. Spark Thrift JDBC/ODBC Server (STS)

Contributing

  • Develop Tools
    • Building Kyuubi
    • Building a Runnable Distribution
    • Building Kyuubi Documentation
    • Running Tests
    • Debugging Kyuubi
    • Developer Tools
    • IntelliJ IDEA Setup Guide
  • Community
    • Contributing to Apache Kyuubi
    • Collaborators
    • Kyuubi Release Guide

Appendix

  • Appendixes
    • 1. Terminologies
Theme by the Executable Book Project
  • repository
  • suggest edit
  • .rst

Monitoring

Monitoring#

In this section, you will learn how to monitor Kyuubi with logging, metrics etc..

  • 1. Monitoring Kyuubi - Logging System
    • 1.1. Logs of Kyuubi Server
    • 1.2. Logs of Spark SQL Engine
    • 1.3. Logs of Flink SQL Engine
    • 1.4. Operation Logs
    • 1.5. Further Readings
  • 2. Monitoring Kyuubi - Server Metrics
    • 2.1. Configurations
    • 2.2. Metrics
  • 3. Trouble Shooting
    • 3.1. Common Issues

previous

Hadoop Credentials Manager

next

1. Monitoring Kyuubi - Logging System

By Kent Yao
© Copyright Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. .