Impala Daemon Metrics

Metric Name Description Unit CDH Version
alerts_rate The number of alerts. events per second CDH 5
assignments_rate The number of assignments assignments per second CDH 5
audit_agent_bytes_left_rate Number of bytes of audit events still to be sent to the Audit Server. bytes per second CDH 5
audit_agent_bytes_sent_rate Number of bytes of audit events successfully sent by Cloudera Manager Agent to the Audit Server. bytes per second CDH 5
audit_agent_events_sent_rate Number of audit events successfully sent by Cloudera Manager Agent to the Audit Server. events per second CDH 5
audit_agent_send_failures_rate Number of time Cloudera Manager Agent encountered failure when sending audit event(s) to the Audit Server. errors per second CDH 5
audit_plugin_coalesced_rate Number of audit events coalesced events per second CDH 5
audit_plugin_events_rate Number of audit events persisted to local filesystem events per second CDH 5
audit_plugin_exceptions_rate Number of exception encountered when processing audit events errors per second CDH 5
audit_plugin_filtered_rate Number of audit events that were filtered based on user specified criteria events per second CDH 5
audit_plugin_parse_errors_rate Number of audit events that cannot be parsed errors per second CDH 5
backends_client_cache_clients_in_use The number of active Impala Backend clients. These clients are for communication with other Impala Daemons. clients CDH 5
backends_client_cache_total_clients The total number of Impala Backend clients in this Impala Daemon's client cache. These clients are for communication with other Impala Daemons. clients CDH 5
catalog_num_databases The number of databases in the catalog. databases CDH 5
catalog_num_tables The number of tables in the catalog. table CDH 5
cgroup_cpu_system_rate CPU usage of the role's cgroup seconds per second CDH 5
cgroup_cpu_user_rate User Space CPU usage of the role's cgroup seconds per second CDH 5
cgroup_mem_page_cache Page cache usage of the role's cgroup bytes CDH 5
cgroup_mem_rss Resident memory of the role's cgroup bytes CDH 5
cgroup_mem_swap Swap usage of the role's cgroup bytes CDH 5
cgroup_read_bytes_rate Bytes read from all disks by the role's cgroup bytes per second CDH 5
cgroup_read_ios_rate Number of read I/O operations from all disks by the role's cgroup ios per second CDH 5
cgroup_write_bytes_rate Bytes written to all disks by the role's cgroup bytes per second CDH 5
cgroup_write_ios_rate Number of write I/O operations to all disks by the role's cgroup ios per second CDH 5
completed_query_monitoring_failure_rate The number of failures encountered by Cloudera Manager Agent when monitoring completed queries. failures per second CDH 5
cpu_system_rate Total System CPU seconds per second CDH 5
cpu_user_rate Total CPU user time seconds per second CDH 5
events_critical_rate The number of critical events. events per second CDH 5
events_important_rate The number of important events. events per second CDH 5
events_informational_rate The number of informational events. events per second CDH 5
executing_query_monitoring_failure_rate The number of failures encountered by Cloudera Manager Agent when monitoring executing queries. failures per second CDH 5
fd_max Maximum number of file descriptors file descriptors CDH 5
fd_open Open file descriptors. file descriptors CDH 5
hash_table_total_bytes The current size of all allocated hash tables. bytes CDH 5
health_bad_rate Percentage of Time with Bad Health seconds per second CDH 5
health_concerning_rate Percentage of Time with Concerning Health seconds per second CDH 5
health_disabled_rate Percentage of Time with Disabled Health seconds per second CDH 5
health_good_rate Percentage of Time with Good Health seconds per second CDH 5
health_unknown_rate Percentage of Time with Unknown Health seconds per second CDH 5
io_mgr_num_buffers The number of allocated IO buffers. IO buffers are shared by all queries. buffers CDH 5
io_mgr_num_open_files The current number of files opened by the IO Manager files CDH 5
io_mgr_num_unused_buffers The number of unused IO buffers. IO buffers are shared by all queries. buffers CDH 5
io_mgr_total_bytes Number of bytes used by IO buffers (used and unused). bytes CDH 5
local_assignments_rate Number of assignments operating on local data assignments per second CDH 5
mem_pool_total_bytes The current size of the memory pool shared by all queries bytes CDH 5
mem_rss Resident memory used bytes CDH 5
mem_swap Amount of swap memory used by this role's process. bytes CDH 5
mem_tracker_process_bytes_freed_by_last_gc The amount of memory freed by the last memory tracker garbage collection. bytes CDH 5
mem_tracker_process_bytes_over_limit The amount of memory by which the process was over its memory limit the last time the memory limit was encountered. bytes CDH 5
mem_tracker_process_limit The total amount of memory available to the memory tracker over the life of the process. bytes CDH 5
mem_tracker_process_num_gcs_rate The total number of garbage collections performed by the memory tracker over the life of the process. garbage collections per second CDH 5
mem_virtual Virtual memory used bytes CDH 5
num_backends The number of backend connections from this Impala Daemon to other Impala Daemons. backends CDH 5
num_files_open_for_insert The number of HDFS files currently open for writing. files CDH 5
num_fragments_rate The total number of query fragments processed over the life of the process query fragments per second CDH 5
num_open_beeswax_sessions The number of open Beeswax sessions. sessions CDH 5
num_open_hiveserver2_sessions The number of open HiveServer2 sessions. sessions CDH 5
num_queries_expired_rate Number of queries expired due to inactivity. queries per second CDH 5
num_queries_rate The total number of queries processed over the life of the process queries per second CDH 5
num_sessions_expired_rate Number of sessions expired due to inactivity. sessions per second CDH 5
oom_exits_rate The number of times the role's backing process was killed due to an OutOfMemory error. This counter is only incremented if the Cloudera Manager "Kill When Out of Memory" option is enabled. exits per second CDH 5
read_bytes_rate The number of bytes read from the device bytes per second CDH 5
scan_ranges_num_missing_volume_id_rate The total number of scan ranges read over the life of the process that did not have volume metadata scan ranges per second CDH 5
scan_ranges_rate The total number of scan ranges read over the life of the process scan ranges per second CDH 5
statestore_subscriber_heartbeat_interval_time_last The most recent interval between heartbeats from this Impala Daemon to the StateStore. seconds CDH 5
statestore_subscriber_heartbeat_interval_time_max The maximum interval between heartbeats from this Impala Daemon to the StateStore. This is calculated over the lifetime of the Impala Daemon. seconds CDH 5
statestore_subscriber_heartbeat_interval_time_mean The average interval between heartbeats from this Impala Daemon to the StateStore. This is calculated over the lifetime of the Impala Daemon. seconds CDH 5
statestore_subscriber_heartbeat_interval_time_min The minimum interval between heartbeats from this Impala Daemon to the StateStore. This is calculated over the lifetime of the Impala Daemon. seconds CDH 5
statestore_subscriber_heartbeat_interval_time_rate The total number of samples taken of the Impala Daemon's StateStore heartbeat interval. samples per second CDH 5
statestore_subscriber_heartbeat_interval_time_stddev The standard deviation in the interval between heartbeats from this Impala Daemon to the StateStore. This is calculated over the lifetime of the Impala Daemon. seconds CDH 5
statestore_subscriber_last_recovery_duration The amount of time the StateStore subscriber took to recover the connection the last time it was lost. seconds CDH 5
statestore_subscriber_statestore_client_cache_clients_in_use The number of active StateStore subscriber clients in this Impala Daemon's client cache. These clients are for communication from this role to the StateStore. connections CDH 5
statestore_subscriber_statestore_client_cache_total_clients The total number of StateStore subscriber clients in this Impala Daemon's client cache. These clients are for communication from this role to the StateStore. connections CDH 5
tcmalloc_bytes_in_use Number of bytes used by the application. This will not typically match the memory use reported by the OS, because it does not include TCMalloc overhead or memory fragmentation. bytes CDH 5
tcmalloc_pageheap_free_bytes Number of bytes in free, mapped pages in page heap. These bytes can be used to fulfill allocation requests. They always count towards virtual memory usage, and unless the underlying memory is swapped out by the OS, they also count towards physical memory usage. bytes CDH 5
tcmalloc_pageheap_unmapped_bytes Number of bytes in free, unmapped pages in page heap. These are bytes that have been released back to the OS, possibly by one of the MallocExtension "Release" calls. They can be used to fulfill allocation requests, but typically incur a page fault. They always count towards virtual memory usage, and depending on the OS, typically do not count towards physical memory usage. bytes CDH 5
tcmalloc_physical_bytes_reserved Derived metric computing the amount of physical memory (in bytes) used by the process, including that actually in use and free bytes reserved by tcmalloc. Does not include the tcmalloc metadata. bytes CDH 5
tcmalloc_total_bytes_reserved Bytes of system memory reserved by TCMalloc. bytes CDH 5
thread_manager_running_threads The number of running threads in this process. threads CDH 5
thread_manager_threads_created_rate Threads created over the lifetime of the process. threads per second CDH 5
thrift_server_backend_connections_in_use The number of active Impala Backend client connections to this Impala Daemon. connections CDH 5
thrift_server_backend_connections_rate The total number of Impala Backend client connections made to this Impala Daemon over its lifetime. connections per second CDH 5
thrift_server_beeswax_frontend_connections_in_use The number of active Beeswax API connections to this Impala Daemon. connections CDH 5
thrift_server_beeswax_frontend_connections_rate The total number of Beeswax API connections made to this Impala Daemon over its lifetime. connections per second CDH 5
thrift_server_hiveserver2_frontend_connections_in_use The number of active HiveServer2 API connections to this Impala Daemon. connections CDH 5
thrift_server_hiveserver2_frontend_connections_rate The total number of HiveServer2 API connections made to this Impala Daemon over its lifetime. connections per second CDH 5
unexpected_exits_rate The number of times the role's backing process exited unexpectedly. exits per second CDH 5
uptime For a host, the amount of time since the host was booted. For a role, the uptime of the backing process. seconds CDH 5
web_metrics_collection_duration Web Server Responsiveness ms CDH 5
write_bytes_rate The number of bytes written to the device bytes per second CDH 5
impala_backends_connection_setup_queue_size The number of connections to the Impala Backend Server that have been accepted but are awaiting setup connections CDH 5
impala_buffer_pool_clean_page_bytes Total bytes of clean page memory cached in the buffer pool bytes CDH 5
impala_buffer_pool_clean_pages Total number of clean pages cached in the buffer pool pages CDH 5
impala_buffer_pool_free_buffer_bytes Total bytes of free buffer memory cached in the buffer pool bytes CDH 5
impala_buffer_pool_free_buffers Total number of free buffers cached in the buffer pool buffers CDH 5
impala_buffer_pool_limit Maximum allowed bytes allocated by the buffer pool bytes CDH 5
impala_buffer_pool_reserved Total bytes of buffers reserved by Impala subsystems bytes CDH 5
impala_buffer_pool_system_allocated Total buffer memory currently allocated by the buffer pool bytes CDH 5
impala_data_stream_service_current_usage_bytes Data Stream Service Current Usage Bytes bytes CDH 5
impala_data_stream_service_peak_usage_bytes Data Stream Service Peak Usage Bytes bytes CDH 5
impala_hedged_read_ops_rate The number of hedged reads that have been attempted operations per second CDH 5
impala_hedged_read_ops_win_rate The number of times the hedged read returned faster than the original read operations per second CDH 5
impala_jvm_heap_committed_usage_bytes Jvm heap Committed Usage Bytes bytes CDH 5
impala_jvm_heap_current_usage_bytes Jvm heap Current Usage Bytes bytes CDH 5
impala_jvm_heap_init_usage_bytes JVM heap Init Usage Bytes bytes CDH 5
impala_jvm_heap_max_usage_bytes JVM heap Max Usage Bytes bytes CDH 5
impala_memory_anon_huge_page_bytes Total bytes of anonymous (a.k.a. transparent) huge pages used by this process bytes CDH 5
impala_memory_mapped_bytes Total bytes of memory mappings in this process (the virtual memory size) bytes CDH 5
impala_memory_num_maps Total number of memory mappings in this process regions CDH 5
impala_memory_rss Resident set size (RSS) of this process, including TCMalloc, buffer pool and Jvm bytes CDH 5
impala_memory_total_used Total memory currently used by TCMalloc and buffer pool bytes CDH 5
impala_num_fragments_in_flight The number of query fragment instances currently executing message.units.objects CDH 5
impala_num_queries_registered Number of Queries Registered, Includes Queries That Are in Flight and Waiting to Be Closed message.units.objects CDH 5
impala_rpc_data_stream_service_rpcs_queue_overflow_rate Total number of incoming DataStreamService RPCs that were rejected due to overflow of the incoming service queue requests per second CDH 5