Apache Impala

Memory Usage

Memory consumption / limit: 238.46 MB / 1.70 GB

Breakdown

Process: Limit=1.70 GB Total=238.48 MB Peak=3.29 GB
  Buffer Pool: Free Buffers: Total=0
  Buffer Pool: Clean Pages: Total=0
  Buffer Pool: Unused Reservation: Total=0
  Control Service Queue: Limit=50.00 MB Total=0 Peak=109.68 KB
  Data Stream Service Queue: Limit=87.04 MB Total=0 Peak=578.87 KB
  Data Stream Manager Early RPCs: Total=0 Peak=0
  TCMalloc Overhead: Total=77.67 MB
  RequestPool=root.default: Total=0 Peak=153.84 MB
  RequestPool=fe-eval-exprs: Total=0 Peak=4.00 KB
  Untracked Memory: Total=160.81 MB

tcmalloc

------------------------------------------------
MALLOC:      168620680 (  160.8 MiB) Bytes in use by application
MALLOC: +            0 (    0.0 MiB) Bytes in page heap freelist
MALLOC: +     16582208 (   15.8 MiB) Bytes in central cache freelist
MALLOC: +      9963008 (    9.5 MiB) Bytes in transfer cache freelist
MALLOC: +     54903096 (   52.4 MiB) Bytes in thread cache freelists
MALLOC: +     12976128 (   12.4 MiB) Bytes in malloc metadata
MALLOC:   ------------
MALLOC: =    263045120 (  250.9 MiB) Actual memory used (physical + swap)
MALLOC: +   5522554880 ( 5266.7 MiB) Bytes released to OS (aka unmapped)
MALLOC:   ------------
MALLOC: =   5785600000 ( 5517.6 MiB) Virtual address space used
MALLOC:
MALLOC:          10680              Spans in use
MALLOC:            646              Thread heaps in use
MALLOC:           8192              Tcmalloc page size
------------------------------------------------
Call ReleaseFreeMemory() to release freelist memory to the OS (via madvise()).
Bytes released to the OS take up virtual address space but no physical memory.

System

Physical Memory: 31.34 GB
Transparent Huge Pages Config:
  enabled: always [madvise] never
  defrag: always defer defer+madvise [madvise] never
  khugepaged defrag: 1

Process and system memory metrics

Name	Value	Description
`memory.thp.khugepaged-defrag`	1	The system-wide 'defrag' setting for khugepaged.
`memory.thp.enabled`	always [madvise] never	The system-wide 'enabled' setting for Transparent Huge Pages.
`memory.thp.defrag`	always defer defer+madvise [madvise] never	The system-wide 'defrag' setting for Transparent Huge Pages.
`memory.rss`	707.10 MB	Resident set size (RSS) of this process, including TCMalloc, buffer pool and Jvm.
`memory.mapped-bytes`	12.09 GB	Total bytes of memory mappings in this process (the virtual memory size).
`memory.total-used`	238.48 MB	Total memory currently used by TCMalloc and buffer pool.

Buffer pool memory metrics

Name	Value	Description
`buffer-pool.clean-page-bytes`	0	Total bytes of clean page memory cached in the buffer pool.
`buffer-pool.clean-pages`	0	Total number of clean pages cached in the buffer pool.
`buffer-pool.free-buffers`	0	Total number of free buffers cached in the buffer pool.
`buffer-pool.unused-reservation-bytes`	0	Total bytes of buffer reservations by Impala subsystems that are currently unused
`buffer-pool.arena-7.num-final-scavenges`	0	Number of times the allocator had to lock all arenas and scavenge to fulfil an allocation.
`buffer-pool.arena-7.clean-page-hits`	0	Number of times a clean page was evicted to fulfil an allocation.
`buffer-pool.arena-2.clean-page-hits`	0	Number of times a clean page was evicted to fulfil an allocation.
`buffer-pool.arena-2.num-scavenges`	0	Number of times the allocator had to scavenge to fulfil an allocation.
`buffer-pool.arena-5.numa-arena-free-buffer-hits`	0	Number of times that a recycled buffer within the same NUMA node was used to fulfil an allocation.
`buffer-pool.arena-2.system-alloc-time`	2.999ms	Total time the buffer pool spent in the system allocator for this arena.
`buffer-pool.arena-0.num-final-scavenges`	0	Number of times the allocator had to lock all arenas and scavenge to fulfil an allocation.
`buffer-pool.arena-7.allocated-buffer-sizes`	Count: 4, sum: 56.00 KB, min / max: 8.00 KB / 32.00 KB, 25th %-ile: 8.00 KB, 50th %-ile: 8.00 KB, 75th %-ile: 8.00 KB, 90th %-ile: 32.00 KB, 95th %-ile: 32.00 KB, 99.9th %-ile: 32.00 KB	Statistics for buffer sizes allocated from the system. Only a subset of allocations are counted in this metric to reduce overhead.
`buffer-pool.arena-1.local-arena-free-buffer-hits`	275	Number of times a free buffer was recycled from this core's arena to fulfil an allocation.
`buffer-pool.arena-2.local-arena-free-buffer-hits`	317	Number of times a free buffer was recycled from this core's arena to fulfil an allocation.
`buffer-pool.arena-1.num-final-scavenges`	0	Number of times the allocator had to lock all arenas and scavenge to fulfil an allocation.
`buffer-pool.arena-1.num-scavenges`	0	Number of times the allocator had to scavenge to fulfil an allocation.
`buffer-pool.arena-3.direct-alloc-count`	371	Number of times a new buffer was directly allocated from the system allocator to fulfil an allocation.
`buffer-pool.arena-6.num-scavenges`	0	Number of times the allocator had to scavenge to fulfil an allocation.
`buffer-pool.arena-7.local-arena-free-buffer-hits`	320	Number of times a free buffer was recycled from this core's arena to fulfil an allocation.
`buffer-pool.arena-1.clean-page-hits`	0	Number of times a clean page was evicted to fulfil an allocation.
`buffer-pool.arena-6.system-alloc-time`	2.301ms	Total time the buffer pool spent in the system allocator for this arena.
`buffer-pool.arena-0.system-alloc-time`	3.393ms	Total time the buffer pool spent in the system allocator for this arena.
`buffer-pool.arena-4.local-arena-free-buffer-hits`	587	Number of times a free buffer was recycled from this core's arena to fulfil an allocation.
`buffer-pool.arena-6.numa-arena-free-buffer-hits`	0	Number of times that a recycled buffer within the same NUMA node was used to fulfil an allocation.
`buffer-pool.arena-0.local-arena-free-buffer-hits`	357	Number of times a free buffer was recycled from this core's arena to fulfil an allocation.
`buffer-pool.arena-1.allocated-buffer-sizes`	Count: 4, sum: 2.03 MB, min / max: 8.00 KB / 2.00 MB, 25th %-ile: 8.00 KB, 50th %-ile: 8.00 KB, 75th %-ile: 16.00 KB, 90th %-ile: 2.00 MB, 95th %-ile: 2.00 MB, 99.9th %-ile: 2.00 MB	Statistics for buffer sizes allocated from the system. Only a subset of allocations are counted in this metric to reduce overhead.
`buffer-pool.arena-4.clean-page-hits`	0	Number of times a clean page was evicted to fulfil an allocation.
`buffer-pool.arena-3.allocated-buffer-sizes`	Count: 5, sum: 6.02 MB, min / max: 8.00 KB / 2.00 MB, 25th %-ile: 8.00 KB, 50th %-ile: 2.00 MB, 75th %-ile: 2.00 MB, 90th %-ile: 2.00 MB, 95th %-ile: 2.00 MB, 99.9th %-ile: 2.00 MB	Statistics for buffer sizes allocated from the system. Only a subset of allocations are counted in this metric to reduce overhead.
`buffer-pool.arena-3.system-alloc-time`	3.302ms	Total time the buffer pool spent in the system allocator for this arena.
`buffer-pool.arena-1.direct-alloc-count`	275	Number of times a new buffer was directly allocated from the system allocator to fulfil an allocation.
`buffer-pool.arena-0.direct-alloc-count`	362	Number of times a new buffer was directly allocated from the system allocator to fulfil an allocation.
`buffer-pool.clean-pages-limit`	133.17 MB	Limit on number of clean pages cached in the buffer pool.
`buffer-pool.free-buffer-bytes`	0	Total bytes of free buffer memory cached in the buffer pool.
`buffer-pool.arena-2.direct-alloc-count`	403	Number of times a new buffer was directly allocated from the system allocator to fulfil an allocation.
`buffer-pool.arena-5.local-arena-free-buffer-hits`	170	Number of times a free buffer was recycled from this core's arena to fulfil an allocation.
`buffer-pool.arena-7.direct-alloc-count`	315	Number of times a new buffer was directly allocated from the system allocator to fulfil an allocation.
`buffer-pool.arena-0.num-scavenges`	0	Number of times the allocator had to scavenge to fulfil an allocation.
`buffer-pool.arena-4.numa-arena-free-buffer-hits`	0	Number of times that a recycled buffer within the same NUMA node was used to fulfil an allocation.
`buffer-pool.arena-7.system-alloc-time`	2.366ms	Total time the buffer pool spent in the system allocator for this arena.
`buffer-pool.arena-2.numa-arena-free-buffer-hits`	0	Number of times that a recycled buffer within the same NUMA node was used to fulfil an allocation.
`buffer-pool.arena-0.allocated-buffer-sizes`	Count: 5, sum: 2.52 MB, min / max: 8.00 KB / 2.00 MB, 25th %-ile: 8.00 KB, 50th %-ile: 256.00 KB, 75th %-ile: 256.00 KB, 90th %-ile: 2.00 MB, 95th %-ile: 2.00 MB, 99.9th %-ile: 2.00 MB	Statistics for buffer sizes allocated from the system. Only a subset of allocations are counted in this metric to reduce overhead.
`buffer-pool.arena-7.num-scavenges`	0	Number of times the allocator had to scavenge to fulfil an allocation.
`buffer-pool.arena-3.numa-arena-free-buffer-hits`	0	Number of times that a recycled buffer within the same NUMA node was used to fulfil an allocation.
`buffer-pool.arena-2.num-final-scavenges`	0	Number of times the allocator had to lock all arenas and scavenge to fulfil an allocation.
`buffer-pool.arena-5.num-scavenges`	0	Number of times the allocator had to scavenge to fulfil an allocation.
`buffer-pool.arena-0.numa-arena-free-buffer-hits`	0	Number of times that a recycled buffer within the same NUMA node was used to fulfil an allocation.
`buffer-pool.system-allocated`	0	Total buffer memory currently allocated by the buffer pool.
`buffer-pool.arena-5.allocated-buffer-sizes`	Count: 3, sum: 272.00 KB, min / max: 8.00 KB / 256.00 KB, 25th %-ile: 8.00 KB, 50th %-ile: 8.00 KB, 75th %-ile: 8.00 KB, 90th %-ile: 256.00 KB, 95th %-ile: 256.00 KB, 99.9th %-ile: 256.00 KB	Statistics for buffer sizes allocated from the system. Only a subset of allocations are counted in this metric to reduce overhead.
`buffer-pool.arena-0.clean-page-hits`	0	Number of times a clean page was evicted to fulfil an allocation.
`buffer-pool.limit`	1.30 GB	Maximum allowed bytes allocated by the buffer pool.
`buffer-pool.arena-1.system-alloc-time`	1.897ms	Total time the buffer pool spent in the system allocator for this arena.
`buffer-pool.arena-1.numa-arena-free-buffer-hits`	0	Number of times that a recycled buffer within the same NUMA node was used to fulfil an allocation.
`buffer-pool.arena-3.clean-page-hits`	0	Number of times a clean page was evicted to fulfil an allocation.
`buffer-pool.reserved`	0	Total bytes of buffers reserved by Impala subsystems
`buffer-pool.arena-3.num-scavenges`	0	Number of times the allocator had to scavenge to fulfil an allocation.
`buffer-pool.arena-3.local-arena-free-buffer-hits`	284	Number of times a free buffer was recycled from this core's arena to fulfil an allocation.
`buffer-pool.arena-3.num-final-scavenges`	0	Number of times the allocator had to lock all arenas and scavenge to fulfil an allocation.
`buffer-pool.arena-4.system-alloc-time`	3.970ms	Total time the buffer pool spent in the system allocator for this arena.
`buffer-pool.arena-7.numa-arena-free-buffer-hits`	0	Number of times that a recycled buffer within the same NUMA node was used to fulfil an allocation.
`buffer-pool.arena-4.direct-alloc-count`	389	Number of times a new buffer was directly allocated from the system allocator to fulfil an allocation.
`buffer-pool.arena-4.num-scavenges`	0	Number of times the allocator had to scavenge to fulfil an allocation.
`buffer-pool.arena-6.local-arena-free-buffer-hits`	349	Number of times a free buffer was recycled from this core's arena to fulfil an allocation.
`buffer-pool.arena-5.system-alloc-time`	1.380ms	Total time the buffer pool spent in the system allocator for this arena.
`buffer-pool.arena-4.num-final-scavenges`	0	Number of times the allocator had to lock all arenas and scavenge to fulfil an allocation.
`buffer-pool.arena-5.direct-alloc-count`	246	Number of times a new buffer was directly allocated from the system allocator to fulfil an allocation.
`buffer-pool.arena-2.allocated-buffer-sizes`	Count: 6, sum: 656.00 KB, min / max: 8.00 KB / 256.00 KB, 25th %-ile: 8.00 KB, 50th %-ile: 64.00 KB, 75th %-ile: 256.00 KB, 90th %-ile: 256.00 KB, 95th %-ile: 256.00 KB, 99.9th %-ile: 256.00 KB	Statistics for buffer sizes allocated from the system. Only a subset of allocations are counted in this metric to reduce overhead.
`buffer-pool.arena-4.allocated-buffer-sizes`	Count: 6, sum: 3.52 MB, min / max: 8.00 KB / 2.00 MB, 25th %-ile: 8.00 KB, 50th %-ile: 256.00 KB, 75th %-ile: 1.00 MB, 90th %-ile: 1.00 MB, 95th %-ile: 2.00 MB, 99.9th %-ile: 2.00 MB	Statistics for buffer sizes allocated from the system. Only a subset of allocations are counted in this metric to reduce overhead.
`buffer-pool.arena-5.num-final-scavenges`	0	Number of times the allocator had to lock all arenas and scavenge to fulfil an allocation.
`buffer-pool.arena-5.clean-page-hits`	0	Number of times a clean page was evicted to fulfil an allocation.
`buffer-pool.arena-6.direct-alloc-count`	322	Number of times a new buffer was directly allocated from the system allocator to fulfil an allocation.
`buffer-pool.arena-6.allocated-buffer-sizes`	Count: 5, sum: 400.00 KB, min / max: 8.00 KB / 256.00 KB, 25th %-ile: 8.00 KB, 50th %-ile: 64.00 KB, 75th %-ile: 64.00 KB, 90th %-ile: 256.00 KB, 95th %-ile: 256.00 KB, 99.9th %-ile: 256.00 KB	Statistics for buffer sizes allocated from the system. Only a subset of allocations are counted in this metric to reduce overhead.
`buffer-pool.arena-6.clean-page-hits`	0	Number of times a clean page was evicted to fulfil an allocation.
`buffer-pool.arena-6.num-final-scavenges`	0	Number of times the allocator had to lock all arenas and scavenge to fulfil an allocation.

JVM aggregate memory metrics

Name	Value	Description
`jvm.gc_total_extra_sleep_time_millis`	18s919ms	Jvm Pause Detection Extra Sleep Time
`jvm.total.init-usage-bytes`	310.44 MB	Jvm total Init Usage Bytes
`jvm.total.committed-usage-bytes`	419.99 MB	Jvm total Committed Usage Bytes
`jvm.total.peak-max-usage-bytes`	1.54 GB	Jvm total Peak Max Usage Bytes
`jvm.total.peak-current-usage-bytes`	373.71 MB	Jvm total Peak Current Usage Bytes
`jvm.total.peak-init-usage-bytes`	310.44 MB	Jvm total Peak Init Usage Bytes
`jvm.total.peak-committed-usage-bytes`	609.99 MB	Jvm total Peak Committed Usage Bytes
`jvm.total.current-usage-bytes`	259.08 MB	Jvm total Current Usage Bytes
`jvm.total.max-usage-bytes`	1.54 GB	Jvm total Max Usage Bytes

JVM heap memory metrics

Name	Value	Description
`jvm.heap.peak-committed-usage-bytes`	0	Jvm heap Peak Committed Usage Bytes
`jvm.heap.peak-max-usage-bytes`	0	Jvm heap Peak Max Usage Bytes
`jvm.heap.init-usage-bytes`	308.00 MB	Jvm heap Init Usage Bytes
`jvm.heap.peak-init-usage-bytes`	0	Jvm heap Peak Init Usage Bytes
`jvm.heap.current-usage-bytes`	149.25 MB	Jvm heap Current Usage Bytes
`jvm.heap.max-usage-bytes`	308.00 MB	Jvm heap Max Usage Bytes
`jvm.heap.peak-current-usage-bytes`	0	Jvm heap Peak Current Usage Bytes
`jvm.heap.committed-usage-bytes`	308.00 MB	Jvm heap Committed Usage Bytes

JVM non-heap memory metrics

Name	Value	Description
`jvm.non-heap.peak-init-usage-bytes`	0	Jvm non-heap Peak Init Usage Bytes
`jvm.non-heap.peak-committed-usage-bytes`	0	Jvm non-heap Peak Committed Usage Bytes
`jvm.non-heap.peak-current-usage-bytes`	0	Jvm non-heap Peak Current Usage Bytes
`jvm.non-heap.peak-max-usage-bytes`	0	Jvm non-heap Peak Max Usage Bytes
`jvm.non-heap.committed-usage-bytes`	111.99 MB	Jvm non-heap Committed Usage Bytes
`jvm.non-heap.max-usage-bytes`	-1.00 B	Jvm non-heap Max Usage Bytes
`jvm.non-heap.init-usage-bytes`	2.44 MB	Jvm non-heap Init Usage Bytes
`jvm.non-heap.current-usage-bytes`	109.82 MB	Jvm non-heap Current Usage Bytes