Query be4e7100835021e7:a7a24f3e00000000
Query (id=be4e7100835021e7:a7a24f3e00000000):
Summary:
Session ID: 5946d513f5de5439:1acc8b13b8e0578b
Session Type: HIVESERVER2
HiveServer2 Protocol Version: V6
Start Time: 2025-09-18 18:19:36.023227000
End Time: 2025-09-18 18:19:36.506541000
Duration: 483.314ms (483314 us)
Query Type: QUERY
Query State: FINISHED
Impala Query State: FINISHED
Query Status: OK
Impala Version: impalad version 4.4.1-RELEASE RELEASE (build ced4193fbfdc9b5635407157c0f18ce00480327c)
User: psantos
Connected User: psantos
Delegated User:
Network Address: 172.19.147.17:35482
Default Db: default
Sql Statement: SELECT `C_64656661756c745f6f7264657273`.`rowid` AS `C_8`, `C_64656661756c745f6f7264657273`.`orderid` AS `C_9`, `C_64656661756c745f6f7264657273`.`orderdate` AS `C_13`, `C_64656661756c745f6f7264657273`.`shipdate` AS `C_6`, `C_64656661756c745f6f7264657273`.`shipmode` AS `C_19`, `C_64656661756c745f6f7264657273`.`customerid` AS `C_16`, `C_64656661756c745f6f7264657273`.`customername` AS `C_14`, `C_64656661756c745f6f7264657273`.`segment` AS `C_7`, `C_64656661756c745f6f7264657273`.`country` AS `C_5`, `C_64656661756c745f6f7264657273`.`city` AS `C_4`, `C_64656661756c745f6f7264657273`.`state` AS `C_10`, `C_64656661756c745f6f7264657273`.`postalcode` AS `C_0`, `C_64656661756c745f6f7264657273`.`region` AS `C_1`, `C_64656661756c745f6f7264657273`.`productid` AS `C_17`, `C_64656661756c745f6f7264657273`.`category` AS `C_43`, `C_64656661756c745f6f7264657273`.`subcategory` AS `C_2`, `C_64656661756c745f6f7264657273`.`productname` AS `C_15`, `C_64656661756c745f6f7264657273`.`sales` AS `C_12`, `C_64656661756c745f6f7264657273`.`quantity` AS `C_3`, `C_64656661756c745f6f7264657273`.`discount` AS `C_18`, `C_64656661756c745f6f7264657273`.`profit` AS `C_11` FROM `default`.`orders` `C_64656661756c745f6f7264657273`
Coordinator: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000
Query Options (set by configuration): COMPRESSION_CODEC=TCompressionCodec(codec=ZSTD, compression_level=3),DEFAULT_JOIN_DISTRIBUTION_MODE=SHUFFLE,TIMEZONE=Europe/Moscow,DEFAULT_FILE_FORMAT=PARQUET,DEFAULT_HINTS_INSERT_STATEMENT=NOCLUSTERED,FETCH_ROWS_TIMEOUT_MS=0,ENABLE_OUTER_JOIN_TO_INNER_TRANSFORMATION=1,UTF8_MODE=1
Query Options (set by configuration and planner): COMPRESSION_CODEC=TCompressionCodec(codec=ZSTD, compression_level=3),MT_DOP=0,DEFAULT_JOIN_DISTRIBUTION_MODE=SHUFFLE,TIMEZONE=Europe/Moscow,DEFAULT_FILE_FORMAT=PARQUET,DEFAULT_HINTS_INSERT_STATEMENT=NOCLUSTERED,FETCH_ROWS_TIMEOUT_MS=0,ENABLE_OUTER_JOIN_TO_INNER_TRANSFORMATION=1,UTF8_MODE=1,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE
Tables Queried: default.orders
Plan:
----------------
Max Per-Host Resource Reservation: Memory=9.31MB Threads=5
Per-Host Resource Estimates: Memory=184MB
WARNING: The following tables are missing relevant table and/or column statistics.
default.orders
Analyzed query: SELECT C_64656661756c745f6f7264657273.rowid C_8,
C_64656661756c745f6f7264657273.orderid C_9,
C_64656661756c745f6f7264657273.orderdate C_13,
C_64656661756c745f6f7264657273.shipdate C_6,
C_64656661756c745f6f7264657273.shipmode C_19,
C_64656661756c745f6f7264657273.customerid C_16,
C_64656661756c745f6f7264657273.customername C_14,
C_64656661756c745f6f7264657273.segment C_7,
C_64656661756c745f6f7264657273.country C_5, C_64656661756c745f6f7264657273.city
C_4, C_64656661756c745f6f7264657273.state C_10,
C_64656661756c745f6f7264657273.postalcode C_0,
C_64656661756c745f6f7264657273.region C_1,
C_64656661756c745f6f7264657273.productid C_17,
C_64656661756c745f6f7264657273.category C_43,
C_64656661756c745f6f7264657273.subcategory C_2,
C_64656661756c745f6f7264657273.productname C_15,
C_64656661756c745f6f7264657273.sales C_12,
C_64656661756c745f6f7264657273.quantity C_3,
C_64656661756c745f6f7264657273.discount C_18,
C_64656661756c745f6f7264657273.profit C_11 FROM `default`.orders
c_64656661756c745f6f7264657273
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Host Resources: mem-estimate=14.67MB mem-reservation=4.00MB thread-reservation=1
PLAN-ROOT SINK
| output exprs: C_64656661756c745f6f7264657273.rowid, C_64656661756c745f6f7264657273.orderid, C_64656661756c745f6f7264657273.orderdate, C_64656661756c745f6f7264657273.shipdate, C_64656661756c745f6f7264657273.shipmode, C_64656661756c745f6f7264657273.customerid, C_64656661756c745f6f7264657273.customername, C_64656661756c745f6f7264657273.segment, C_64656661756c745f6f7264657273.country, C_64656661756c745f6f7264657273.city, C_64656661756c745f6f7264657273.state, C_64656661756c745f6f7264657273.postalcode, C_64656661756c745f6f7264657273.region, C_64656661756c745f6f7264657273.productid, C_64656661756c745f6f7264657273.category, C_64656661756c745f6f7264657273.subcategory, C_64656661756c745f6f7264657273.productname, C_64656661756c745f6f7264657273.sales, C_64656661756c745f6f7264657273.quantity, C_64656661756c745f6f7264657273.discount, C_64656661756c745f6f7264657273.profit
| mem-estimate=7.21MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
06:EXCHANGE [UNPARTITIONED]
| mem-estimate=7.46MB mem-reservation=0B thread-reservation=0
| tuple-ids=0 row-size=252B cardinality=30.01K
| in pipelines: 03(GETNEXT), 00(GETNEXT)
|
F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
Per-Host Resources: mem-estimate=136.40MB mem-reservation=5.25MB thread-reservation=2
04:UNION
| pass-through-operands: all
| mem-estimate=0B mem-reservation=0B thread-reservation=0
| tuple-ids=0 row-size=252B cardinality=30.01K
| in pipelines: 03(GETNEXT), 00(GETNEXT)
|
|--02:DELETE EVENTS HASH JOIN [LEFT ANTI JOIN, BROADCAST]
| | hash predicates: c_64656661756c745f6f7264657273.file__position = c_64656661756c745f6f7264657273-position-delete.pos, c_64656661756c745f6f7264657273.input__file__name = c_64656661756c745f6f7264657273-position-delete.file_path
| | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
| | tuple-ids=0 row-size=252B cardinality=20.02K
| | in pipelines: 00(GETNEXT), 01(OPEN)
| |
| |--05:EXCHANGE [BROADCAST]
| | | mem-estimate=2.65MB mem-reservation=0B thread-reservation=0
| | | tuple-ids=1 row-size=132B cardinality=20.02K
| | | in pipelines: 01(GETNEXT)
| | |
| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Host Resources: mem-estimate=32.53MB mem-reservation=64.00KB thread-reservation=2
| | 01:SCAN S3 [default.orders-POSITION-DELETE-01 c_64656661756c745f6f7264657273-position-delete, RANDOM]
| | S3 partitions=1/1 files=4 size=75.81KB
| | Iceberg snapshot id: 8925916327827828503
| | stored statistics:
| | table: rows=20.02K size=75.81KB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=9.65K
| | mem-estimate=32.00MB mem-reservation=64.00KB thread-reservation=1
| | tuple-ids=1 row-size=132B cardinality=20.02K
| | in pipelines: 01(GETNEXT)
| |
| 00:SCAN S3 [default.orders c_64656661756c745f6f7264657273, RANDOM]
| S3 partitions=1/1 files=4 size=732.15KB
| Iceberg snapshot id: 8925916327827828503
| stored statistics:
| table: rows=30.01K size=1.14MB
| columns missing stats: rowid, orderid, orderdate, shipdate, shipmode, customerid, customername, segment, country, city, state, postalcode, region, productid, category, subcategory, productname, sales, quantity, discount, profit
| extrapolated-rows=disabled max-scan-range-rows=14.68K
| mem-estimate=128.00MB mem-reservation=512.00KB thread-reservation=1
| tuple-ids=0 row-size=252B cardinality=20.02K
| in pipelines: 00(GETNEXT)
|
03:SCAN S3 [default.orders c_64656661756c745f6f7264657273, RANDOM]
S3 partitions=1/1 files=1 size=358.27KB
Iceberg snapshot id: 8925916327827828503
stored statistics:
table: rows=30.01K size=1.14MB
columns missing stats: rowid, orderid, orderdate, shipdate, shipmode, customerid, customername, segment, country, city, state, postalcode, region, productid, category, subcategory, productname, sales, quantity, discount, profit
extrapolated-rows=disabled max-scan-range-rows=30.01K
mem-estimate=128.00MB mem-reservation=512.00KB thread-reservation=1
tuple-ids=0 row-size=252B cardinality=9.99K
in pipelines: 03(GETNEXT)
----------------
Estimated Per-Host Mem: 192526452
Tables Missing Stats: default.orders
Request Pool: root.default
Per Host Min Memory Reservation: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(9.31 MB)
Per Host Number of Fragment Instances: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(3)
Admission result: Admitted immediately
Cluster Memory Admitted: 183.61 MB
Executor Group: default
Number of running queries in designated executor group when admitted: 1
ExecSummary:
Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
F04:ROOT 1 1 3.576ms 3.576ms 6.01 MB 7.21 MB
06:EXCHANGE 1 1 185.302us 185.302us 9.99K 30.01K 3.02 MB 7.46 MB UNPARTITIONED
F03:EXCHANGE SENDER 1 1 4.700ms 4.700ms 2.24 MB 1.00 MB
04:UNION 1 1 0.000ns 0.000ns 9.99K 30.01K 0 0
|--02:DELETE EVENTS HASH JOIN 1 1 6.608ms 6.608ms 0 20.02K 5.18 MB 4.75 MB LEFT ANTI JOIN, BROADCAST
| |--05:EXCHANGE 1 1 225.536us 225.536us 20.02K 20.02K 4.94 MB 2.65 MB BROADCAST
| | F02:EXCHANGE SENDER 1 1 1.702ms 1.702ms 274.43 KB 544.00 KB
| | 01:SCAN S3 1 1 31.439ms 31.439ms 20.02K 20.02K 859.23 KB 32.00 MB default.orders-POSITION-DELETE-01 c_64656661756c745f6f7264657273-position-delete
| 00:SCAN S3 1 1 78.804ms 78.804ms 20.02K 20.02K 3.58 MB 128.00 MB default.orders c_64656661756c745f6f7264657273
03:SCAN S3 1 1 106.059ms 106.059ms 9.99K 9.99K 3.48 MB 128.00 MB default.orders c_64656661756c745f6f7264657273
Errors:
Query Compilation: 5.225ms
- Metadata of all 1 tables cached: 1.575ms (1.575ms)
- Analysis finished: 2.231ms (655.767us)
- Authorization finished (noop): 2.372ms (141.274us)
- Value transfer graph computed: 2.440ms (67.553us)
- Single node plan created: 3.106ms (666.293us)
- Runtime filters computed: 3.210ms (104.143us)
- Distributed plan created: 3.233ms (22.584us)
- Lineage info computed: 3.318ms (85.161us)
- Planning finished: 5.225ms (1.906ms)
Query Timeline: 529.593ms
- Query submitted: 47.561us (47.561us)
- Planning finished: 6.347ms (6.300ms)
- Submit for admission: 6.663ms (315.874us)
- Completed admission: 16.813ms (10.149ms)
- Ready to start on 1 backends: 16.948ms (135.826us)
- All 1 execution backends (3 fragment instances) started: 18.298ms (1.349ms)
- Rows available: 171.291ms (152.992ms)
- First row fetched: 235.721ms (64.430ms)
- Last row fetched: 480.738ms (245.016ms)
- Released admission control resources: 483.312ms (2.573ms)
- Unregister query: 529.593ms (46.281ms)
- AdmissionControlTimeSinceLastUpdate: 0.000ns
- ComputeScanRangeAssignmentTimer: 71.396us
Memory Reserve:
Frontend:
Referenced Tables: default.orders
Expr memory estimated bytes: 3150
- CatalogFetch.ColumnStats.Hits: 42
- CatalogFetch.ColumnStats.Misses: 0
- CatalogFetch.ColumnStats.Requests: 42
- CatalogFetch.ColumnStats.Time: 0
- CatalogFetch.Config.Hits: 1
- CatalogFetch.Config.Misses: 0
- CatalogFetch.Config.Requests: 1
- CatalogFetch.Config.Time: 0
- CatalogFetch.DatabaseList.Hits: 1
- CatalogFetch.DatabaseList.Misses: 0
- CatalogFetch.DatabaseList.Requests: 1
- CatalogFetch.DatabaseList.Time: 0
- CatalogFetch.PartitionLists.Hits: 1
- CatalogFetch.PartitionLists.Misses: 0
- CatalogFetch.PartitionLists.Requests: 1
- CatalogFetch.PartitionLists.Time: 0
- CatalogFetch.Partitions.Hits: 6
- CatalogFetch.Partitions.Misses: 0
- CatalogFetch.Partitions.Requests: 6
- CatalogFetch.Partitions.Time: 0
- CatalogFetch.TableList.Hits: 1
- CatalogFetch.TableList.Misses: 0
- CatalogFetch.TableList.Requests: 1
- CatalogFetch.TableList.Time: 0
- CatalogFetch.Tables.Hits: 3
- CatalogFetch.Tables.Misses: 0
- CatalogFetch.Tables.Requests: 3
- CatalogFetch.Tables.Time: 0
- ExecutorGroupsConsidered: 1 (1)
Executor group 1:
Verdict: Match
- MemoryAsk: 183.61 MB (192526452)
- MemoryMax: 8589934592.00 GB (9223372036854775807)
ImpalaServer:
- ClientFetchWaitTimeStats: (Avg: 26.471ms ; Min: 19.501ms ; Max: 62.305ms ; Number of samples: 11)
- GetInFlightProfileTimeStats: 0.000ns (Number of samples: 0)
- ClientFetchLockWaitTimer: 2.119us
- ClientFetchWaitTimer: 291.185ms
- NumRowsFetched: 9.99K (9994)
- NumRowsFetchedFromCache: 0 (0)
- RPCCount: 21 (21)
- RPCReadTimer: 59.000us
- RPCWriteTimer: 11.965ms
- RowMaterializationRate: 476.41 K/sec
- RowMaterializationTimer: 20.977ms
Execution Profile be4e7100835021e7:a7a24f3e00000000:
Number of filters: 0
Filter routing table:
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value In-list size
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Backend startup latencies: Count: 1, sum: 1ms, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms
Slowest backend to start up: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000
Per Node Peak Memory Usage: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(23.19 MB)
Per Node Bytes Read: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(1.49 MB)
Per Node User Time: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(122.244ms)
Per Node System Time: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(32.177ms)
- ExchangeScanRatio: 5.44
- FiltersReceived: 0 (0)
- FinalizationTimer: 0.000ns
- InnerNodeSelectivityRatio: 0.00
- NumBackends: 1 (1)
- NumCompletedBackends: 1 (1)
- NumFragmentInstances: 3 (3)
- NumFragments: 3 (3)
- TotalBytesRead: 1.49 MB (1562217)
- TotalBytesSent: 8.11 MB (8502094)
- TotalCpuTime: 154.422ms
- TotalInnerBytesSent: 0
- TotalScanBytesSent: 8.11 MB (8502094)
Per Node Profiles:
impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000:
- HostCpuIoWaitPercentage (50.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- HostCpuSysPercentage (50.000ms): 3, 3, 3, 3, 3, 3, 3, 4, 4, 4
- HostCpuUserPercentage (50.000ms): 8, 8, 8, 8, 8, 8, 8, 15, 15, 15
- HostDiskReadThroughput (50.000ms): 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec
- HostDiskWriteThroughput (50.000ms): 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec
- HostNetworkRx (50.000ms): 72.44 KB/sec, 72.44 KB/sec, 72.44 KB/sec, 72.44 KB/sec, 72.44 KB/sec, 72.44 KB/sec, 72.44 KB/sec, 10.39 MB/sec, 10.39 MB/sec, 10.39 MB/sec
- HostNetworkTx (50.000ms): 60.63 KB/sec, 60.63 KB/sec, 60.63 KB/sec, 60.63 KB/sec, 60.63 KB/sec, 60.63 KB/sec, 60.63 KB/sec, 3.96 MB/sec, 3.96 MB/sec, 3.96 MB/sec
- AdmissionSlots: 1 (1)
- BloomFilterBytes: 0
- InListFilterItems: 0 (0)
- ScratchBytesRead: 0
- ScratchBytesReadUseLocalDisk: 0
- ScratchBytesReadUseMem: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchReadsUseLocalDisk: 0 (0)
- ScratchReadsUseMem: 0 (0)
- ScratchWrites: 0 (0)
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
- UncompressedScratchBytesWritten: 0
Buffer pool:
- AllocTime: 0.000ns
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- EncryptionTime: 0.000ns
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
JVM:
- GcCount: 0 (0)
- GcNumInfoThresholdExceeded: 0 (0)
- GcNumWarnThresholdExceeded: 0 (0)
- GcTimeMillis: 0
- GcTotalExtraSleepTimeMillis: 0
Fragment F04:
CodeGen:
- CodegenCacheLookupTime: 1.755ms
- CodegenCacheSaveTime: 0.000ns
- CodegenCompileThreadInvoluntaryContextSwitches: 0 (0)
- CodegenCompileThreadTotalWallClockTime: 0.000ns
- CodegenCompileThreadSysTime: 0.000ns
- CodegenCompileThreadUserTime: 0.000ns
- CodegenCompileThreadVoluntaryContextSwitches: 0 (0)
- CodegenInvoluntaryContextSwitches: 2 (2)
- CodegenTotalWallClockTime: 33.232ms
- CodegenSysTime: 3.954ms
- CodegenUserTime: 27.305ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 146.053us
- FunctionPruneTime: 2.981ms
- InactiveTotalTime: 0.000ns
- IrGenerationTime: 759.439us
- LoadTime: 0.000ns
- MainThreadCodegenTime: 7.192ms
- ModuleBitcodeGenTime: 1.674ms
- ModuleBitcodeSize: 3.20 MB (3355244)
- NumCachedFunctions: 22 (22)
- NumFunctions: 26 (26)
- NumInstructions: 616 (616)
- NumOptimizedFunctions: 22 (22)
- NumOptimizedInstructions: 587 (587)
- OptimizationTime: 0.000ns
- PeakMemoryUsage: 2.05 KB (2104)
- PrepareTime: 26.052ms
- TotalTime: 33.244ms
Fragment F03:
CodeGen:
- CodegenCacheLookupTime: 4.835ms
- CodegenCacheSaveTime: 0.000ns
- CodegenCompileThreadInvoluntaryContextSwitches: 0 (0)
- CodegenCompileThreadTotalWallClockTime: 0.000ns
- CodegenCompileThreadSysTime: 0.000ns
- CodegenCompileThreadUserTime: 0.000ns
- CodegenCompileThreadVoluntaryContextSwitches: 0 (0)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 44.620ms
- CodegenSysTime: 0.000ns
- CodegenUserTime: 43.124ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 201.206us
- FunctionPruneTime: 3.500ms
- InactiveTotalTime: 0.000ns
- IrGenerationTime: 8.333ms
- LoadTime: 0.000ns
- MainThreadCodegenTime: 18.070ms
- ModuleBitcodeGenTime: 4.725ms
- ModuleBitcodeSize: 3.20 MB (3355244)
- NumCachedFunctions: 54 (54)
- NumFunctions: 91 (91)
- NumInstructions: 3.75K (3745)
- NumOptimizedFunctions: 54 (54)
- NumOptimizedInstructions: 3.56K (3558)
- OptimizationTime: 0.000ns
- PeakMemoryUsage: 12.48 KB (12776)
- PrepareTime: 26.563ms
- TotalTime: 44.633ms
Fragment F02:
CodeGen:
- CodegenCacheLookupTime: 1.510ms
- CodegenCacheSaveTime: 0.000ns
- CodegenCompileThreadInvoluntaryContextSwitches: 0 (0)
- CodegenCompileThreadTotalWallClockTime: 0.000ns
- CodegenCompileThreadSysTime: 0.000ns
- CodegenCompileThreadUserTime: 0.000ns
- CodegenCompileThreadVoluntaryContextSwitches: 0 (0)
- CodegenInvoluntaryContextSwitches: 0 (0)
- CodegenTotalWallClockTime: 23.349ms
- CodegenSysTime: 0.000ns
- CodegenUserTime: 23.137ms
- CodegenVoluntaryContextSwitches: 1 (1)
- CompileTime: 80.217us
- FunctionPruneTime: 1.991ms
- InactiveTotalTime: 0.000ns
- IrGenerationTime: 331.693us
- LoadTime: 0.000ns
- MainThreadCodegenTime: 4.854ms
- ModuleBitcodeGenTime: 1.404ms
- ModuleBitcodeSize: 3.20 MB (3355244)
- NumCachedFunctions: 1 (1)
- NumFunctions: 3 (3)
- NumInstructions: 102 (102)
- NumOptimizedFunctions: 1 (1)
- NumOptimizedInstructions: 74 (74)
- OptimizationTime: 0.000ns
- PeakMemoryUsage: 258.00 B (258)
- PrepareTime: 18.507ms
- TotalTime: 23.360ms
Averaged Fragment F04:(Total: 461.975ms, non-child: 33.552ms, % non-child: 7.26%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:464.128ms max:464.128ms mean: 464.128ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BytesAssigned: 0
- CompletionTime: 464.128ms
- ExchangeScanRatio: 0.00
- ExecutionRate: 0.00 /sec
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 9.03 MB (9469952)
- PeakReservation: 6.00 MB (6291456)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 23.19 MB (24312268)
- RowsProduced: 9.99K (9994)
- TotalNetworkReceiveTime: 207.206ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 461.832ms
- TotalThreadsSysTime: 8.225ms
- TotalThreadsUserTime: 29.380ms
- TotalThreadsVoluntaryContextSwitches: 12 (12)
- TotalTime: 461.975ms
Fragment Instance Lifecycle Timings:
- ExecTime: 309.492ms
- ExecTreeExecTime: 88.416ms
- OpenTime: 152.349ms
- ExecTreeOpenTime: 118.955ms
- PrepareTime: 106.754us
- ExecTreePrepareTime: 56.769us
PLAN_ROOT_SINK:(Total: 221.059ms, non-child: 3.576ms, % non-child: 1.62%)
- CreateResultSetTime: 17.063ms
- InactiveTotalTime: 217.482ms
- PeakMemoryUsage: 6.01 MB (6299648)
- RowBatchGetWaitTime: 0.000ns
- RowBatchSendWaitTime: 0.000ns
- RowsSent: 9.99K (9994)
- RowsSentRate: 45.21 K/sec
- TotalTime: 221.059ms
Buffer pool:
- AllocTime: 172.945us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 6.00 MB (6291456)
- CumulativeAllocations: 3 (3)
- EncryptionTime: 0.000ns
- PeakReservation: 6.00 MB (6291456)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 6.00 MB (6291456)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 100.00 MB (104857600)
- SystemAllocTime: 163.545us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 207.363ms, non-child: 185.302us, % non-child: 0.09%)
- ConvertRowBatchTime: 134.424us
- InactiveTotalTime: 207.178ms
- PeakMemoryUsage: 3.02 MB (3162112)
- RowsReturned: 9.99K (9994)
- RowsReturnedRate: 48.20 K/sec
- TotalTime: 207.363ms
Buffer pool:
- AllocTime: 29.187us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 9.58 MB (10043392)
- CumulativeAllocations: 20 (20)
- EncryptionTime: 0.000ns
- PeakReservation: 3.02 MB (3162112)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 3.02 MB (3162112)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 4.224us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 118.943ms
- TotalBytesDequeued: 5.53 MB (5800024)
- TotalGetBatchTime: 207.200ms
- DataWaitTime: 207.178ms
Enqueue:
- DispatchTime: (Avg: 41.752us ; Min: 33.282us ; Max: 69.691us ; Number of samples: 10)
- DeserializeRowBatchTime: 1.698ms
- TotalBatchesEnqueued: 10 (10)
- TotalBatchesReceived: 10 (10)
- TotalBytesReceived: 5.49 MB (5760048)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
Coordinator Fragment F04:
Instance be4e7100835021e7:a7a24f3e00000000 (host=impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000):
Last report received time: 2025-09-18 18:19:36.505
Fragment Instance Lifecycle Event Timeline: 462.430ms
- Prepare Finished: 523.177us (523.177us)
- Open Finished: 152.888ms (152.364ms)
- First Batch Produced: 152.907ms (19.512us)
- First Batch Sent: 153.672ms (764.719us)
- ExecInternal Finished: 462.430ms (308.758ms)
- MemoryUsage (50.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 7.03 MB, 9.03 MB, 6.02 MB, 6.02 MB, 6.02 MB, 6.02 MB, 6.02 MB
- AverageThreadTokens: 0.00
- BytesAssigned: 0
- CompletionTime: 464.128ms
- ExchangeScanRatio: 0.00
- ExecutionRate: 0.00 /sec
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 9.03 MB (9469952)
- PeakReservation: 6.00 MB (6291456)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 23.19 MB (24312268)
- RowsProduced: 9.99K (9994)
- TotalNetworkReceiveTime: 207.206ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 461.832ms
- TotalThreadsSysTime: 8.225ms
- TotalThreadsUserTime: 29.380ms
- TotalThreadsVoluntaryContextSwitches: 12 (12)
- TotalTime: 461.975ms
Fragment Instance Lifecycle Timings:
- ExecTime: 309.492ms
- ExecTreeExecTime: 88.416ms
- OpenTime: 152.349ms
- ExecTreeOpenTime: 118.955ms
- PrepareTime: 106.754us
- ExecTreePrepareTime: 56.769us
PLAN_ROOT_SINK:
- CreateResultSetTime: 17.063ms
- InactiveTotalTime: 217.482ms
- PeakMemoryUsage: 6.01 MB (6299648)
- RowBatchGetWaitTime: 0.000ns
- RowBatchSendWaitTime: 0.000ns
- RowsSent: 9.99K (9994)
- RowsSentRate: 45.21 K/sec
- TotalTime: 221.059ms
Buffer pool:
- AllocTime: 172.945us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 6.00 MB (6291456)
- CumulativeAllocations: 3 (3)
- EncryptionTime: 0.000ns
- PeakReservation: 6.00 MB (6291456)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 6.00 MB (6291456)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 100.00 MB (104857600)
- SystemAllocTime: 163.545us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=6):
Node Lifecycle Event Timeline: 244.881ms
- Open Started: 33.855ms (33.855ms)
- Open Finished: 152.807ms (118.952ms)
- First Batch Requested: 152.890ms (82.351us)
- First Batch Returned: 152.906ms (16.846us)
- Last Batch Returned: 244.686ms (91.779ms)
- Closed: 244.881ms (195.097us)
- ConvertRowBatchTime: 134.424us
- InactiveTotalTime: 207.178ms
- PeakMemoryUsage: 3.02 MB (3162112)
- RowsReturned: 9.99K (9994)
- RowsReturnedRate: 48.20 K/sec
- TotalTime: 207.363ms
Buffer pool:
- AllocTime: 29.187us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 9.58 MB (10043392)
- CumulativeAllocations: 20 (20)
- EncryptionTime: 0.000ns
- PeakReservation: 3.02 MB (3162112)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 3.02 MB (3162112)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 4.224us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 118.943ms
- TotalBytesDequeued: 5.53 MB (5800024)
- TotalGetBatchTime: 207.200ms
- DataWaitTime: 207.178ms
Enqueue:
- DispatchTime: (Avg: 41.752us ; Min: 33.282us ; Max: 69.691us ; Number of samples: 10)
- DeserializeRowBatchTime: 1.698ms
- TotalBatchesEnqueued: 10 (10)
- TotalBatchesReceived: 10 (10)
- TotalBytesReceived: 5.49 MB (5760048)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
Averaged Fragment F03:(Total: 244.557ms, non-child: 45.633ms, % non-child: 18.66%)
split sizes: min: 1.06 MB, max: 1.06 MB, avg: 1.06 MB, stddev: 0
completion times: min:464.221ms max:464.221ms mean: 464.221ms stddev:0.000ns
execution rates: min:2.29 MB/sec max:2.29 MB/sec mean:2.29 MB/sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 2.00
- BytesAssigned: 1.06 MB (1116591)
- CompletionTime: 464.221ms
- ExchangeScanRatio: 4.00
- ExecutionRate: 2.29 MB/sec
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 14.13 MB (14818986)
- PeakReservation: 6.80 MB (7127040)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 23.19 MB (24312268)
- RowsProduced: 9.99K (9994)
- TotalNetworkReceiveTime: 23.932us
- TotalNetworkSendTime: 2.529ms
- TotalStorageWaitTime: 312.637ms
- TotalThreadsInvoluntaryContextSwitches: 21 (21)
- TotalThreadsTotalWallClockTime: 633.703ms
- TotalThreadsSysTime: 22.075ms
- TotalThreadsUserTime: 62.547ms
- TotalThreadsVoluntaryContextSwitches: 170 (170)
- TotalTime: 244.557ms
Fragment Instance Lifecycle Timings:
- ExecTime: 199.261ms
- ExecTreeExecTime: 190.995ms
- OpenTime: 44.775ms
- ExecTreeOpenTime: 68.628us
- PrepareTime: 493.373us
- ExecTreePrepareTime: 389.414us
KrpcDataStreamSender (dst_id=6):(Total: 7.230ms, non-child: 4.700ms, % non-child: 65.01%)
- NetworkThroughput: (Avg: 1.20 GB/sec ; Min: 908.86 MB/sec ; Max: 1.48 GB/sec ; Number of samples: 10)
- RpcNetworkTime: (Avg: 437.922us ; Min: 208.919us ; Max: 621.879us ; Number of samples: 11)
- RpcRecvrTime: (Avg: 208.306us ; Min: 56.263us ; Max: 622.030us ; Number of samples: 11)
- EosSent: 1 (1)
- InactiveTotalTime: 2.529ms
- PeakMemoryUsage: 2.24 MB (2344537)
- RowsSent: 9.99K (9994)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 4.289ms
- TotalBytesSent: 5.49 MB (5760048)
- TotalTime: 7.230ms
- UncompressedRowBatchSize: 5.53 MB (5800024)
UNION_NODE (id=4):(Total: 191.443ms, non-child: 0.000ns, % non-child: 0.00%)
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 9.99K (9994)
- RowsReturnedRate: 52.20 K/sec
- TotalTime: 191.443ms
HASH_JOIN_NODE (id=2):(Total: 85.633ms, non-child: 6.608ms, % non-child: 7.72%)
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 5.18 MB (5431443)
- ProbeRows: 20.02K (20015)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 2.088ms
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- TotalTime: 85.633ms
Buffer pool:
- AllocTime: 42.484us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 4.50 MB (4718592)
- CumulativeAllocations: 18 (18)
- EncryptionTime: 0.000ns
- PeakReservation: 4.75 MB (4980736)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 4.50 MB (4718592)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 35.313us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=2):(Total: 4.059ms, non-child: 4.059ms, % non-child: 100.00%)
- BuildRows: 20.02K (20015)
- BuildRowsPartitionTime: 2.223ms
- HashTablesBuildTime: 1.406ms
- InactiveTotalTime: 0.000ns
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumHashTableBuildsSkipped: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 34.12 KB (34944)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- TotalTime: 4.059ms
Hash Table:
- HashBuckets: 32.77K (32768)
- HashCollisions: 0 (0)
- Probes: 40.03K (40030)
- Resizes: 0 (0)
- Travel: 0 (0)
EXCHANGE_NODE (id=5):(Total: 225.536us, non-child: 225.536us, % non-child: 100.00%)
- ConvertRowBatchTime: 186.616us
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 4.94 MB (5177344)
- RowsReturned: 20.02K (20015)
- RowsReturnedRate: 88.74 M/sec
- TotalTime: 225.536us
Buffer pool:
- AllocTime: 152.681us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 4.94 MB (5177344)
- CumulativeAllocations: 44 (44)
- EncryptionTime: 0.000ns
- PeakReservation: 4.94 MB (5177344)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 4.94 MB (5177344)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 124.394us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 0.000ns
- TotalBytesDequeued: 2.69 MB (2822106)
- TotalGetBatchTime: 21.240us
- DataWaitTime: 0.000ns
Enqueue:
- DispatchTime: (Avg: 24.667us ; Min: 13.034us ; Max: 56.229us ; Number of samples: 22)
- DeserializeRowBatchTime: 1.997ms
- TotalBatchesEnqueued: 22 (22)
- TotalBatchesReceived: 22 (22)
- TotalBytesReceived: 2.62 MB (2742046)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
HDFS_SCAN_NODE (id=0):(Total: 78.804ms, non-child: 78.804ms, % non-child: 100.00%)
- ColumnarScannerActualReservation: (Avg: 524.00 KB (536576) ; Min: 512.00 KB (524288) ; Max: 536.00 KB (548864) ; Number of samples: 4)
- ColumnarScannerIdealReservation: (Avg: 352.00 KB (360448) ; Min: 168.00 KB (172032) ; Max: 536.00 KB (548864) ; Number of samples: 4)
- FooterProcessingTime: (Avg: 18.061ms ; Min: 10.085ms ; Max: 37.371ms ; Number of samples: 4)
- InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 4)
- InitialRangeIdealReservation: (Avg: 70.00 KB (71680) ; Min: 8.00 KB (8192) ; Max: 128.00 KB (131072) ; Number of samples: 4)
- PageIndexProcessingTime: 0.000ns (Number of samples: 0)
- ParquetCompressedBytesReadPerColumn: (Avg: 17.40 KB (17820) ; Min: 80.00 B (80) ; Max: 33.33 KB (34125) ; Number of samples: 21)
- ParquetCompressedPageSize: (Avg: 4.35 KB (4455) ; Min: 18.00 B (18) ; Max: 16.63 KB (17034) ; Number of samples: 84)
- ParquetUncompressedBytesReadPerColumn: (Avg: 19.09 KB (19546) ; Min: 44.00 B (44) ; Max: 34.27 KB (35097) ; Number of samples: 21)
- ParquetUncompressedPageSize: (Avg: 4.77 KB (4886) ; Min: 9.00 B (9) ; Max: 17.12 KB (17529) ; Number of samples: 84)
- AverageHdfsReadThreadConcurrency: 32.00
- AverageScannerThreadConcurrency: 4.00
- BytesRead: 925.90 KB (948117)
- BytesReadDataNodeCache: 0
- BytesReadEncrypted: 0
- BytesReadErasureCoded: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- CachedFileHandlesHitCount: 83 (83)
- CachedFileHandlesMissCount: 5 (5)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 1.181ms
- InactiveTotalTime: 0.000ns
- IoReadAsyncBytes: 710.16 KB (727205)
- IoReadAsyncRequest: 336 (336)
- IoReadSkippedBytes: 0
- IoReadSyncBytes: 0
- IoReadSyncRequest: 0 (0)
- IoReadTotalBytes: 710.16 KB (727205)
- IoReadTotalRequest: 336 (336)
- MaterializeTupleTime: 4.968ms
- MaxCompressedTextFileLength: 0
- NumBloomFilteredRowGroups: 0 (0)
- NumColumns: 21 (21)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumFileMetadataRead: 0 (0)
- NumPages: 84 (84)
- NumPagesSkippedByLateMaterialization: 0 (0)
- NumRowGroups: 4 (4)
- NumRowGroupsSkippedByUnusefulFilters: 0 (0)
- NumRowGroupsWithPageIndex: 4 (4)
- NumRuntimeFilteredPages: 0 (0)
- NumRuntimeFilteredRowGroups: 0 (0)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 4 (4)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredPages: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 3.58 MB (3757589)
- PeakScannerThreadConcurrency: 4 (4)
- PerReadThreadRawHdfsThroughput: 739.19 KB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 6.37 MB (6680469)
- RowBatchQueueGetWaitTime: 77.083ms
- RowBatchQueuePeakMemoryUsage: 387.89 KB (397203)
- RowBatchQueuePutWaitTime: 0.000ns
- RowBatchesEnqueued: 30 (30)
- RowsRead: 20.02K (20015)
- RowsReturned: 20.02K (20015)
- RowsReturnedRate: 253.98 K/sec
- ScanRangesComplete: 4 (4)
- ScannerIoWaitTime: 224.829ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 11 (11)
- ScannerThreadsTotalWallClockTime: 277.106ms
- ScannerThreadsSysTime: 12.782ms
- ScannerThreadsUserTime: 5.768ms
- ScannerThreadsVoluntaryContextSwitches: 82 (82)
- TotalRawHdfsOpenFileTime: 69.931ms
- TotalRawHdfsReadTime: 1s252ms
- TotalReadThroughput: 1.55 MB/sec
- TotalTime: 78.804ms
Buffer pool:
- AllocTime: 322.013us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 1.65 MB (1728512)
- CumulativeAllocations: 88 (88)
- EncryptionTime: 0.000ns
- PeakReservation: 2.05 MB (2146304)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.38 MB (1441792)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 248.429us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=3):(Total: 106.059ms, non-child: 106.059ms, % non-child: 100.00%)
- ColumnarScannerActualReservation: (Avg: 536.00 KB (548864) ; Min: 536.00 KB (548864) ; Max: 536.00 KB (548864) ; Number of samples: 1)
- ColumnarScannerIdealReservation: (Avg: 536.00 KB (548864) ; Min: 536.00 KB (548864) ; Max: 536.00 KB (548864) ; Number of samples: 1)
- FooterProcessingTime: (Avg: 28.284ms ; Min: 28.284ms ; Max: 28.284ms ; Number of samples: 1)
- InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 1)
- InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1)
- PageIndexProcessingTime: 0.000ns (Number of samples: 0)
- ParquetCompressedBytesReadPerColumn: (Avg: 8.67 KB (8878) ; Min: 22.00 B (22) ; Max: 16.63 KB (17034) ; Number of samples: 21)
- ParquetCompressedPageSize: (Avg: 8.67 KB (8878) ; Min: 22.00 B (22) ; Max: 16.63 KB (17034) ; Number of samples: 21)
- ParquetUncompressedBytesReadPerColumn: (Avg: 9.53 KB (9754) ; Min: 13.00 B (13) ; Max: 17.12 KB (17529) ; Number of samples: 21)
- ParquetUncompressedPageSize: (Avg: 9.53 KB (9754) ; Min: 13.00 B (13) ; Max: 17.12 KB (17529) ; Number of samples: 21)
- AverageHdfsReadThreadConcurrency: 1.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 452.52 KB (463384)
- BytesReadDataNodeCache: 0
- BytesReadEncrypted: 0
- BytesReadErasureCoded: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- CachedFileHandlesHitCount: 21 (21)
- CachedFileHandlesMissCount: 1 (1)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 476.166us
- InactiveTotalTime: 0.000ns
- IoReadAsyncBytes: 352.52 KB (360984)
- IoReadAsyncRequest: 84 (84)
- IoReadSkippedBytes: 0
- IoReadSyncBytes: 0
- IoReadSyncRequest: 0 (0)
- IoReadTotalBytes: 352.52 KB (360984)
- IoReadTotalRequest: 84 (84)
- MaterializeTupleTime: 2.276ms
- MaxCompressedTextFileLength: 0
- NumBloomFilteredRowGroups: 0 (0)
- NumColumns: 21 (21)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumFileMetadataRead: 0 (0)
- NumPages: 21 (21)
- NumPagesSkippedByLateMaterialization: 0 (0)
- NumRowGroups: 1 (1)
- NumRowGroupsSkippedByUnusefulFilters: 0 (0)
- NumRowGroupsWithPageIndex: 1 (1)
- NumRuntimeFilteredPages: 0 (0)
- NumRuntimeFilteredRowGroups: 0 (0)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredPages: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 3.48 MB (3653426)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 1012.82 KB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 2.87 MB (3013484)
- RowBatchQueueGetWaitTime: 105.230ms
- RowBatchQueuePeakMemoryUsage: 2.20 MB (2303852)
- RowBatchQueuePutWaitTime: 0.000ns
- RowBatchesEnqueued: 12 (12)
- RowsRead: 9.99K (9994)
- RowsReturned: 9.99K (9994)
- RowsReturnedRate: 94.23 K/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 87.807ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 8 (8)
- ScannerThreadsTotalWallClockTime: 108.347ms
- ScannerThreadsSysTime: 5.333ms
- ScannerThreadsUserTime: 4.755ms
- ScannerThreadsVoluntaryContextSwitches: 41 (41)
- TotalRawHdfsOpenFileTime: 9.177ms
- TotalRawHdfsReadTime: 446.793ms
- TotalReadThroughput: 2.21 MB/sec
- TotalTime: 106.059ms
Buffer pool:
- AllocTime: 166.549us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 664.00 KB (679936)
- CumulativeAllocations: 22 (22)
- EncryptionTime: 0.000ns
- PeakReservation: 536.00 KB (548864)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 536.00 KB (548864)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 129.401us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment F03:
Instance be4e7100835021e7:a7a24f3e00000002 (host=impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000):
Last report received time: 2025-09-18 18:19:36.505
Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:5/1.06 MB
Fragment Instance Lifecycle Event Timeline: 244.888ms
- Prepare Finished: 742.622us (742.622us)
- Open Finished: 45.521ms (44.778ms)
- First Batch Produced: 151.029ms (105.508ms)
- First Batch Sent: 151.653ms (623.552us)
- ExecInternal Finished: 244.888ms (93.235ms)
- MemoryUsage (50.000ms): 76.75 KB, 1.90 MB, 6.05 MB, 8.35 MB, 8.63 MB
- ThreadUsage (50.000ms): 1, 2, 2, 1, 5
- AverageThreadTokens: 2.20
- BytesAssigned: 1.06 MB (1116591)
- CompletionTime: 464.221ms
- ExchangeScanRatio: 4.08
- ExecutionRate: 2.29 MB/sec
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 14.13 MB (14818986)
- PeakReservation: 6.80 MB (7127040)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 23.19 MB (24312268)
- RowsProduced: 9.99K (9994)
- TotalNetworkReceiveTime: 23.932us
- TotalNetworkSendTime: 2.529ms
- TotalStorageWaitTime: 312.637ms
- TotalThreadsInvoluntaryContextSwitches: 21 (21)
- TotalThreadsTotalWallClockTime: 633.703ms
- TotalThreadsSysTime: 22.075ms
- TotalThreadsUserTime: 62.547ms
- TotalThreadsVoluntaryContextSwitches: 170 (170)
- TotalTime: 244.557ms
Fragment Instance Lifecycle Timings:
- ExecTime: 199.261ms
- ExecTreeExecTime: 190.995ms
- OpenTime: 44.775ms
- ExecTreeOpenTime: 68.628us
- PrepareTime: 493.373us
- ExecTreePrepareTime: 389.414us
KrpcDataStreamSender (dst_id=6):
ExecOption: Unpartitioned Sender Codegen Disabled: not needed
- BytesSent (50.000ms): 0, 0, 0, 3.38 MB, 5.49 MB
- NetworkThroughput: (Avg: 1.20 GB/sec ; Min: 908.86 MB/sec ; Max: 1.48 GB/sec ; Number of samples: 10)
- RpcNetworkTime: (Avg: 437.922us ; Min: 208.919us ; Max: 621.879us ; Number of samples: 11)
- RpcRecvrTime: (Avg: 208.306us ; Min: 56.263us ; Max: 622.030us ; Number of samples: 11)
- EosSent: 1 (1)
- InactiveTotalTime: 2.529ms
- PeakMemoryUsage: 2.24 MB (2344537)
- RowsSent: 9.99K (9994)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 4.289ms
- TotalBytesSent: 5.49 MB (5760048)
- TotalTime: 7.230ms
- UncompressedRowBatchSize: 5.53 MB (5800024)
UNION_NODE (id=4):
ExecOption: Codegen Enabled
Node Lifecycle Event Timeline: 244.481ms
- Open Started: 45.447ms (45.447ms)
- Open Finished: 45.514ms (66.761us)
- First Batch Requested: 45.522ms (8.601us)
- First Batch Returned: 151.026ms (105.504ms)
- Last Batch Returned: 243.998ms (92.971ms)
- Closed: 244.481ms (483.655us)
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 9.99K (9994)
- RowsReturnedRate: 52.20 K/sec
- TotalTime: 191.443ms
HASH_JOIN_NODE (id=2):
ExecOption: Join Build-Side Prepared Asynchronously, Probe Side Codegen Enabled
Node Lifecycle Event Timeline: 244.481ms
- Open Started: 158.657ms (158.657ms)
- Open Finished: 220.712ms (62.054ms)
- First Batch Requested: 220.715ms (3.125us)
- First Batch Returned: 243.995ms (23.279ms)
- Last Batch Returned: 243.995ms (441.000ns)
- Closed: 244.481ms (485.386us)
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 5.18 MB (5431443)
- ProbeRows: 20.02K (20015)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 2.088ms
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- TotalTime: 85.633ms
Buffer pool:
- AllocTime: 42.484us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 4.50 MB (4718592)
- CumulativeAllocations: 18 (18)
- EncryptionTime: 0.000ns
- PeakReservation: 4.75 MB (4980736)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 4.50 MB (4718592)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 35.313us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=2):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRows: 20.02K (20015)
- BuildRowsPartitionTime: 2.223ms
- HashTablesBuildTime: 1.406ms
- InactiveTotalTime: 0.000ns
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumHashTableBuildsSkipped: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 34.12 KB (34944)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- TotalTime: 4.059ms
Hash Table:
- HashBuckets: 32.77K (32768)
- HashCollisions: 0 (0)
- Probes: 40.03K (40030)
- Resizes: 0 (0)
- Travel: 0 (0)
EXCHANGE_NODE (id=5):
Node Lifecycle Event Timeline: 163.010ms
- Open Started: 158.776ms (158.776ms)
- Open Finished: 158.780ms (3.752us)
- First Batch Requested: 159.045ms (265.502us)
- First Batch Returned: 159.060ms (15.288us)
- Last Batch Returned: 161.446ms (2.385ms)
- Closed: 163.010ms (1.563ms)
- ConvertRowBatchTime: 186.616us
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 4.94 MB (5177344)
- RowsReturned: 20.02K (20015)
- RowsReturnedRate: 88.74 M/sec
- TotalTime: 225.536us
Buffer pool:
- AllocTime: 152.681us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 4.94 MB (5177344)
- CumulativeAllocations: 44 (44)
- EncryptionTime: 0.000ns
- PeakReservation: 4.94 MB (5177344)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 4.94 MB (5177344)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 124.394us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 0.000ns
- TotalBytesDequeued: 2.69 MB (2822106)
- TotalGetBatchTime: 21.240us
- DataWaitTime: 0.000ns
Enqueue:
- DispatchTime: (Avg: 24.667us ; Min: 13.034us ; Max: 56.229us ; Number of samples: 22)
- DeserializeRowBatchTime: 1.997ms
- TotalBatchesEnqueued: 22 (22)
- TotalBatchesReceived: 22 (22)
- TotalBytesReceived: 2.62 MB (2742046)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
HDFS_SCAN_NODE (id=0):
Table Name: default.orders
Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/732.15 KB
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:100%
File Formats: PARQUET/ZSTD:4
ExecOption: Codegen enabled: 4 out of 4, PARQUET Codegen Enabled
Node Lifecycle Event Timeline: 244.478ms
- Open Started: 158.820ms (158.820ms)
- Open Finished: 158.897ms (76.960us)
- First Batch Requested: 163.076ms (4.178ms)
- First Batch Returned: 220.708ms (57.632ms)
- Last Batch Returned: 243.857ms (23.148ms)
- Closed: 244.478ms (621.359us)
- BytesReadSeries (50.000ms): 0, 0, 0, 0, 397.15 KB
- ColumnarScannerActualReservation: (Avg: 524.00 KB (536576) ; Min: 512.00 KB (524288) ; Max: 536.00 KB (548864) ; Number of samples: 4)
- ColumnarScannerIdealReservation: (Avg: 352.00 KB (360448) ; Min: 168.00 KB (172032) ; Max: 536.00 KB (548864) ; Number of samples: 4)
- FooterProcessingTime: (Avg: 18.061ms ; Min: 10.085ms ; Max: 37.371ms ; Number of samples: 4)
- InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 4)
- InitialRangeIdealReservation: (Avg: 70.00 KB (71680) ; Min: 8.00 KB (8192) ; Max: 128.00 KB (131072) ; Number of samples: 4)
- PageIndexProcessingTime: 0.000ns (Number of samples: 0)
- ParquetCompressedBytesReadPerColumn: (Avg: 17.40 KB (17820) ; Min: 80.00 B (80) ; Max: 33.33 KB (34125) ; Number of samples: 21)
- ParquetCompressedPageSize: (Avg: 4.35 KB (4455) ; Min: 18.00 B (18) ; Max: 16.63 KB (17034) ; Number of samples: 84)
- ParquetUncompressedBytesReadPerColumn: (Avg: 19.09 KB (19546) ; Min: 44.00 B (44) ; Max: 34.27 KB (35097) ; Number of samples: 21)
- ParquetUncompressedPageSize: (Avg: 4.77 KB (4886) ; Min: 9.00 B (9) ; Max: 17.12 KB (17529) ; Number of samples: 84)
- AverageHdfsReadThreadConcurrency: 32.00
- AverageScannerThreadConcurrency: 4.00
- BytesRead: 925.90 KB (948117)
- BytesReadDataNodeCache: 0
- BytesReadEncrypted: 0
- BytesReadErasureCoded: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- CachedFileHandlesHitCount: 83 (83)
- CachedFileHandlesMissCount: 5 (5)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 1.181ms
- InactiveTotalTime: 0.000ns
- IoReadAsyncBytes: 710.16 KB (727205)
- IoReadAsyncRequest: 336 (336)
- IoReadSkippedBytes: 0
- IoReadSyncBytes: 0
- IoReadSyncRequest: 0 (0)
- IoReadTotalBytes: 710.16 KB (727205)
- IoReadTotalRequest: 336 (336)
- MaterializeTupleTime: 4.968ms
- MaxCompressedTextFileLength: 0
- NumBloomFilteredRowGroups: 0 (0)
- NumColumns: 21 (21)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumFileMetadataRead: 0 (0)
- NumPages: 84 (84)
- NumPagesSkippedByLateMaterialization: 0 (0)
- NumRowGroups: 4 (4)
- NumRowGroupsSkippedByUnusefulFilters: 0 (0)
- NumRowGroupsWithPageIndex: 4 (4)
- NumRuntimeFilteredPages: 0 (0)
- NumRuntimeFilteredRowGroups: 0 (0)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 4 (4)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredPages: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 3.58 MB (3757589)
- PeakScannerThreadConcurrency: 4 (4)
- PerReadThreadRawHdfsThroughput: 739.19 KB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 6.37 MB (6680469)
- RowBatchQueueGetWaitTime: 77.083ms
- RowBatchQueuePeakMemoryUsage: 387.89 KB (397203)
- RowBatchQueuePutWaitTime: 0.000ns
- RowBatchesEnqueued: 30 (30)
- RowsRead: 20.02K (20015)
- RowsReturned: 20.02K (20015)
- RowsReturnedRate: 253.98 K/sec
- ScanRangesComplete: 4 (4)
- ScannerIoWaitTime: 224.829ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 11 (11)
- ScannerThreadsTotalWallClockTime: 277.106ms
- ScannerThreadsSysTime: 12.782ms
- ScannerThreadsUserTime: 5.768ms
- ScannerThreadsVoluntaryContextSwitches: 82 (82)
- TotalRawHdfsOpenFileTime: 69.931ms
- TotalRawHdfsReadTime: 1s252ms
- TotalReadThroughput: 1.55 MB/sec
- TotalTime: 78.804ms
Buffer pool:
- AllocTime: 322.013us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 1.65 MB (1728512)
- CumulativeAllocations: 88 (88)
- EncryptionTime: 0.000ns
- PeakReservation: 2.05 MB (2146304)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.38 MB (1441792)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 248.429us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=3):
Table Name: default.orders
Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/358.27 KB
Hdfs Read Thread Concurrency Bucket: 0:33.33% 1:33.33% 2:33.33% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0%
File Formats: PARQUET/ZSTD:1
ExecOption: Codegen enabled: 1 out of 1, PARQUET Codegen Enabled
Node Lifecycle Event Timeline: 158.655ms
- Open Started: 45.454ms (45.454ms)
- Open Finished: 45.513ms (58.999us)
- First Batch Requested: 45.525ms (11.204us)
- First Batch Returned: 151.023ms (105.498ms)
- Last Batch Returned: 158.611ms (7.587ms)
- Closed: 158.655ms (44.633us)
- BytesReadSeries (50.000ms): 0, 0, 395.29 KB, 452.52 KB
- ColumnarScannerActualReservation: (Avg: 536.00 KB (548864) ; Min: 536.00 KB (548864) ; Max: 536.00 KB (548864) ; Number of samples: 1)
- ColumnarScannerIdealReservation: (Avg: 536.00 KB (548864) ; Min: 536.00 KB (548864) ; Max: 536.00 KB (548864) ; Number of samples: 1)
- FooterProcessingTime: (Avg: 28.284ms ; Min: 28.284ms ; Max: 28.284ms ; Number of samples: 1)
- InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 1)
- InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1)
- PageIndexProcessingTime: 0.000ns (Number of samples: 0)
- ParquetCompressedBytesReadPerColumn: (Avg: 8.67 KB (8878) ; Min: 22.00 B (22) ; Max: 16.63 KB (17034) ; Number of samples: 21)
- ParquetCompressedPageSize: (Avg: 8.67 KB (8878) ; Min: 22.00 B (22) ; Max: 16.63 KB (17034) ; Number of samples: 21)
- ParquetUncompressedBytesReadPerColumn: (Avg: 9.53 KB (9754) ; Min: 13.00 B (13) ; Max: 17.12 KB (17529) ; Number of samples: 21)
- ParquetUncompressedPageSize: (Avg: 9.53 KB (9754) ; Min: 13.00 B (13) ; Max: 17.12 KB (17529) ; Number of samples: 21)
- AverageHdfsReadThreadConcurrency: 1.00
- AverageScannerThreadConcurrency: 0.67
- BytesRead: 452.52 KB (463384)
- BytesReadDataNodeCache: 0
- BytesReadEncrypted: 0
- BytesReadErasureCoded: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- CachedFileHandlesHitCount: 21 (21)
- CachedFileHandlesMissCount: 1 (1)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 476.166us
- InactiveTotalTime: 0.000ns
- IoReadAsyncBytes: 352.52 KB (360984)
- IoReadAsyncRequest: 84 (84)
- IoReadSkippedBytes: 0
- IoReadSyncBytes: 0
- IoReadSyncRequest: 0 (0)
- IoReadTotalBytes: 352.52 KB (360984)
- IoReadTotalRequest: 84 (84)
- MaterializeTupleTime: 2.276ms
- MaxCompressedTextFileLength: 0
- NumBloomFilteredRowGroups: 0 (0)
- NumColumns: 21 (21)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumFileMetadataRead: 0 (0)
- NumPages: 21 (21)
- NumPagesSkippedByLateMaterialization: 0 (0)
- NumRowGroups: 1 (1)
- NumRowGroupsSkippedByUnusefulFilters: 0 (0)
- NumRowGroupsWithPageIndex: 1 (1)
- NumRuntimeFilteredPages: 0 (0)
- NumRuntimeFilteredRowGroups: 0 (0)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredPages: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 3.48 MB (3653426)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 1012.82 KB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 2.87 MB (3013484)
- RowBatchQueueGetWaitTime: 105.230ms
- RowBatchQueuePeakMemoryUsage: 2.20 MB (2303852)
- RowBatchQueuePutWaitTime: 0.000ns
- RowBatchesEnqueued: 12 (12)
- RowsRead: 9.99K (9994)
- RowsReturned: 9.99K (9994)
- RowsReturnedRate: 94.23 K/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 87.807ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 8 (8)
- ScannerThreadsTotalWallClockTime: 108.347ms
- ScannerThreadsSysTime: 5.333ms
- ScannerThreadsUserTime: 4.755ms
- ScannerThreadsVoluntaryContextSwitches: 41 (41)
- TotalRawHdfsOpenFileTime: 9.177ms
- TotalRawHdfsReadTime: 446.793ms
- TotalReadThroughput: 2.21 MB/sec
- TotalTime: 106.059ms
Buffer pool:
- AllocTime: 166.549us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 664.00 KB (679936)
- CumulativeAllocations: 22 (22)
- EncryptionTime: 0.000ns
- PeakReservation: 536.00 KB (548864)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 536.00 KB (548864)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 129.401us
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Averaged Fragment F02:(Total: 60.473ms, non-child: 23.720ms, % non-child: 39.22%)
split sizes: min: 75.81 KB, max: 75.81 KB, avg: 75.81 KB, stddev: 0
completion times: min:464.467ms max:464.467ms mean: 464.467ms stddev:0.000ns
execution rates: min:163.21 KB/sec max:163.21 KB/sec mean:163.21 KB/sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 1.00
- BytesAssigned: 75.81 KB (77625)
- CompletionTime: 464.467ms
- ExchangeScanRatio: 18.00
- ExecutionRate: 163.21 KB/sec
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 1.14 MB (1190567)
- PeakReservation: 272.00 KB (278528)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 23.19 MB (24312268)
- RowsProduced: 20.02K (20015)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 3.610ms
- TotalStorageWaitTime: 95.283ms
- TotalThreadsInvoluntaryContextSwitches: 5 (5)
- TotalThreadsTotalWallClockTime: 173.119ms
- TotalThreadsSysTime: 1.878ms
- TotalThreadsUserTime: 30.317ms
- TotalThreadsVoluntaryContextSwitches: 79 (79)
- TotalTime: 60.473ms
Fragment Instance Lifecycle Timings:
- ExecTime: 36.734ms
- ExecTreeExecTime: 31.257ms
- OpenTime: 23.584ms
- ExecTreeOpenTime: 68.656us
- PrepareTime: 134.175us
- ExecTreePrepareTime: 70.151us
KrpcDataStreamSender (dst_id=5):(Total: 5.313ms, non-child: 1.702ms, % non-child: 32.04%)
- NetworkThroughput: (Avg: 1.00 GB/sec ; Min: 4.83 MB/sec ; Max: 1.41 GB/sec ; Number of samples: 22)
- RpcNetworkTime: (Avg: 126.097us ; Min: 65.244us ; Max: 247.214us ; Number of samples: 23)
- RpcRecvrTime: (Avg: 113.576us ; Min: 21.344us ; Max: 162.286us ; Number of samples: 23)
- EosSent: 1 (1)
- InactiveTotalTime: 3.610ms
- PeakMemoryUsage: 274.43 KB (281021)
- RowsSent: 20.02K (20015)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 1.334ms
- TotalBytesSent: 2.62 MB (2742046)
- TotalTime: 5.313ms
- UncompressedRowBatchSize: 2.69 MB (2822106)
HDFS_SCAN_NODE (id=1):(Total: 31.439ms, non-child: 31.439ms, % non-child: 100.00%)
- ColumnarScannerActualReservation: (Avg: 68.00 KB (69632) ; Min: 64.00 KB (65536) ; Max: 72.00 KB (73728) ; Number of samples: 4)
- ColumnarScannerIdealReservation: (Avg: 44.00 KB (45056) ; Min: 16.00 KB (16384) ; Max: 72.00 KB (73728) ; Number of samples: 4)
- FooterProcessingTime: (Avg: 12.680ms ; Min: 11.130ms ; Max: 14.435ms ; Number of samples: 4)
- InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4)
- InitialRangeIdealReservation: (Avg: 36.00 KB (36864) ; Min: 8.00 KB (8192) ; Max: 64.00 KB (65536) ; Number of samples: 4)
- PageIndexProcessingTime: 0.000ns (Number of samples: 0)
- ParquetCompressedBytesReadPerColumn: (Avg: 16.70 KB (17102) ; Min: 84.00 B (84) ; Max: 33.32 KB (34120) ; Number of samples: 2)
- ParquetCompressedPageSize: (Avg: 4.17 KB (4275) ; Min: 18.00 B (18) ; Max: 16.63 KB (17034) ; Number of samples: 8)
- ParquetUncompressedBytesReadPerColumn: (Avg: 17.16 KB (17572) ; Min: 48.00 B (48) ; Max: 34.27 KB (35097) ; Number of samples: 2)
- ParquetUncompressedPageSize: (Avg: 4.29 KB (4393) ; Min: 9.00 B (9) ; Max: 17.12 KB (17529) ; Number of samples: 8)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 147.18 KB (150716)
- BytesReadDataNodeCache: 0
- BytesReadEncrypted: 0
- BytesReadErasureCoded: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- CachedFileHandlesHitCount: 12 (12)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 94.026us
- InactiveTotalTime: 0.000ns
- IoReadAsyncBytes: 71.38 KB (73091)
- IoReadAsyncRequest: 32 (32)
- IoReadSkippedBytes: 0
- IoReadSyncBytes: 0
- IoReadSyncRequest: 0 (0)
- IoReadTotalBytes: 71.38 KB (73091)
- IoReadTotalRequest: 32 (32)
- MaterializeTupleTime: 494.376us
- MaxCompressedTextFileLength: 0
- NumBloomFilteredRowGroups: 0 (0)
- NumColumns: 2 (2)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumFileMetadataRead: 0 (0)
- NumPages: 8 (8)
- NumPagesSkippedByLateMaterialization: 0 (0)
- NumRowGroups: 4 (4)
- NumRowGroupsSkippedByUnusefulFilters: 0 (0)
- NumRowGroupsWithPageIndex: 4 (4)
- NumRuntimeFilteredPages: 0 (0)
- NumRuntimeFilteredRowGroups: 0 (0)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 4 (4)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredPages: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 859.23 KB (879850)
- PeakScannerThreadConcurrency: 4 (4)
- PerReadThreadRawHdfsThroughput: 1.04 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 510.00 KB (522240)
- RowBatchQueueGetWaitTime: 30.105ms
- RowBatchQueuePeakMemoryUsage: 578.00 KB (591872)
- RowBatchQueuePutWaitTime: 0.000ns
- RowBatchesEnqueued: 30 (30)
- RowsRead: 20.02K (20015)
- RowsReturned: 20.02K (20015)
- RowsReturnedRate: 636.61 K/sec
- ScanRangesComplete: 4 (4)
- ScannerIoWaitTime: 95.283ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 5 (5)
- ScannerThreadsTotalWallClockTime: 112.818ms
- ScannerThreadsSysTime: 1.878ms
- ScannerThreadsUserTime: 3.390ms
- ScannerThreadsVoluntaryContextSwitches: 47 (47)
- TotalRawHdfsOpenFileTime: 38.431us
- TotalRawHdfsReadTime: 138.459ms
- TotalReadThroughput: 1.44 MB/sec
- TotalTime: 31.439ms
Buffer pool:
- AllocTime: 28.890us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 320.00 KB (327680)
- CumulativeAllocations: 12 (12)
- EncryptionTime: 0.000ns
- PeakReservation: 272.00 KB (278528)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 176.00 KB (180224)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment F02:
Instance be4e7100835021e7:a7a24f3e00000001 (host=impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000):
Last report received time: 2025-09-18 18:19:36.505
Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/75.81 KB
Fragment Instance Lifecycle Event Timeline: 60.611ms
- Prepare Finished: 280.922us (280.922us)
- Open Finished: 23.865ms (23.584ms)
- First Batch Produced: 49.705ms (25.840ms)
- First Batch Sent: 49.768ms (63.025us)
- ExecInternal Finished: 60.611ms (10.843ms)
- MemoryUsage (50.000ms): 14.09 KB, 827.10 KB
- ThreadUsage (50.000ms): 1, 1
- AverageThreadTokens: 1.00
- BytesAssigned: 75.81 KB (77625)
- CompletionTime: 464.467ms
- ExchangeScanRatio: 18.19
- ExecutionRate: 163.21 KB/sec
- InactiveTotalTime: 0.000ns
- PeakMemoryUsage: 1.14 MB (1190567)
- PeakReservation: 272.00 KB (278528)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 23.19 MB (24312268)
- RowsProduced: 20.02K (20015)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 3.610ms
- TotalStorageWaitTime: 95.283ms
- TotalThreadsInvoluntaryContextSwitches: 5 (5)
- TotalThreadsTotalWallClockTime: 173.119ms
- TotalThreadsSysTime: 1.878ms
- TotalThreadsUserTime: 30.317ms
- TotalThreadsVoluntaryContextSwitches: 79 (79)
- TotalTime: 60.473ms
Fragment Instance Lifecycle Timings:
- ExecTime: 36.734ms
- ExecTreeExecTime: 31.257ms
- OpenTime: 23.584ms
- ExecTreeOpenTime: 68.656us
- PrepareTime: 134.175us
- ExecTreePrepareTime: 70.151us
KrpcDataStreamSender (dst_id=5):
ExecOption: Unpartitioned Sender Codegen Disabled: not needed
- BytesSent (50.000ms): 0, 551.61 KB
- NetworkThroughput: (Avg: 1.00 GB/sec ; Min: 4.83 MB/sec ; Max: 1.41 GB/sec ; Number of samples: 22)
- RpcNetworkTime: (Avg: 126.097us ; Min: 65.244us ; Max: 247.214us ; Number of samples: 23)
- RpcRecvrTime: (Avg: 113.576us ; Min: 21.344us ; Max: 162.286us ; Number of samples: 23)
- EosSent: 1 (1)
- InactiveTotalTime: 3.610ms
- PeakMemoryUsage: 274.43 KB (281021)
- RowsSent: 20.02K (20015)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 1.334ms
- TotalBytesSent: 2.62 MB (2742046)
- TotalTime: 5.313ms
- UncompressedRowBatchSize: 2.69 MB (2822106)
HDFS_SCAN_NODE (id=1):
Table Name: default.orders
Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/75.81 KB
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0%
File Formats: PARQUET/ZSTD:4
ExecOption: Codegen enabled: 4 out of 4, PARQUET Codegen Enabled
Node Lifecycle Event Timeline: 60.422ms
- Open Started: 23.791ms (23.791ms)
- Open Finished: 23.858ms (67.036us)
- First Batch Requested: 23.866ms (7.993us)
- First Batch Returned: 49.703ms (25.836ms)
- Last Batch Returned: 60.390ms (10.687ms)
- Closed: 60.422ms (32.229us)
- BytesReadSeries (50.000ms): 0, 147.18 KB
- ColumnarScannerActualReservation: (Avg: 68.00 KB (69632) ; Min: 64.00 KB (65536) ; Max: 72.00 KB (73728) ; Number of samples: 4)
- ColumnarScannerIdealReservation: (Avg: 44.00 KB (45056) ; Min: 16.00 KB (16384) ; Max: 72.00 KB (73728) ; Number of samples: 4)
- FooterProcessingTime: (Avg: 12.680ms ; Min: 11.130ms ; Max: 14.435ms ; Number of samples: 4)
- InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4)
- InitialRangeIdealReservation: (Avg: 36.00 KB (36864) ; Min: 8.00 KB (8192) ; Max: 64.00 KB (65536) ; Number of samples: 4)
- PageIndexProcessingTime: 0.000ns (Number of samples: 0)
- ParquetCompressedBytesReadPerColumn: (Avg: 16.70 KB (17102) ; Min: 84.00 B (84) ; Max: 33.32 KB (34120) ; Number of samples: 2)
- ParquetCompressedPageSize: (Avg: 4.17 KB (4275) ; Min: 18.00 B (18) ; Max: 16.63 KB (17034) ; Number of samples: 8)
- ParquetUncompressedBytesReadPerColumn: (Avg: 17.16 KB (17572) ; Min: 48.00 B (48) ; Max: 34.27 KB (35097) ; Number of samples: 2)
- ParquetUncompressedPageSize: (Avg: 4.29 KB (4393) ; Min: 9.00 B (9) ; Max: 17.12 KB (17529) ; Number of samples: 8)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 147.18 KB (150716)
- BytesReadDataNodeCache: 0
- BytesReadEncrypted: 0
- BytesReadErasureCoded: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- CachedFileHandlesHitCount: 12 (12)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 94.026us
- InactiveTotalTime: 0.000ns
- IoReadAsyncBytes: 71.38 KB (73091)
- IoReadAsyncRequest: 32 (32)
- IoReadSkippedBytes: 0
- IoReadSyncBytes: 0
- IoReadSyncRequest: 0 (0)
- IoReadTotalBytes: 71.38 KB (73091)
- IoReadTotalRequest: 32 (32)
- MaterializeTupleTime: 494.376us
- MaxCompressedTextFileLength: 0
- NumBloomFilteredRowGroups: 0 (0)
- NumColumns: 2 (2)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumFileMetadataRead: 0 (0)
- NumPages: 8 (8)
- NumPagesSkippedByLateMaterialization: 0 (0)
- NumRowGroups: 4 (4)
- NumRowGroupsSkippedByUnusefulFilters: 0 (0)
- NumRowGroupsWithPageIndex: 4 (4)
- NumRuntimeFilteredPages: 0 (0)
- NumRuntimeFilteredRowGroups: 0 (0)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 4 (4)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredPages: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 859.23 KB (879850)
- PeakScannerThreadConcurrency: 4 (4)
- PerReadThreadRawHdfsThroughput: 1.04 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 510.00 KB (522240)
- RowBatchQueueGetWaitTime: 30.105ms
- RowBatchQueuePeakMemoryUsage: 578.00 KB (591872)
- RowBatchQueuePutWaitTime: 0.000ns
- RowBatchesEnqueued: 30 (30)
- RowsRead: 20.02K (20015)
- RowsReturned: 20.02K (20015)
- RowsReturnedRate: 636.61 K/sec
- ScanRangesComplete: 4 (4)
- ScannerIoWaitTime: 95.283ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 5 (5)
- ScannerThreadsTotalWallClockTime: 112.818ms
- ScannerThreadsSysTime: 1.878ms
- ScannerThreadsUserTime: 3.390ms
- ScannerThreadsVoluntaryContextSwitches: 47 (47)
- TotalRawHdfsOpenFileTime: 38.431us
- TotalRawHdfsReadTime: 138.459ms
- TotalReadThroughput: 1.44 MB/sec
- TotalTime: 31.439ms
Buffer pool:
- AllocTime: 28.890us
- CompressionTime: 0.000ns
- CumulativeAllocationBytes: 320.00 KB (327680)
- CumulativeAllocations: 12 (12)
- EncryptionTime: 0.000ns
- PeakReservation: 272.00 KB (278528)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 176.00 KB (180224)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns