Query ff41f38805a70ab0:149ceded00000000
Query (id=ff41f38805a70ab0:149ceded00000000):
Summary:
Session ID: 1d43317a85ca12de:8e8ff65b51ae08ae
Session Type: HIVESERVER2
HiveServer2 Protocol Version: V6
Start Time: 2025-09-18 18:19:29.726859000
End Time: 2025-09-18 18:19:30.056443000
Duration: 329.584ms (329584 us)
Query Type: QUERY
Query State: FINISHED
Impala Query State: FINISHED
Query Status: OK
Impala Version: impalad version 4.4.1-RELEASE RELEASE (build ced4193fbfdc9b5635407157c0f18ce00480327c)
User: psantos
Connected User: psantos
Delegated User:
Network Address: 172.19.147.17:36776
Default Db: default
Sql Statement: SELECT `C_64656661756c745f6f7264657273`.`rowid` AS `C_0`, `C_64656661756c745f6f7264657273`.`orderid` AS `C_14`, `C_64656661756c745f6f7264657273`.`orderdate` AS `C_9`, `C_64656661756c745f6f7264657273`.`shipdate` AS `C_3`, `C_64656661756c745f6f7264657273`.`shipmode` AS `C_1`, `C_64656661756c745f6f7264657273`.`customerid` AS `C_43`, `C_64656661756c745f6f7264657273`.`customername` AS `C_5`, `C_64656661756c745f6f7264657273`.`segment` AS `C_13`, `C_64656661756c745f6f7264657273`.`country` AS `C_11`, `C_64656661756c745f6f7264657273`.`city` AS `C_2`, `C_64656661756c745f6f7264657273`.`state` AS `C_10`, `C_64656661756c745f6f7264657273`.`postalcode` AS `C_6`, `C_64656661756c745f6f7264657273`.`region` AS `C_4`, `C_64656661756c745f6f7264657273`.`productid` AS `C_12`, `C_64656661756c745f6f7264657273`.`category` AS `C_15`, `C_64656661756c745f6f7264657273`.`subcategory` AS `C_18`, `C_64656661756c745f6f7264657273`.`productname` AS `C_7`, `C_64656661756c745f6f7264657273`.`sales` AS `C_16`, `C_64656661756c745f6f7264657273`.`quantity` AS `C_17`, `C_64656661756c745f6f7264657273`.`discount` AS `C_19`, `C_64656661756c745f6f7264657273`.`profit` AS `C_8` FROM `default`.`orders` `C_64656661756c745f6f7264657273`
Coordinator: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000
Query Options (set by configuration): COMPRESSION_CODEC=TCompressionCodec(codec=ZSTD, compression_level=3),DEFAULT_JOIN_DISTRIBUTION_MODE=SHUFFLE,TIMEZONE=Europe/Moscow,DEFAULT_FILE_FORMAT=PARQUET,DEFAULT_HINTS_INSERT_STATEMENT=NOCLUSTERED,FETCH_ROWS_TIMEOUT_MS=0,ENABLE_OUTER_JOIN_TO_INNER_TRANSFORMATION=1,UTF8_MODE=1
Query Options (set by configuration and planner): COMPRESSION_CODEC=TCompressionCodec(codec=ZSTD, compression_level=3),MT_DOP=0,DEFAULT_JOIN_DISTRIBUTION_MODE=SHUFFLE,TIMEZONE=Europe/Moscow,DEFAULT_FILE_FORMAT=PARQUET,DEFAULT_HINTS_INSERT_STATEMENT=NOCLUSTERED,FETCH_ROWS_TIMEOUT_MS=0,ENABLE_OUTER_JOIN_TO_INNER_TRANSFORMATION=1,UTF8_MODE=1,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE
Tables Queried: default.orders
Plan:
----------------
Max Per-Host Resource Reservation: Memory=9.31MB Threads=5
Per-Host Resource Estimates: Memory=184MB
WARNING: The following tables are missing relevant table and/or column statistics.
default.orders
Analyzed query: SELECT C_64656661756c745f6f7264657273.rowid C_0,
C_64656661756c745f6f7264657273.orderid C_14,
C_64656661756c745f6f7264657273.orderdate C_9,
C_64656661756c745f6f7264657273.shipdate C_3,
C_64656661756c745f6f7264657273.shipmode C_1,
C_64656661756c745f6f7264657273.customerid C_43,
C_64656661756c745f6f7264657273.customername C_5,
C_64656661756c745f6f7264657273.segment C_13,
C_64656661756c745f6f7264657273.country C_11, C_64656661756c745f6f7264657273.city
C_2, C_64656661756c745f6f7264657273.state C_10,
C_64656661756c745f6f7264657273.postalcode C_6,
C_64656661756c745f6f7264657273.region C_4,
C_64656661756c745f6f7264657273.productid C_12,
C_64656661756c745f6f7264657273.category C_15,
C_64656661756c745f6f7264657273.subcategory C_18,
C_64656661756c745f6f7264657273.productname C_7,
C_64656661756c745f6f7264657273.sales C_16,
C_64656661756c745f6f7264657273.quantity C_17,
C_64656661756c745f6f7264657273.discount C_19,
C_64656661756c745f6f7264657273.profit C_8 FROM `default`.orders
c_64656661756c745f6f7264657273
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Host Resources: mem-estimate=14.67MB mem-reservation=4.00MB thread-reservation=1
PLAN-ROOT SINK
| output exprs: C_64656661756c745f6f7264657273.rowid, C_64656661756c745f6f7264657273.orderid, C_64656661756c745f6f7264657273.orderdate, C_64656661756c745f6f7264657273.shipdate, C_64656661756c745f6f7264657273.shipmode, C_64656661756c745f6f7264657273.customerid, C_64656661756c745f6f7264657273.customername, C_64656661756c745f6f7264657273.segment, C_64656661756c745f6f7264657273.country, C_64656661756c745f6f7264657273.city, C_64656661756c745f6f7264657273.state, C_64656661756c745f6f7264657273.postalcode, C_64656661756c745f6f7264657273.region, C_64656661756c745f6f7264657273.productid, C_64656661756c745f6f7264657273.category, C_64656661756c745f6f7264657273.subcategory, C_64656661756c745f6f7264657273.productname, C_64656661756c745f6f7264657273.sales, C_64656661756c745f6f7264657273.quantity, C_64656661756c745f6f7264657273.discount, C_64656661756c745f6f7264657273.profit
| mem-estimate=7.21MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
06:EXCHANGE [UNPARTITIONED]
| mem-estimate=7.46MB mem-reservation=0B thread-reservation=0
| tuple-ids=0 row-size=252B cardinality=30.01K
| in pipelines: 03(GETNEXT), 00(GETNEXT)
|
F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
Per-Host Resources: mem-estimate=136.40MB mem-reservation=5.25MB thread-reservation=2
04:UNION
| pass-through-operands: all
| mem-estimate=0B mem-reservation=0B thread-reservation=0
| tuple-ids=0 row-size=252B cardinality=30.01K
| in pipelines: 03(GETNEXT), 00(GETNEXT)
|
|--02:DELETE EVENTS HASH JOIN [LEFT ANTI JOIN, BROADCAST]
| | hash predicates: c_64656661756c745f6f7264657273.file__position = c_64656661756c745f6f7264657273-position-delete.pos, c_64656661756c745f6f7264657273.input__file__name = c_64656661756c745f6f7264657273-position-delete.file_path
| | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
| | tuple-ids=0 row-size=252B cardinality=20.02K
| | in pipelines: 00(GETNEXT), 01(OPEN)
| |
| |--05:EXCHANGE [BROADCAST]
| | | mem-estimate=2.65MB mem-reservation=0B thread-reservation=0
| | | tuple-ids=1 row-size=132B cardinality=20.02K
| | | in pipelines: 01(GETNEXT)
| | |
| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Host Resources: mem-estimate=32.53MB mem-reservation=64.00KB thread-reservation=2
| | 01:SCAN S3 [default.orders-POSITION-DELETE-01 c_64656661756c745f6f7264657273-position-delete, RANDOM]
| | S3 partitions=1/1 files=4 size=75.81KB
| | Iceberg snapshot id: 8925916327827828503
| | stored statistics:
| | table: rows=20.02K size=75.81KB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=9.65K
| | mem-estimate=32.00MB mem-reservation=64.00KB thread-reservation=1
| | tuple-ids=1 row-size=132B cardinality=20.02K
| | in pipelines: 01(GETNEXT)
| |
| 00:SCAN S3 [default.orders c_64656661756c745f6f7264657273, RANDOM]
| S3 partitions=1/1 files=4 size=732.15KB
| Iceberg snapshot id: 8925916327827828503
| stored statistics:
| table: rows=30.01K size=1.14MB
| columns missing stats: rowid, orderid, orderdate, shipdate, shipmode, customerid, customername, segment, country, city, state, postalcode, region, productid, category, subcategory, productname, sales, quantity, discount, profit
| extrapolated-rows=disabled max-scan-range-rows=14.68K
| mem-estimate=128.00MB mem-reservation=512.00KB thread-reservation=1
| tuple-ids=0 row-size=252B cardinality=20.02K
| in pipelines: 00(GETNEXT)
|
03:SCAN S3 [default.orders c_64656661756c745f6f7264657273, RANDOM]
S3 partitions=1/1 files=1 size=358.27KB
Iceberg snapshot id: 8925916327827828503
stored statistics:
table: rows=30.01K size=1.14MB
columns missing stats: rowid, orderid, orderdate, shipdate, shipmode, customerid, customername, segment, country, city, state, postalcode, region, productid, category, subcategory, productname, sales, quantity, discount, profit
extrapolated-rows=disabled max-scan-range-rows=30.01K
mem-estimate=128.00MB mem-reservation=512.00KB thread-reservation=1
tuple-ids=0 row-size=252B cardinality=9.99K
in pipelines: 03(GETNEXT)
----------------
Estimated Per-Host Mem: 192526452
Tables Missing Stats: default.orders
Request Pool: root.default
Per Host Min Memory Reservation: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(9.31 MB)
Per Host Number of Fragment Instances: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(3)
Admission result: Admitted immediately
Cluster Memory Admitted: 183.61 MB
Executor Group: default
Number of running queries in designated executor group when admitted: 1
ExecSummary:
Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
F04:ROOT 1 1 0.000ns 0.000ns 0 7.21 MB
06:EXCHANGE 1 1 0.000ns 0.000ns 0 30.01K 0 7.46 MB UNPARTITIONED
F03:EXCHANGE SENDER 1 1 0.000ns 0.000ns 0 1.00 MB
04:UNION 1 1 0.000ns 0.000ns 0 30.01K 0 0
|--02:DELETE EVENTS HASH JOIN 1 1 0.000ns 0.000ns 0 20.02K 0 4.75 MB LEFT ANTI JOIN, BROADCAST
| |--05:EXCHANGE 1 1 0.000ns 0.000ns 0 20.02K 0 2.65 MB BROADCAST
| | F02:EXCHANGE SENDER 1 1 0.000ns 0.000ns 0 544.00 KB
| | 01:SCAN S3 1 1 0.000ns 0.000ns 0 20.02K 0 32.00 MB default.orders-POSITION-DELETE-01 c_64656661756c745f6f7264657273-position-delete
| 00:SCAN S3 1 1 0.000ns 0.000ns 0 20.02K 0 128.00 MB default.orders c_64656661756c745f6f7264657273
03:SCAN S3 1 1 0.000ns 0.000ns 0 9.99K 0 128.00 MB default.orders c_64656661756c745f6f7264657273
Errors:
Query Compilation: 4.793ms
- Metadata of all 1 tables cached: 1.349ms (1.349ms)
- Analysis finished: 1.880ms (530.573us)
- Authorization finished (noop): 2.055ms (174.877us)
- Value transfer graph computed: 2.163ms (107.985us)
- Single node plan created: 2.827ms (664.697us)
- Runtime filters computed: 2.929ms (101.159us)
- Distributed plan created: 2.952ms (23.713us)
- Lineage info computed: 3.040ms (87.860us)
- Planning finished: 4.793ms (1.753ms)
Query Timeline: 329.695ms
- Query submitted: 45.155us (45.155us)
- Planning finished: 5.822ms (5.777ms)
- Submit for admission: 6.072ms (250.297us)
- Completed admission: 16.143ms (10.071ms)
- Ready to start on 1 backends: 16.271ms (128.030us)
- All 1 execution backends (3 fragment instances) started: 17.666ms (1.394ms)
- Rows available: 210.374ms (192.708ms)
- First row fetched: 276.161ms (65.786ms)
- Execution cancelled: 329.186ms (53.025ms)
- Released admission control resources: 329.581ms (394.959us)
- Unregister query: 329.695ms (114.681us)
- AdmissionControlTimeSinceLastUpdate: 50.000ms
- ComputeScanRangeAssignmentTimer: 62.002us
Memory Reserve:
Frontend:
Referenced Tables: default.orders
Expr memory estimated bytes: 3150
- CatalogFetch.ColumnStats.Hits: 42
- CatalogFetch.ColumnStats.Misses: 0
- CatalogFetch.ColumnStats.Requests: 42
- CatalogFetch.ColumnStats.Time: 0
- CatalogFetch.Config.Hits: 1
- CatalogFetch.Config.Misses: 0
- CatalogFetch.Config.Requests: 1
- CatalogFetch.Config.Time: 0
- CatalogFetch.DatabaseList.Hits: 1
- CatalogFetch.DatabaseList.Misses: 0
- CatalogFetch.DatabaseList.Requests: 1
- CatalogFetch.DatabaseList.Time: 0
- CatalogFetch.PartitionLists.Hits: 1
- CatalogFetch.PartitionLists.Misses: 0
- CatalogFetch.PartitionLists.Requests: 1
- CatalogFetch.PartitionLists.Time: 0
- CatalogFetch.Partitions.Hits: 6
- CatalogFetch.Partitions.Misses: 0
- CatalogFetch.Partitions.Requests: 6
- CatalogFetch.Partitions.Time: 0
- CatalogFetch.TableList.Hits: 1
- CatalogFetch.TableList.Misses: 0
- CatalogFetch.TableList.Requests: 1
- CatalogFetch.TableList.Time: 0
- CatalogFetch.Tables.Hits: 3
- CatalogFetch.Tables.Misses: 0
- CatalogFetch.Tables.Requests: 3
- CatalogFetch.Tables.Time: 0
- ExecutorGroupsConsidered: 1 (1)
Executor group 1:
Verdict: Match
- MemoryAsk: 183.61 MB (192526452)
- MemoryMax: 8589934592.00 GB (9223372036854775807)
ImpalaServer:
- ClientFetchWaitTimeStats: (Avg: 37.747ms ; Min: 23.570ms ; Max: 62.682ms ; Number of samples: 3)
- GetInFlightProfileTimeStats: 0.000ns (Number of samples: 0)
- ClientFetchLockWaitTimer: 427.000ns
- ClientFetchWaitTimer: 113.241ms
- NumRowsFetched: 2.05K (2048)
- NumRowsFetchedFromCache: 0 (0)
- RPCCount: 11 (11)
- RPCReadTimer: 27.000us
- RPCWriteTimer: 8.517ms
- RowMaterializationRate: 337.46 K/sec
- RowMaterializationTimer: 6.068ms
Execution Profile ff41f38805a70ab0:149ceded00000000:
Number of filters: 0
Filter routing table:
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value In-list size
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Backend startup latencies: Count: 1, sum: 1ms, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms
Slowest backend to start up: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000
Per Node Peak Memory Usage: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(0)
Per Node Bytes Read: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(0)
Per Node User Time: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(0.000ns)
Per Node System Time: impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000(0.000ns)
- ExchangeScanRatio: 0.00
- FiltersReceived: 0 (0)
- FinalizationTimer: 0.000ns
- InnerNodeSelectivityRatio: 0.00
- NumBackends: 1 (1)
- NumCompletedBackends: 0 (0)
- NumFragmentInstances: 3 (3)
- NumFragments: 3 (3)
- TotalBytesRead: 0
- TotalBytesSent: 0
- TotalCpuTime: 0.000ns
- TotalInnerBytesSent: 0
- TotalScanBytesSent: 0
Per Node Profiles:
impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000:
- AdmissionSlots: 1 (1)
Averaged Fragment F04:
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:311.976ms max:311.976ms mean: 311.976ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- InactiveTotalTime: 0.000ns
- TotalTime: 0.000ns
Coordinator Fragment F04:
Instance ff41f38805a70ab0:149ceded00000000 (host=impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000):
Last report received time: 2025-09-18 18:19:29.743
- BytesAssigned: 0
- CompletionTime: 311.976ms
- ExecutionRate: 0.00 /sec
- InactiveTotalTime: 0.000ns
- TotalTime: 0.000ns
Averaged Fragment F03:
split sizes: min: 1.06 MB, max: 1.06 MB, avg: 1.06 MB, stddev: 0
completion times: min:311.974ms max:311.974ms mean: 311.974ms stddev:0.000ns
execution rates: min:3.41 MB/sec max:3.41 MB/sec mean:3.41 MB/sec stddev:0.00 /sec
num instances: 1
- InactiveTotalTime: 0.000ns
- TotalTime: 0.000ns
Fragment F03:
Instance ff41f38805a70ab0:149ceded00000002 (host=impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000):
Last report received time: 2025-09-18 18:19:29.743
- BytesAssigned: 1.06 MB (1116591)
- CompletionTime: 311.974ms
- ExecutionRate: 3.41 MB/sec
- InactiveTotalTime: 0.000ns
- TotalTime: 0.000ns
Averaged Fragment F02:
split sizes: min: 75.81 KB, max: 75.81 KB, avg: 75.81 KB, stddev: 0
completion times: min:311.967ms max:311.967ms mean: 311.967ms stddev:0.000ns
execution rates: min:242.99 KB/sec max:242.99 KB/sec mean:242.99 KB/sec stddev:0.00 /sec
num instances: 1
- InactiveTotalTime: 0.000ns
- TotalTime: 0.000ns
Fragment F02:
Instance ff41f38805a70ab0:149ceded00000001 (host=impala-0.impala-sv.impala-flight-sql.svc.cluster.local:27000):
Last report received time: 2025-09-18 18:19:29.743
- BytesAssigned: 75.81 KB (77625)
- CompletionTime: 311.967ms
- ExecutionRate: 242.99 KB/sec
- InactiveTotalTime: 0.000ns
- TotalTime: 0.000ns