Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

no rows in Trino when pyspark xtable source from delta and write into Hudi and Iceberg with S3 + HMS #460

Open
3 of 4 tasks
alberttwong opened this issue Jun 4, 2024 · 17 comments
Labels
bug Something isn't working

Comments

@alberttwong
Copy link
Contributor

alberttwong commented Jun 4, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

Please describe the bug 🐞

I wrote 6 rows into delta on s3 and then used xtable to covert the data to iceberg and hudi. Next I used run_sync_tool.sh to register the hudi files in HMS and then query it into Trino. No data in Trino.

I don't see any errors.


xtable looks good

2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[00000000000000011__deltacommit__COMPLETED__20240604232709963]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieBackedTableMetadataWriter:451 - Initializing COLUMN_STATS index in metadata table took 145 in ms
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieTableMetadataUtil:395 - Updating at 20240604232400230 from Commit/null. #partitions_updated=6, #files_added=6
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieTableMetadataUtil:942 - Loading latest file slices for metadata table partition column_stats
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:429 - Building file system view for partition (column_stats)
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieTableMetadataUtil:942 - Loading latest file slices for metadata table partition files
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:429 - Building file system view for partition (files)
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:155 - Loading Active commit timeline for s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[00000000000000011__deltacommit__COMPLETED__20240604232709963]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:243 - Creating View Manager with storage type :MEMORY
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:255 - Creating in-memory based Table View
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieBackedTableMetadataWriter:1103 - New commit at 20240604232400230 being applied to MDT.
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:155 - Loading Active commit timeline for s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[00000000000000011__deltacommit__COMPLETED__20240604232709963]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.CleanerUtils:221 - Cleaned failed attempts if any
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:155 - Loading Active commit timeline for s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[00000000000000011__deltacommit__COMPLETED__20240604232709963]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:243 - Creating View Manager with storage type :MEMORY
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:255 - Creating in-memory based Table View
2024-06-04 23:27:10 INFO  org.apache.hudi.client.BaseHoodieWriteClient:945 - Generate a new instant time: 20240604232400230 action: deltacommit
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:202 - Creating a new instant [==>20240604232400230__deltacommit__REQUESTED]
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:615 - Checking for file exists ?s3a://warehouse/people/.hoodie/metadata/.hoodie/20240604232400230.deltacommit.requested
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:623 - Create new file for toInstant ?s3a://warehouse/people/.hoodie/metadata/.hoodie/20240604232400230.deltacommit.inflight
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:155 - Loading Active commit timeline for s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[==>20240604232400230__deltacommit__INFLIGHT__20240604232710097]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:243 - Creating View Manager with storage type :MEMORY
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:255 - Creating in-memory based Table View
2024-06-04 23:27:10 INFO  org.apache.hudi.async.AsyncCleanerService:63 - The HoodieWriteClient is not configured to auto & async clean. Async clean service will not start.
2024-06-04 23:27:10 INFO  org.apache.hudi.async.AsyncArchiveService:61 - The HoodieWriteClient is not configured to auto & async archive. Async archive service will not start.
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.deltacommit.JavaUpsertPreppedDeltaCommitActionExecutor:74 - Total update fileIDs 3, total inserts 0 for commit 20240604232400230
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:165 - Creating InMemory based view for basePath s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:429 - Building file system view for partition (files)
# WARNING: Unable to get Instrumentation. Dynamic Attach failed. You may add this JAR as -javaagent manually, or supply -Djdk.attach.allowAttachSelf
# WARNING: Unable to attach Serviceability Agent. Unable to attach even with module exceptions: [org.openjdk.jol.vm.sa.SASupportException: Sense failed., org.openjdk.jol.vm.sa.SASupportException: Sense failed., org.openjdk.jol.vm.sa.SASupportException: Sense failed.]
2024-06-04 23:27:10 INFO  org.apache.hudi.table.marker.DirectWriteMarkers:197 - Creating Marker Path=s3a://warehouse/people/.hoodie/metadata/.hoodie/.temp/20240604232400230/files/files-0000-0_0-0-0_00000000000000010.hfile.marker.APPEND
2024-06-04 23:27:10 INFO  org.apache.hudi.table.marker.DirectWriteMarkers:202 - [direct] Created marker file s3a://warehouse/people/.hoodie/metadata/.hoodie/.temp/20240604232400230/files/files-0000-0_0-0-0_00000000000000010.hfile.marker.APPEND in 17 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormat$WriterBuilder:215 - Building HoodieLogFormat Writer
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormat$WriterBuilder:270 - HoodieLogFile on path s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.1_0-0-0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormatWriter:122 - Append not supported.. Rolling over to HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.io.HoodieAppendHandle:438 - AppendHandle for partitionPath files filePath files/.files-0000-0_00000000000000010.log.2_0-0-0, took 301 ms.
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:429 - Building file system view for partition (column_stats)
2024-06-04 23:27:10 INFO  org.apache.hudi.table.marker.DirectWriteMarkers:197 - Creating Marker Path=s3a://warehouse/people/.hoodie/metadata/.hoodie/.temp/20240604232400230/column_stats/col-stats-0001-0_0-0-0_00000000000000011.hfile.marker.APPEND
2024-06-04 23:27:10 INFO  org.apache.hudi.table.marker.DirectWriteMarkers:202 - [direct] Created marker file s3a://warehouse/people/.hoodie/metadata/.hoodie/.temp/20240604232400230/column_stats/col-stats-0001-0_0-0-0_00000000000000011.hfile.marker.APPEND in 12 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormat$WriterBuilder:215 - Building HoodieLogFormat Writer
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormat$WriterBuilder:270 - HoodieLogFile on path s3a://warehouse/people/.hoodie/metadata/column_stats/.col-stats-0001-0_00000000000000011.log.1_0-0-0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormatWriter:122 - Append not supported.. Rolling over to HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/column_stats/.col-stats-0001-0_00000000000000011.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.io.HoodieAppendHandle:438 - AppendHandle for partitionPath column_stats filePath column_stats/.col-stats-0001-0_00000000000000011.log.2_0-0-0, took 43 ms.
2024-06-04 23:27:10 INFO  org.apache.hudi.table.marker.DirectWriteMarkers:197 - Creating Marker Path=s3a://warehouse/people/.hoodie/metadata/.hoodie/.temp/20240604232400230/column_stats/col-stats-0000-0_0-0-0_00000000000000011.hfile.marker.APPEND
2024-06-04 23:27:10 INFO  org.apache.hudi.table.marker.DirectWriteMarkers:202 - [direct] Created marker file s3a://warehouse/people/.hoodie/metadata/.hoodie/.temp/20240604232400230/column_stats/col-stats-0000-0_0-0-0_00000000000000011.hfile.marker.APPEND in 8 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormat$WriterBuilder:215 - Building HoodieLogFormat Writer
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormat$WriterBuilder:270 - HoodieLogFile on path s3a://warehouse/people/.hoodie/metadata/column_stats/.col-stats-0000-0_00000000000000011.log.1_0-0-0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormatWriter:122 - Append not supported.. Rolling over to HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/column_stats/.col-stats-0000-0_00000000000000011.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.io.HoodieAppendHandle:438 - AppendHandle for partitionPath column_stats filePath column_stats/.col-stats-0000-0_00000000000000011.log.2_0-0-0, took 24 ms.
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.commit.BaseCommitActionExecutor:182 - Auto commit enabled: Committing 20240604232400230
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.CommitUtils:121 - Creating  metadata for UPSERT_PREPPED numWriteStats:3 numReplaceFileIds:0
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.commit.BaseJavaCommitActionExecutor:205 - Committing 20240604232400230, action Type deltacommit
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.commit.BaseJavaCommitActionExecutor:211 - Committing 20240604232400230, action Type deltacommit
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:220 - Marking instant complete [==>20240604232400230__deltacommit__INFLIGHT]
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:615 - Checking for file exists ?s3a://warehouse/people/.hoodie/metadata/.hoodie/20240604232400230.deltacommit.inflight
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:623 - Create new file for toInstant ?s3a://warehouse/people/.hoodie/metadata/.hoodie/20240604232400230.deltacommit
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:224 - Completed [==>20240604232400230__deltacommit__INFLIGHT]
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.commit.BaseJavaCommitActionExecutor:219 - Committed 20240604232400230
2024-06-04 23:27:10 INFO  org.apache.hudi.common.fs.FSUtils:716 - Removed directory at s3a://warehouse/people/.hoodie/metadata/.hoodie/.temp/20240604232400230
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:155 - Loading Active commit timeline for s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:243 - Creating View Manager with storage type :MEMORY
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:255 - Creating in-memory based Table View
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:220 - Marking instant complete [==>20240604232400230__replacecommit__INFLIGHT]
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:615 - Checking for file exists ?s3a://warehouse/people/.hoodie/20240604232400230.replacecommit.inflight
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:623 - Create new file for toInstant ?s3a://warehouse/people/.hoodie/20240604232400230.replacecommit
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:224 - Completed [==>20240604232400230__replacecommit__INFLIGHT]
2024-06-04 23:27:10 INFO  org.apache.hudi.client.BaseHoodieWriteClient:238 - Committed 20240604232400230
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:155 - Loading Active commit timeline for s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__replacecommit__COMPLETED__20240604232710563]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:243 - Creating View Manager with storage type :MEMORY
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:255 - Creating in-memory based Table View
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:243 - Creating View Manager with storage type :MEMORY
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:255 - Creating in-memory based Table View
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.FileSystemViewManager:165 - Creating InMemory based view for basePath s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__replacecommit__COMPLETED__20240604232710563]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 9 ms to read  1 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:109 - Load all partitions and files into file system view in advance.
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieTableMetadataUtil:927 - Loading latest merged file slices for metadata table partition files
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:429 - Building file system view for partition (files)
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieBackedTableMetadata:451 - Opened metadata base file from s3a://warehouse/people/.hoodie/metadata/files/files-0000-0_0-0-0_00000000000000010.hfile at instant 00000000000000010 in 3 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__replacecommit__COMPLETED__20240604232710563]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:250 - Scanning log file HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.1_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:293 - Reading a delete block from file s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.1_0-0-0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormatReader:115 - Moving to the next reader for logfile HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:250 - Scanning log file HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:286 - Reading a data block from file s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0 at instant 20240604232400230
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:402 - Merging the final data blocks
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:818 - Number of remaining logblocks to merge 2
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:818 - Number of remaining logblocks to merge 1
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:206 - Number of log files scanned => 2
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:207 - MaxMemoryInBytes allowed for compaction => 1073741824
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:208 - Number of entries in MemoryBasedMap in ExternalSpillableMap => 6
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:209 - Total size in bytes of MemoryBasedMap in ExternalSpillableMap => 5568
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:210 - Number of entries in DiskBasedMap in ExternalSpillableMap => 0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:211 - Size of file spilled to disk => 0
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieBackedTableMetadata:501 - Opened 2 metadata log files (dataset instant=20240604232400230, metadata instant=20240604232400230) in 96 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.BaseTableMetadata:334 - Listed partitions from metadata: #partitions=5
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieBackedTableMetadata:451 - Opened metadata base file from s3a://warehouse/people/.hoodie/metadata/files/files-0000-0_0-0-0_00000000000000010.hfile at instant 00000000000000010 in 0 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:250 - Scanning log file HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.1_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:293 - Reading a delete block from file s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.1_0-0-0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormatReader:115 - Moving to the next reader for logfile HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:250 - Scanning log file HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:286 - Reading a data block from file s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0 at instant 20240604232400230
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:402 - Merging the final data blocks
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:818 - Number of remaining logblocks to merge 2
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:818 - Number of remaining logblocks to merge 1
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:206 - Number of log files scanned => 2
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:207 - MaxMemoryInBytes allowed for compaction => 1073741824
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:208 - Number of entries in MemoryBasedMap in ExternalSpillableMap => 6
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:209 - Total size in bytes of MemoryBasedMap in ExternalSpillableMap => 5568
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:210 - Number of entries in DiskBasedMap in ExternalSpillableMap => 0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:211 - Size of file spilled to disk => 0
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieBackedTableMetadata:501 - Opened 2 metadata log files (dataset instant=20240604232400230, metadata instant=20240604232400230) in 18 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.BaseTableMetadata:397 - Listed files in 5 partitions from metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieTableMetadataUtil:927 - Loading latest merged file slices for metadata table partition files
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:429 - Building file system view for partition (files)
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieBackedTableMetadata:451 - Opened metadata base file from s3a://warehouse/people/.hoodie/metadata/files/files-0000-0_0-0-0_00000000000000010.hfile at instant 00000000000000010 in 0 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__replacecommit__COMPLETED__20240604232710563]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:250 - Scanning log file HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.1_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:293 - Reading a delete block from file s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.1_0-0-0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieLogFormatReader:115 - Moving to the next reader for logfile HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:250 - Scanning log file HoodieLogFile{pathStr='s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0', fileLen=-1}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:286 - Reading a data block from file s3a://warehouse/people/.hoodie/metadata/files/.files-0000-0_00000000000000010.log.2_0-0-0 at instant 20240604232400230
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:402 - Merging the final data blocks
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:818 - Number of remaining logblocks to merge 2
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader:818 - Number of remaining logblocks to merge 1
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:206 - Number of log files scanned => 2
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:207 - MaxMemoryInBytes allowed for compaction => 1073741824
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:208 - Number of entries in MemoryBasedMap in ExternalSpillableMap => 6
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:209 - Total size in bytes of MemoryBasedMap in ExternalSpillableMap => 5568
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:210 - Number of entries in DiskBasedMap in ExternalSpillableMap => 0
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner:211 - Size of file spilled to disk => 0
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.HoodieBackedTableMetadata:501 - Opened 2 metadata log files (dataset instant=20240604232400230, metadata instant=20240604232400230) in 19 ms
2024-06-04 23:27:10 INFO  org.apache.hudi.metadata.BaseTableMetadata:334 - Listed partitions from metadata: #partitions=5
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:317 - Cleaning city=DFW, retaining latest 0 commits.
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:501 - 0 patterns used to delete in partition path:city=DFW
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:317 - Cleaning city=NYC, retaining latest 0 commits.
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:501 - 0 patterns used to delete in partition path:city=NYC
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:317 - Cleaning city=ORD, retaining latest 0 commits.
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:501 - 0 patterns used to delete in partition path:city=ORD
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:317 - Cleaning city=SEA, retaining latest 0 commits.
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:501 - 0 patterns used to delete in partition path:city=SEA
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:317 - Cleaning city=SFO, retaining latest 0 commits.
2024-06-04 23:27:10 INFO  org.apache.hudi.table.action.clean.CleanPlanner:501 - 0 patterns used to delete in partition path:city=SFO
2024-06-04 23:27:10 WARN  org.apache.hudi.client.HoodieTimelineArchiver:83 - The configured archival configs hoodie.keep.min.commits=0 is more aggressive than the cleaning configs as the earliest commit to retain is [20240604232400230__replacecommit__COMPLETED__20240604232710563]. Adjusted the archival configs to be hoodie.keep.min.commits=2 and hoodie.keep.max.commits=3
2024-06-04 23:27:10 WARN  org.apache.hudi.client.HoodieTimelineArchiver:95 - Cleaning configs: hoodie.cleaner.policy=KEEP_LATEST_BY_HOURS hoodie.cleaner.hours.retained=168
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__replacecommit__COMPLETED__20240604232710563]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/metadata/.hoodie/hoodie.properties
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=HFILE) from s3a://warehouse/people/.hoodie/metadata
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__deltacommit__COMPLETED__20240604232710519]}
2024-06-04 23:27:10 INFO  org.apache.hudi.common.table.view.AbstractTableFileSystemView:259 - Took 0 ms to read  0 instants, 0 replaced file groups
2024-06-04 23:27:10 INFO  org.apache.hudi.common.util.ClusteringUtils:147 - Found 0 files in pending clustering operations
2024-06-04 23:27:10 INFO  org.apache.hudi.client.HoodieTimelineArchiver:514 - Not archiving as there is no compaction yet on the metadata table
2024-06-04 23:27:10 INFO  org.apache.hudi.client.HoodieTimelineArchiver:177 - No Instants to archive
2024-06-04 23:27:10 INFO  org.apache.iceberg.hadoop.HadoopTableOperations:164 - Committed a new metadata file s3a://warehouse/people/metadata/v1.metadata.json
2024-06-04 23:27:10 INFO  org.apache.iceberg.SnapshotScan:120 - Scanning empty table s3a://warehouse/people
2024-06-04 23:27:11 INFO  org.apache.iceberg.SnapshotProducer:414 - Committed snapshot 369315014296903406 (BaseOverwriteFiles)
2024-06-04 23:27:11 INFO  org.apache.iceberg.metrics.LoggingMetricsReporter:38 - Received metrics report: CommitReport{tableName=s3a://warehouse/people, snapshotId=369315014296903406, sequenceNumber=1, operation=overwrite, commitMetrics=CommitMetricsResult{totalDuration=TimerResult{timeUnit=NANOSECONDS, totalDuration=PT0.085428125S, count=1}, attempts=CounterResult{unit=COUNT, value=1}, addedDataFiles=CounterResult{unit=COUNT, value=6}, removedDataFiles=null, totalDataFiles=CounterResult{unit=COUNT, value=6}, addedDeleteFiles=null, addedEqualityDeleteFiles=null, addedPositionalDeleteFiles=null, removedDeleteFiles=null, removedEqualityDeleteFiles=null, removedPositionalDeleteFiles=null, totalDeleteFiles=CounterResult{unit=COUNT, value=0}, addedRecords=CounterResult{unit=COUNT, value=6}, removedRecords=null, totalRecords=CounterResult{unit=COUNT, value=6}, addedFilesSizeInBytes=CounterResult{unit=BYTES, value=7621}, removedFilesSizeInBytes=null, totalFilesSizeInBytes=CounterResult{unit=BYTES, value=7621}, addedPositionalDeletes=null, removedPositionalDeletes=null, totalPositionalDeletes=CounterResult{unit=COUNT, value=0}, addedEqualityDeletes=null, removedEqualityDeletes=null, totalEqualityDeletes=CounterResult{unit=COUNT, value=0}}, metadata={iceberg-version=Apache Iceberg 1.4.2 (commit f6bb9173b13424d77e7ad8439b5ef9627e530cb2)}}
2024-06-04 23:27:11 INFO  org.apache.iceberg.RemoveSnapshots:124 - Expiring snapshots older than: 2024-05-28T23:27:11.069+00:00 (1716938831069)
2024-06-04 23:27:11 INFO  org.apache.iceberg.RemoveSnapshots:309 - Committed snapshot changes
2024-06-04 23:27:11 INFO  org.apache.iceberg.RemoveSnapshots:328 - Cleaning up expired files (local, incremental)
2024-06-04 23:27:11 INFO  org.apache.iceberg.hadoop.HadoopTableOperations:164 - Committed a new metadata file s3a://warehouse/people/metadata/v2.metadata.json
2024-06-04 23:27:11 INFO  org.apache.xtable.conversion.ConversionController:133 - Sync is successful for the following formats HUDI,ICEBERG

hudi-hive-sync/run_sync_tool.sh looks good

root@spark:/opt/hudi/hudi-sync/hudi-hive-sync# ./run_sync_tool.sh  --metastore-uris 'thrift://hive-metastore:9083' --partitioned-by city --base-path 's3a://warehouse/people' --database hudi_db --table people --sync-mode hms
ls: cannot access '/opt/hudi/hudi-sync/hudi-hive-sync/../../packaging/hudi-hive-sync-bundle/target/hudi-hive-sync-*.jar': No such file or directory
setting hadoop conf dir
Running Command : java -cp /hive/lib/hive-metastore-2.3.10.jar::/hive/lib/hive-service-2.3.10.jar::/hive/lib/hive-exec-2.3.10.jar::/hive/lib/hive-jdbc-2.3.10.jar:/hive/lib/hive-jdbc-handler-2.3.10.jar::/hive/lib/jackson-annotations-2.12.0.jar:/hive/lib/jackson-core-2.12.0.jar:/hive/lib/jackson-core-asl-1.9.13.jar:/hive/lib/jackson-databind-2.12.0.jar:/hive/lib/jackson-dataformat-smile-2.12.0.jar:/hive/lib/jackson-datatype-guava-2.12.0.jar:/hive/lib/jackson-datatype-joda-2.12.0.jar:/hive/lib/jackson-jaxrs-1.9.13.jar:/hive/lib/jackson-jaxrs-base-2.12.0.jar:/hive/lib/jackson-jaxrs-json-provider-2.12.0.jar:/hive/lib/jackson-jaxrs-smile-provider-2.12.0.jar:/hive/lib/jackson-mapper-asl-1.9.13.jar:/hive/lib/jackson-module-jaxb-annotations-2.12.0.jar:/hive/lib/jackson-module-scala_2.11-2.12.0.jar:/hive/lib/jackson-xc-1.9.13.jar::/hadoop/share/hadoop/common/*:/hadoop/share/hadoop/mapreduce/*:/hadoop/share/hadoop/hdfs/*:/hadoop/share/hadoop/common/lib/*:/hadoop/share/hadoop/hdfs/lib/*:/hadoop/etc/hadoop: org.apache.hudi.hive.HiveSyncTool --metastore-uris thrift://hive-metastore:9083 --partitioned-by city --base-path s3a://warehouse/people --database hudi_db --table people --sync-mode hms
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/.ivy2/jars/org.slf4j_slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/hadoop-2.10.2/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
2024-06-04 23:30:49,554 INFO  [main] conf.HiveConf (HiveConf.java:findConfigFile(187)) - Found configuration file null
2024-06-04 23:30:49,765 INFO  [main] table.HoodieTableMetaClient (HoodieTableMetaClient.java:<init>(133)) - Loading HoodieTableMetaClient from s3a://warehouse/people
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/root/.ivy2/jars/org.apache.hadoop_hadoop-auth-2.10.2.jar) to method sun.security.krb5.Config.getInstance()
WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2024-06-04 23:30:49,799 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2024-06-04 23:30:50,319 INFO  [main] Configuration.deprecation (Configuration.java:logDeprecation(1294)) - fs.s3a.server-side-encryption-key is deprecated. Instead, use fs.s3a.server-side-encryption.key
2024-06-04 23:30:50,362 INFO  [main] table.HoodieTableConfig (HoodieTableConfig.java:<init>(276)) - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:30:50,374 INFO  [main] table.HoodieTableMetaClient (HoodieTableMetaClient.java:<init>(152)) - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:30:50,374 INFO  [main] table.HoodieTableMetaClient (HoodieTableMetaClient.java:<init>(155)) - Loading Active commit timeline for s3a://warehouse/people
2024-06-04 23:30:50,392 INFO  [main] timeline.HoodieActiveTimeline (HoodieActiveTimeline.java:<init>(172)) - Loaded instants upto : Option{val=[20240604232400230__replacecommit__COMPLETED__20240604232710563]}
2024-06-04 23:30:50,427 INFO  [main] hive.metastore (HiveMetaStoreClient.java:open(408)) - Trying to connect to metastore with URI thrift://hive-metastore:9083
2024-06-04 23:30:50,435 INFO  [main] hive.metastore (HiveMetaStoreClient.java:open(493)) - Opened a connection to metastore, current connections: 1
2024-06-04 23:30:50,445 INFO  [main] hive.metastore (HiveMetaStoreClient.java:open(546)) - Connected to metastore.
2024-06-04 23:30:50,473 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(162)) - Syncing target hoodie table with hive table(hudi_db.people). Hive metastore URL from HiveConf:thrift://hive-metastore:9083). Hive metastore URL from HiveSyncConfig:thrift://hive-metastore:9083, basePath :s3a://warehouse/people
2024-06-04 23:30:50,473 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(224)) - Trying to sync hoodie table people with base path s3a://warehouse/people of type COPY_ON_WRITE
2024-06-04 23:30:50,659 INFO  [main] table.TableSchemaResolver (TableSchemaResolver.java:readSchemaFromParquetBaseFile(329)) - Reading schema from s3a://warehouse/people/city=ORD/part-00003-6b980503-b6c2-42cb-aaa5-2d2feacda190.c000.snappy.parquet_20240604232400230_hudiext
2024-06-04 23:30:50,675 INFO  [main] table.TableSchemaResolver (TableSchemaResolver.java:hasOperationField(470)) - Failed to read operation field from avro schema (Failed to read data schema)
2024-06-04 23:30:50,698 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncFirstTime(321)) - Sync table people for the first time.
2024-06-04 23:30:50,747 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(265)) - Last commit time synced was found to be null, last commit completion time is found to be null
2024-06-04 23:30:50,748 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(279)) - Sync all partitions given the last commit time synced is empty or before the start of the active timeline. Listing all partitions in s3a://warehouse/people, file system: S3AFileSystem{uri=s3a://warehouse, workingDir=s3a://warehouse/user/root, inputPolicy=normal, partSize=104857600, enableMultiObjectsDelete=true, maxKeys=5000, readAhead=65536, blockSize=33554432, multiPartThreshold=2147483647, serverSideEncryptionAlgorithm='NONE', metastore=NullMetadataStore, authoritative=false, boundedExecutor=BlockingThreadPoolExecutorService{SemaphoredDelegatingExecutor{permitCount=25, available=25, waiting=0}, activeCount=0}, unboundedExecutor=java.util.concurrent.ThreadPoolExecutor@66813e6e[Running, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], DirectoryMarkerRetention{policy='delete'}, statistics {31810 bytes read, 0 bytes written, 7 read ops, 0 large read ops, 0 write ops}, metrics {{Context=S3AFileSystem} {FileSystemId=3ce354be-808a-4240-813d-fc67413cd80a-warehouse} {fsURI=s3a://warehouse/people/.hoodie} {files_created=0} {files_copied=0} {files_copied_bytes=0} {files_deleted=0} {fake_directories_deleted=0} {directories_created=0} {directories_deleted=0} {ignored_errors=0} {op_copy_from_local_file=0} {op_exists=0} {op_get_file_status=6} {op_glob_status=0} {op_is_directory=0} {op_is_file=0} {op_list_files=0} {op_list_located_status=0} {op_list_status=1} {op_mkdirs=0} {op_rename=0} {object_copy_requests=0} {object_delete_requests=0} {object_list_requests=4} {object_continue_list_requests=0} {object_metadata_requests=6} {object_multipart_aborted=0} {object_put_bytes=0} {object_put_requests=0} {object_put_requests_completed=0} {stream_write_failures=0} {stream_write_block_uploads=0} {stream_write_block_uploads_committed=0} {stream_write_block_uploads_aborted=0} {stream_write_total_time=0} {stream_write_total_data=0} {s3guard_metadatastore_put_path_request=5} {s3guard_metadatastore_initialization=0} {object_put_requests_active=0} {object_put_bytes_pending=0} {stream_write_block_uploads_active=0} {stream_write_block_uploads_pending=0} {stream_write_block_uploads_data_pending=0} {S3guard_metadatastore_put_path_latencyNumOps=0} {S3guard_metadatastore_put_path_latency50thPercentileLatency=0} {S3guard_metadatastore_put_path_latency75thPercentileLatency=0} {S3guard_metadatastore_put_path_latency90thPercentileLatency=0} {S3guard_metadatastore_put_path_latency95thPercentileLatency=0} {S3guard_metadatastore_put_path_latency99thPercentileLatency=0} {stream_read_fully_operations=0} {stream_opened=3} {stream_bytes_skipped_on_seek=0} {stream_closed=3} {stream_bytes_backwards_on_seek=0} {stream_bytes_read=31810} {stream_read_operations_incomplete=5} {stream_bytes_discarded_in_abort=0} {stream_close_operations=3} {stream_read_operations=33} {stream_aborted=0} {stream_forward_seek_operations=0} {stream_backward_seek_operations=0} {stream_seek_operations=0} {stream_bytes_read_in_close=0} {stream_read_exceptions=0} }}
2024-06-04 23:30:50,780 INFO  [main] table.HoodieTableConfig (HoodieTableConfig.java:<init>(276)) - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:30:50,906 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(298)) - Sync complete for people
2024-06-04 23:30:50,909 INFO  [main] hive.metastore (HiveMetaStoreClient.java:close(576)) - Closed a connection to metastore, current connections: 0

trino should show rows

trino@trino:/$ trino
trino> select * from hudi.hudi_db.people;
    -> select * from delta.delta_db.people;
    -> select * from iceberg.iceberg_db.people;
 _hoodie_commit_time | _hoodie_commit_seqno | _hoodie_record_key | _hoodie_part>
---------------------+----------------------+--------------------+------------->
(0 rows)

Query 20240604_233108_00000_ujp5k, FINISHED, 1 node
Splits: 1 total, 1 done (100.00%)
1.36 [0 rows, 0B] [0 rows/s, 0B/s]

 id |  name   | age | city |      create_ts
----+---------+-----+------+---------------------
  5 | Bob     |  28 | SEA  | 2023-09-23 00:00:00
  6 | Charlie |  31 | DFW  | 2023-08-29 00:00:00
  4 | Andrew  |  40 | NYC  | 2023-10-28 00:00:00
  1 | John    |  25 | NYC  | 2023-09-28 00:00:00
  3 | Michael |  35 | ORD  | 2023-09-28 00:00:00
  2 | Emily   |  30 | SFO  | 2023-09-28 00:00:00
(6 rows)

Query 20240604_233113_00001_ujp5k, FINISHED, 1 node
Splits: 6 total, 6 done (100.00%)
0.83 [6 rows, 7.44KB] [7 rows/s, 8.96KB/s]

 id |  name   | age | city |      create_ts
----+---------+-----+------+---------------------
  1 | John    |  25 | NYC  | 2023-09-28 00:00:00
  4 | Andrew  |  40 | NYC  | 2023-10-28 00:00:00
  2 | Emily   |  30 | SFO  | 2023-09-28 00:00:00
  3 | Michael |  35 | ORD  | 2023-09-28 00:00:00
  6 | Charlie |  31 | DFW  | 2023-08-29 00:00:00
  5 | Bob     |  28 | SEA  | 2023-09-23 00:00:00
(6 rows)

Query 20240604_233114_00002_ujp5k, FINISHED, 1 node
Splits: 6 total, 6 done (100.00%)
0.95 [6 rows, 7.44KB] [6 rows/s, 7.8KB/s]

Are you willing to submit PR?

  • I am willing to submit a PR!
  • I am willing to submit a PR but need help getting started!

Code of Conduct

@alberttwong alberttwong added the bug Something isn't working label Jun 4, 2024
@alberttwong
Copy link
Contributor Author

alberttwong commented Jun 4, 2024

running xtable again

root@spark:/opt/hudi/hudi-sync/hudi-hive-sync# cd /opt/xtable/jars/; java -jar xtable-utilities-0.1.0-SNAPSHOT-bundled.jar --datasetConfig xtable_delta.yaml -p core-site.xml
WARNING: Runtime environment or build system does not support multi-release JARs. This will impact location-based features.
2024-06-04 23:40:55 INFO  org.apache.xtable.utilities.RunSync:148 - Running sync for basePath s3a://warehouse/people for following table formats [HUDI, ICEBERG]
2024-06-04 23:40:55 WARN  org.apache.hadoop.util.NativeCodeLoader:60 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/opt/xtable/jars/xtable-utilities-0.1.0-SNAPSHOT-bundled.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2024-06-04 23:40:56 WARN  org.apache.hadoop.metrics2.impl.MetricsConfig:136 - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
2024-06-04 23:40:56 WARN  org.apache.hadoop.fs.s3a.SDKV2Upgrade:39 - Directly referencing AWS SDK V1 credential provider com.amazonaws.auth.DefaultAWSCredentialsProviderChain. AWS SDK V1 credential providers will be removed once S3A is upgraded to SDK V2
2024-06-04 23:40:57 INFO  org.apache.spark.sql.delta.storage.DelegatingLogStore:60 - LogStore `LogStoreAdapter(io.delta.storage.S3SingleDriverLogStore)` is used for scheme `s3a`
2024-06-04 23:40:57 INFO  org.apache.spark.sql.delta.DeltaLog:60 - Loading version 0.
2024-06-04 23:40:58 INFO  org.apache.spark.sql.delta.DeltaLogFileIndex:60 - Created DeltaLogFileIndex(JSON, numFilesInSegment: 1, totalFileSize: 3848)
2024-06-04 23:40:59 INFO  org.apache.spark.sql.delta.Snapshot:60 - [tableId=3ce0a1d7-8227-4adc-950d-4909c31ce4ec] Created snapshot Snapshot(path=s3a://warehouse/people/_delta_log, version=0, metadata=Metadata(f9b5140a-bd50-4095-9695-021c48c8e079,null,null,Format(parquet,Map()),{"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":true,"metadata":{}},{"name":"city","type":"string","nullable":true,"metadata":{}},{"name":"create_ts","type":"string","nullable":true,"metadata":{}}]},List(city),Map(),Some(1717543438122)), logSegment=LogSegment(s3a://warehouse/people/_delta_log,0,WrappedArray(S3AFileStatus{path=s3a://warehouse/people/_delta_log/00000000000000000000.json; isDirectory=false; length=3848; replication=1; blocksize=33554432; modification_time=1717543440230; access_time=0; owner=root; group=root; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=b4ef5c900263aaf74ca626d27d79cc3c versionId=null),None,1717543440230), checksumOpt=None)
2024-06-04 23:40:59 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:133 - Loading HoodieTableMetaClient from s3a://warehouse/people
2024-06-04 23:40:59 INFO  org.apache.hudi.common.table.HoodieTableConfig:276 - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:40:59 INFO  org.apache.hudi.common.table.HoodieTableMetaClient:152 - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:40:59 INFO  org.apache.iceberg.hadoop.HadoopTables:101 - Table location loaded: s3a://warehouse/people
2024-06-04 23:40:59 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline:171 - Loaded instants upto : Option{val=[20240604232400230__replacecommit__COMPLETED__20240604232710563]}

running sync again

root@spark:/opt/xtable/jars# cd /opt/hudi/hudi-sync/hudi-hive-sync ; \
> ./run_sync_tool.sh  \
> --metastore-uris 'thrift://hive-metastore:9083' \
> --partitioned-by city \
> --base-path 's3a://warehouse/people' \
> --database hudi_db \
> --table people \
> --sync-mode hms
ls: cannot access '/opt/hudi/hudi-sync/hudi-hive-sync/../../packaging/hudi-hive-sync-bundle/target/hudi-hive-sync-*.jar': No such file or directory
setting hadoop conf dir
Running Command : java -cp /hive/lib/hive-metastore-2.3.10.jar::/hive/lib/hive-service-2.3.10.jar::/hive/lib/hive-exec-2.3.10.jar::/hive/lib/hive-jdbc-2.3.10.jar:/hive/lib/hive-jdbc-handler-2.3.10.jar::/hive/lib/jackson-annotations-2.12.0.jar:/hive/lib/jackson-core-2.12.0.jar:/hive/lib/jackson-core-asl-1.9.13.jar:/hive/lib/jackson-databind-2.12.0.jar:/hive/lib/jackson-dataformat-smile-2.12.0.jar:/hive/lib/jackson-datatype-guava-2.12.0.jar:/hive/lib/jackson-datatype-joda-2.12.0.jar:/hive/lib/jackson-jaxrs-1.9.13.jar:/hive/lib/jackson-jaxrs-base-2.12.0.jar:/hive/lib/jackson-jaxrs-json-provider-2.12.0.jar:/hive/lib/jackson-jaxrs-smile-provider-2.12.0.jar:/hive/lib/jackson-mapper-asl-1.9.13.jar:/hive/lib/jackson-module-jaxb-annotations-2.12.0.jar:/hive/lib/jackson-module-scala_2.11-2.12.0.jar:/hive/lib/jackson-xc-1.9.13.jar::/hadoop/share/hadoop/common/*:/hadoop/share/hadoop/mapreduce/*:/hadoop/share/hadoop/hdfs/*:/hadoop/share/hadoop/common/lib/*:/hadoop/share/hadoop/hdfs/lib/*:/hadoop/etc/hadoop: org.apache.hudi.hive.HiveSyncTool --metastore-uris thrift://hive-metastore:9083 --partitioned-by city --base-path s3a://warehouse/people --database hudi_db --table people --sync-mode hms
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/.ivy2/jars/org.slf4j_slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/hadoop-2.10.2/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
2024-06-04 23:45:16,811 INFO  [main] conf.HiveConf (HiveConf.java:findConfigFile(187)) - Found configuration file null
2024-06-04 23:45:17,016 INFO  [main] table.HoodieTableMetaClient (HoodieTableMetaClient.java:<init>(133)) - Loading HoodieTableMetaClient from s3a://warehouse/people
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/root/.ivy2/jars/org.apache.hadoop_hadoop-auth-2.10.2.jar) to method sun.security.krb5.Config.getInstance()
WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2024-06-04 23:45:17,050 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2024-06-04 23:45:17,513 INFO  [main] Configuration.deprecation (Configuration.java:logDeprecation(1294)) - fs.s3a.server-side-encryption-key is deprecated. Instead, use fs.s3a.server-side-encryption.key
2024-06-04 23:45:17,555 INFO  [main] table.HoodieTableConfig (HoodieTableConfig.java:<init>(276)) - Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-06-04 23:45:17,570 INFO  [main] table.HoodieTableMetaClient (HoodieTableMetaClient.java:<init>(152)) - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-06-04 23:45:17,570 INFO  [main] table.HoodieTableMetaClient (HoodieTableMetaClient.java:<init>(155)) - Loading Active commit timeline for s3a://warehouse/people
2024-06-04 23:45:17,589 INFO  [main] timeline.HoodieActiveTimeline (HoodieActiveTimeline.java:<init>(172)) - Loaded instants upto : Option{val=[20240604232400230__replacecommit__COMPLETED__20240604232710563]}
2024-06-04 23:45:17,621 INFO  [main] hive.metastore (HiveMetaStoreClient.java:open(408)) - Trying to connect to metastore with URI thrift://hive-metastore:9083
2024-06-04 23:45:17,629 INFO  [main] hive.metastore (HiveMetaStoreClient.java:open(493)) - Opened a connection to metastore, current connections: 1
2024-06-04 23:45:17,639 INFO  [main] hive.metastore (HiveMetaStoreClient.java:open(546)) - Connected to metastore.
2024-06-04 23:45:17,666 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(162)) - Syncing target hoodie table with hive table(hudi_db.people). Hive metastore URL from HiveConf:thrift://hive-metastore:9083). Hive metastore URL from HiveSyncConfig:thrift://hive-metastore:9083, basePath :s3a://warehouse/people
2024-06-04 23:45:17,666 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(224)) - Trying to sync hoodie table people with base path s3a://warehouse/people of type COPY_ON_WRITE
2024-06-04 23:45:17,828 INFO  [main] table.TableSchemaResolver (TableSchemaResolver.java:readSchemaFromParquetBaseFile(329)) - Reading schema from s3a://warehouse/people/city=ORD/part-00003-6b980503-b6c2-42cb-aaa5-2d2feacda190.c000.snappy.parquet_20240604232400230_hudiext
2024-06-04 23:45:17,843 INFO  [main] table.TableSchemaResolver (TableSchemaResolver.java:hasOperationField(470)) - Failed to read operation field from avro schema (Failed to read data schema)
2024-06-04 23:45:17,893 INFO  [main] ddl.HMSDDLExecutor (HMSDDLExecutor.java:getTableSchema(182)) - Time taken to getTableSchema: 16 ms
2024-06-04 23:45:17,896 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncSchema(345)) - No Schema difference for people
MessageType: message struct {
  optional binary _hoodie_commit_time (UTF8);
  optional binary _hoodie_commit_seqno (UTF8);
  optional binary _hoodie_record_key (UTF8);
  optional binary _hoodie_partition_path (UTF8);
  optional binary _hoodie_file_name (UTF8);
  optional int32 id;
  optional binary name (UTF8);
  optional int32 age;
  optional binary city (UTF8);
  optional binary create_ts (UTF8);
}

2024-06-04 23:45:17,925 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(265)) - Last commit time synced was found to be 20240604232400230, last commit completion time is found to be 20240604232710563
2024-06-04 23:45:17,926 INFO  [main] common.HoodieSyncClient (HoodieSyncClient.java:getWrittenPartitionsSince(140)) - Last commit time synced is 20240604232400230, Getting commits since then
2024-06-04 23:45:17,928 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(286)) - Storage partitions scan complete. Found 0
2024-06-04 23:45:17,968 INFO  [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(298)) - Sync complete for people
2024-06-04 23:45:17,971 INFO  [main] hive.metastore (HiveMetaStoreClient.java:close(576)) - Closed a connection to metastore, current connections: 0

@alberttwong alberttwong changed the title no rows when xtable source from delta and write into Hudi + HMS no rows when xtable source from delta and write into Hudi and Iceberg with S3 + HMS Jun 4, 2024
@vinishjail97
Copy link
Contributor

Hey @alberttwong, do you have the hudi connector present in the trino version you are running ? If possible can you share the trino environment details you are using ?

https://xtable.apache.org/docs/trino
https://trino.io/docs/current/connector/hudi.html

@alberttwong
Copy link
Contributor Author

alberttwong commented Jun 5, 2024

BTW, Trino works fine with source hudi and target iceberg and delta.

@the-other-tim-brown
Copy link
Contributor

@alberttwong is there a way to pass in reader options to Trino for reading hoodie? hoodie.metadata.enable must be set to true on the reader side to read a Hudi table generated by XTable and Hudi version 0.14.0+ must be used by the reader as well.

@alberttwong
Copy link
Contributor Author

I'll give it a try. What is weird is that this option isn't listed at https://trino.io/docs/current/connector/hudi.html

@alberttwong
Copy link
Contributor Author

alberttwong commented Jun 6, 2024

won't work in Trino 428

atwong@Coolidgelabs demo-s3 % cat trino/catalog/hudi.properties
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
connector.name=hudi
hive.metastore.uri=thrift://hive-metastore:9083
hive.s3.aws-access-key=admin
hive.s3.aws-secret-key=password
hive.s3.endpoint=http://minio:9000
hoodie.metadata.enable=true
2024-06-05 20:48:11 2024-06-06T03:48:11.571Z    ERROR   main    io.trino.server.Server  Configuration errors:
2024-06-05 20:48:11 
2024-06-05 20:48:11 1) Error: Configuration property 'hoodie.metadata.enable' was not used
2024-06-05 20:48:11 
2024-06-05 20:48:11 1 error
2024-06-05 20:48:11 io.airlift.bootstrap.ApplicationConfigurationException: Configuration errors:
2024-06-05 20:48:11 
2024-06-05 20:48:11 1) Error: Configuration property 'hoodie.metadata.enable' was not used
2024-06-05 20:48:11 
2024-06-05 20:48:11 1 error
2024-06-05 20:48:11     at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:232)
2024-06-05 20:48:11     at io.trino.plugin.hudi.InternalHudiConnectorFactory.createConnector(InternalHudiConnectorFactory.java:95)
2024-06-05 20:48:11     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2024-06-05 20:48:11     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2024-06-05 20:48:11     at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2024-06-05 20:48:11     at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2024-06-05 20:48:11     at io.trino.plugin.hudi.HudiConnectorFactory.create(HudiConnectorFactory.java:48)
2024-06-05 20:48:11     at io.trino.connector.DefaultCatalogFactory.createConnector(DefaultCatalogFactory.java:224)
2024-06-05 20:48:11     at io.trino.connector.DefaultCatalogFactory.createCatalog(DefaultCatalogFactory.java:133)
2024-06-05 20:48:11     at io.trino.connector.LazyCatalogFactory.createCatalog(LazyCatalogFactory.java:45)
2024-06-05 20:48:11     at io.trino.connector.StaticCatalogManager.lambda$loadInitialCatalogs$1(StaticCatalogManager.java:157)
2024-06-05 20:48:11     at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2024-06-05 20:48:11     at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
2024-06-05 20:48:11     at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2024-06-05 20:48:11     at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)
2024-06-05 20:48:11     at java.base/java.util.concurrent.ExecutorCompletionService.submit(ExecutorCompletionService.java:184)
2024-06-05 20:48:11     at io.trino.util.Executors.executeUntilFailure(Executors.java:41)
2024-06-05 20:48:11     at io.trino.connector.StaticCatalogManager.loadInitialCatalogs(StaticCatalogManager.java:151)
2024-06-05 20:48:11     at io.trino.server.Server.doStart(Server.java:144)
2024-06-05 20:48:11     at io.trino.server.Server.lambda$start$0(Server.java:91)
2024-06-05 20:48:11     at io.trino.$gen.Trino_428____20240606_034757_1.run(Unknown Source)
2024-06-05 20:48:11     at io.trino.server.Server.start(Server.java:91)
2024-06-05 20:48:11     at io.trino.server.TrinoServer.main(TrinoServer.java:38)

@alberttwong
Copy link
Contributor Author

alberttwong commented Jun 6, 2024

trinodb/trino#15368 implies that the hudi setting in hudi.properties should be hudi.metadata-enabled=true however when I do this I get this error.

also trino 428 shows there isn't any metadata like property I can set. https://github.com/trinodb/trino/blob/428/plugin/trino-hudi/src/main/java/io/trino/plugin/hudi/HudiConfig.java

Also I don't know how to upgrade the hudi connector in Trino. There are no instructions.

2024-06-05 21:04:23 2024-06-06T04:04:23.069Z    ERROR   main    io.trino.server.Server  Configuration errors:
2024-06-05 21:04:23 
2024-06-05 21:04:23 1) Error: Defunct property 'hudi.metadata-enabled' (class [class HudiConfig]) cannot be configured.
2024-06-05 21:04:23 
2024-06-05 21:04:23 2) Error: Configuration property 'hudi.metadata-enabled' was not used
2024-06-05 21:04:23 
2024-06-05 21:04:23 2 errors
2024-06-05 21:04:23 
2024-06-05 21:04:23 ======================
2024-06-05 21:04:23 Full classname legend:
2024-06-05 21:04:23 ======================
2024-06-05 21:04:23 HudiConfig: "io.trino.plugin.hudi.HudiConfig"
2024-06-05 21:04:23 ========================
2024-06-05 21:04:23 End of classname legend:
2024-06-05 21:04:23 ========================
2024-06-05 21:04:23 
2024-06-05 21:04:23 io.airlift.bootstrap.ApplicationConfigurationException: Configuration errors:
2024-06-05 21:04:23 
2024-06-05 21:04:23 1) Error: Defunct property 'hudi.metadata-enabled' (class [class HudiConfig]) cannot be configured.
2024-06-05 21:04:23 
2024-06-05 21:04:23 2) Error: Configuration property 'hudi.metadata-enabled' was not used
2024-06-05 21:04:23 
2024-06-05 21:04:23 2 errors
2024-06-05 21:04:23 
2024-06-05 21:04:23 ======================
2024-06-05 21:04:23 Full classname legend:
2024-06-05 21:04:23 ======================
2024-06-05 21:04:23 HudiConfig: "io.trino.plugin.hudi.HudiConfig"
2024-06-05 21:04:23 ========================
2024-06-05 21:04:23 End of classname legend:
2024-06-05 21:04:23 ========================
2024-06-05 21:04:23 
2024-06-05 21:04:23     at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:232)
2024-06-05 21:04:23     at io.trino.plugin.hudi.InternalHudiConnectorFactory.createConnector(InternalHudiConnectorFactory.java:95)
2024-06-05 21:04:23     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2024-06-05 21:04:23     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2024-06-05 21:04:23     at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2024-06-05 21:04:23     at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2024-06-05 21:04:23     at io.trino.plugin.hudi.HudiConnectorFactory.create(HudiConnectorFactory.java:48)
2024-06-05 21:04:23     at io.trino.connector.DefaultCatalogFactory.createConnector(DefaultCatalogFactory.java:224)
2024-06-05 21:04:23     at io.trino.connector.DefaultCatalogFactory.createCatalog(DefaultCatalogFactory.java:133)
2024-06-05 21:04:23     at io.trino.connector.LazyCatalogFactory.createCatalog(LazyCatalogFactory.java:45)
2024-06-05 21:04:23     at io.trino.connector.StaticCatalogManager.lambda$loadInitialCatalogs$1(StaticCatalogManager.java:157)
2024-06-05 21:04:23     at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2024-06-05 21:04:23     at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
2024-06-05 21:04:23     at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2024-06-05 21:04:23     at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)
2024-06-05 21:04:23     at java.base/java.util.concurrent.ExecutorCompletionService.submit(ExecutorCompletionService.java:184)
2024-06-05 21:04:23     at io.trino.util.Executors.executeUntilFailure(Executors.java:41)
2024-06-05 21:04:23     at io.trino.connector.StaticCatalogManager.loadInitialCatalogs(StaticCatalogManager.java:151)
2024-06-05 21:04:23     at io.trino.server.Server.doStart(Server.java:144)
2024-06-05 21:04:23     at io.trino.server.Server.lambda$start$0(Server.java:91)
2024-06-05 21:04:23     at io.trino.$gen.Trino_428____20240606_040414_1.run(Unknown Source)
2024-06-05 21:04:23     at io.trino.server.Server.start(Server.java:91)
2024-06-05 21:04:23     at io.trino.server.TrinoServer.main(TrinoServer.java:38)

@alberttwong
Copy link
Contributor Author

looking up Trino 428, they're using Hudi 0.12.3 https://github.com/trinodb/trino/blob/428/plugin/trino-hudi/pom.xml. Trino 440 is the first one to use Hudi 0.14.1 https://github.com/trinodb/trino/blob/440/plugin/trino-hudi/pom.xml. Do you want me to upgrade my image to at least Trino 440?

@alberttwong
Copy link
Contributor Author

I just tried out Trino 449 and it has the same error

2024-06-05 21:39:19 2024-06-06T04:39:19.113Z    ERROR   main    io.trino.server.Server  Configuration errors:
2024-06-05 21:39:19 
2024-06-05 21:39:19 1) Error: Defunct property 'hudi.metadata-enabled' (class [class HudiConfig]) cannot be configured.
2024-06-05 21:39:19 
2024-06-05 21:39:19 2) Error: Configuration property 'hudi.metadata-enabled' was not used
2024-06-05 21:39:19 
2024-06-05 21:39:19 2 errors
2024-06-05 21:39:19 
2024-06-05 21:39:19 ======================
2024-06-05 21:39:19 Full classname legend:
2024-06-05 21:39:19 ======================
2024-06-05 21:39:19 HudiConfig: "io.trino.plugin.hudi.HudiConfig"
2024-06-05 21:39:19 ========================
2024-06-05 21:39:19 End of classname legend:
2024-06-05 21:39:19 ========================
2024-06-05 21:39:19 
2024-06-05 21:39:19 io.airlift.bootstrap.ApplicationConfigurationException: Configuration errors:
2024-06-05 21:39:19 
2024-06-05 21:39:19 1) Error: Defunct property 'hudi.metadata-enabled' (class [class HudiConfig]) cannot be configured.
2024-06-05 21:39:19 
2024-06-05 21:39:19 2) Error: Configuration property 'hudi.metadata-enabled' was not used
2024-06-05 21:39:19 
2024-06-05 21:39:19 2 errors
2024-06-05 21:39:19 
2024-06-05 21:39:19 ======================
2024-06-05 21:39:19 Full classname legend:
2024-06-05 21:39:19 ======================
2024-06-05 21:39:19 HudiConfig: "io.trino.plugin.hudi.HudiConfig"
2024-06-05 21:39:19 ========================
2024-06-05 21:39:19 End of classname legend:
2024-06-05 21:39:19 ========================
2024-06-05 21:39:19 
2024-06-05 21:39:19     at io.airlift.bootstrap.Bootstrap.configure(Bootstrap.java:217)
2024-06-05 21:39:19     at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:246)
2024-06-05 21:39:19     at io.trino.plugin.hudi.HudiConnectorFactory.createConnector(HudiConnectorFactory.java:98)
2024-06-05 21:39:19     at io.trino.plugin.hudi.HudiConnectorFactory.create(HudiConnectorFactory.java:66)
2024-06-05 21:39:19     at io.trino.connector.DefaultCatalogFactory.createConnector(DefaultCatalogFactory.java:202)
2024-06-05 21:39:19     at io.trino.connector.DefaultCatalogFactory.createCatalog(DefaultCatalogFactory.java:120)
2024-06-05 21:39:19     at io.trino.connector.LazyCatalogFactory.createCatalog(LazyCatalogFactory.java:45)
2024-06-05 21:39:19     at io.trino.connector.StaticCatalogManager.lambda$loadInitialCatalogs$1(StaticCatalogManager.java:161)
2024-06-05 21:39:19     at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
2024-06-05 21:39:19     at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
2024-06-05 21:39:19     at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
2024-06-05 21:39:19     at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)
2024-06-05 21:39:19     at java.base/java.util.concurrent.ExecutorCompletionService.submit(ExecutorCompletionService.java:186)
2024-06-05 21:39:19     at io.trino.util.Executors.executeUntilFailure(Executors.java:46)
2024-06-05 21:39:19     at io.trino.connector.StaticCatalogManager.loadInitialCatalogs(StaticCatalogManager.java:155)
2024-06-05 21:39:19     at io.trino.server.Server.doStart(Server.java:155)
2024-06-05 21:39:19     at io.trino.server.Server.lambda$start$0(Server.java:93)
2024-06-05 21:39:19     at io.trino.$gen.Trino_449____20240606_043904_1.run(Unknown Source)
2024-06-05 21:39:19     at io.trino.server.Server.start(Server.java:93)
2024-06-05 21:39:19     at io.trino.server.TrinoServer.main(TrinoServer.java:37)
2024-06-05 21:39:19 

@alberttwong
Copy link
Contributor Author

I'll retry writing delta and xtable and hudi-hive-sync/run_sync_tool.sh with Trino 449 tomorrow morning.

@alberttwong
Copy link
Contributor Author

confirmed that upgrading to Trino 449 doesn't work. It looks like we need to make changes to the Trino Hudi Plugin.

@alberttwong
Copy link
Contributor Author

linked Trino github issue. trinodb/trino#22289

@alberttwong
Copy link
Contributor Author

hmm... another wrinkle. apache/hudi#10289

@alberttwong alberttwong changed the title no rows when xtable source from delta and write into Hudi and Iceberg with S3 + HMS no rows in Trino when xtable source from delta and write into Hudi and Iceberg with S3 + HMS Jun 6, 2024
@alberttwong alberttwong changed the title no rows in Trino when xtable source from delta and write into Hudi and Iceberg with S3 + HMS no rows in Trino when pyspark xtable source from delta and write into Hudi and Iceberg with S3 + HMS Jun 7, 2024
@alberttwong
Copy link
Contributor Author

I was told to downgrade to Trino 418.

@alberttwong
Copy link
Contributor Author

Downgrade doesn't work.

2024-07-15 12:46:25 2024-07-15T19:46:25.953Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 38.21ms
2024-07-15 12:46:26 2024-07-15T19:46:26.327Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 10.50ms
2024-07-15 12:46:26 2024-07-15T19:46:26.341Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 9.13ms
2024-07-15 12:46:26 2024-07-15T19:46:26.343Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='_hoodie_commit_time', type=varchar) succeeded in 389.13us
2024-07-15 12:46:26 2024-07-15T19:46:26.343Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='_hoodie_commit_seqno', type=varchar) succeeded in 15.96us
2024-07-15 12:46:26 2024-07-15T19:46:26.343Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='_hoodie_record_key', type=varchar) succeeded in 14.75us
2024-07-15 12:46:26 2024-07-15T19:46:26.343Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='_hoodie_partition_path', type=varchar) succeeded in 9.96us
2024-07-15 12:46:26 2024-07-15T19:46:26.343Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='_hoodie_file_name', type=varchar) succeeded in 10.83us
2024-07-15 12:46:26 2024-07-15T19:46:26.343Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='id', type=integer) succeeded in 11.58us
2024-07-15 12:46:26 2024-07-15T19:46:26.343Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='name', type=varchar) succeeded in 20.00us
2024-07-15 12:46:26 2024-07-15T19:46:26.344Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='age', type=integer) succeeded in 13.67us
2024-07-15 12:46:26 2024-07-15T19:46:26.344Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='create_ts', type=varchar) succeeded in 34.17us
2024-07-15 12:46:26 2024-07-15T19:46:26.344Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='city', type=varchar) succeeded in 12.17us
2024-07-15 12:46:26 2024-07-15T19:46:26.344Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='$path', type=varchar) succeeded in 9.58us
2024-07-15 12:46:26 2024-07-15T19:46:26.344Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='$file_size', type=bigint) succeeded in 10.63us
2024-07-15 12:46:26 2024-07-15T19:46:26.344Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='$file_modified_time', type=timestamp(3) with time zone) succeeded in 19.75us
2024-07-15 12:46:26 2024-07-15T19:46:26.344Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getColumnMask(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnName='$partition', type=varchar) succeeded in 16.50us
2024-07-15 12:46:26 2024-07-15T19:46:26.344Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of getRowFilters(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people) succeeded in 199.46us
2024-07-15 12:46:26 2024-07-15T19:46:26.356Z    DEBUG   Query-20240715_194625_00000_23mm5-188   io.trino.security.AccessControl Invocation of checkCanSelectFromColumns(context=SecurityContext{identity=Identity{user='trino', principal=trino}, queryId=20240715_194625_00000_23mm5}, tableName=hudi.hudi_db.people, columnNames=[_hoodie_commit_time, _hoodie_partition_path, city, _hoodie_record_key, name, create_ts, _hoodie_commit_seqno, id, _hoodie_file_name, age]) succeeded in 189.13us
2024-07-15 12:46:26 2024-07-15T19:46:26.358Z    DEBUG   dispatcher-query-4      io.trino.execution.QueryStateMachine    Query 20240715_194625_00000_23mm5 is DISPATCHING
2024-07-15 12:46:26 2024-07-15T19:46:26.359Z    DEBUG   dispatcher-query-4      io.trino.execution.QueryStateMachine    Query 20240715_194625_00000_23mm5 is PLANNING
2024-07-15 12:46:26 2024-07-15T19:46:26.400Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 9.64ms
2024-07-15 12:46:26 2024-07-15T19:46:26.411Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 9.05ms
2024-07-15 12:46:26 2024-07-15T19:46:26.415Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     Initial plan:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ Project[]
2024-07-15 12:46:26    │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26    └─ Project[]
2024-07-15 12:46:26       │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26       └─ Project[]
2024-07-15 12:46:26          │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26          └─ ScanProject[table = hudi:hudi_db.people]
2024-07-15 12:46:26                 Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26                 _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26                 _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26                 _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26                 _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26                 _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26                 id := id:int:REGULAR
2024-07-15 12:46:26                 name := name:string:REGULAR
2024-07-15 12:46:26                 age := age:int:REGULAR
2024-07-15 12:46:26                 create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26                 city := city:string:PARTITION_KEY
2024-07-15 12:46:26                 $path := $path:string:SYNTHESIZED
2024-07-15 12:46:26                 $file_size := $file_size:bigint:SYNTHESIZED
2024-07-15 12:46:26                 $file_modified_time := $file_modified_time:timestamp:SYNTHESIZED
2024-07-15 12:46:26                 $partition := $partition:string:SYNTHESIZED
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.432Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 8.42ms
2024-07-15 12:46:26 2024-07-15T19:46:26.441Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.74ms
2024-07-15 12:46:26 2024-07-15T19:46:26.442Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ Project[]
2024-07-15 12:46:26    │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26    └─ Project[]
2024-07-15 12:46:26       │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26       └─ Project[]
2024-07-15 12:46:26          │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26          └─ ScanProject[table = hudi:hudi_db.people]
2024-07-15 12:46:26                 Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26                 _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26                 _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26                 _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26                 _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26                 _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26                 id := id:int:REGULAR
2024-07-15 12:46:26                 name := name:string:REGULAR
2024-07-15 12:46:26                 age := age:int:REGULAR
2024-07-15 12:46:26                 create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26                 city := city:string:PARTITION_KEY
2024-07-15 12:46:26                 $path := $path:string:SYNTHESIZED
2024-07-15 12:46:26                 $file_size := $file_size:bigint:SYNTHESIZED
2024-07-15 12:46:26                 $file_modified_time := $file_modified_time:timestamp:SYNTHESIZED
2024-07-15 12:46:26                 $partition := $partition:string:SYNTHESIZED
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.452Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.94ms
2024-07-15 12:46:26 2024-07-15T19:46:26.461Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.57ms
2024-07-15 12:46:26 2024-07-15T19:46:26.462Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ Project[]
2024-07-15 12:46:26    │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26    └─ Project[]
2024-07-15 12:46:26       │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26       └─ Project[]
2024-07-15 12:46:26          │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26          └─ ScanProject[table = hudi:hudi_db.people]
2024-07-15 12:46:26                 Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26                 _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26                 _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26                 _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26                 _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26                 _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26                 id := id:int:REGULAR
2024-07-15 12:46:26                 name := name:string:REGULAR
2024-07-15 12:46:26                 age := age:int:REGULAR
2024-07-15 12:46:26                 create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26                 city := city:string:PARTITION_KEY
2024-07-15 12:46:26                 $path := $path:string:SYNTHESIZED
2024-07-15 12:46:26                 $file_size := $file_size:bigint:SYNTHESIZED
2024-07-15 12:46:26                 $file_modified_time := $file_modified_time:timestamp:SYNTHESIZED
2024-07-15 12:46:26                 $partition := $partition:string:SYNTHESIZED
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.463Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.PruneOutputSourceColumns
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 2]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ Project[]
2024-07-15 12:46:26    │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26    └─ GroupReference[groupId = 2]
2024-07-15 12:46:26           Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.467Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.PruneProjectColumns
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 2]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ Project[]
2024-07-15 12:46:26    │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26    └─ GroupReference[groupId = 3]
2024-07-15 12:46:26           Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.471Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.InlineProjections
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 8]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 3]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.471Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.PruneProjectColumns
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 3]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ Project[]
2024-07-15 12:46:26    │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26    └─ GroupReference[groupId = 4]
2024-07-15 12:46:26           Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.472Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.InlineProjections
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 9]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 4]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.473Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.PruneProjectColumns
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 4]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ Project[]
2024-07-15 12:46:26    │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26    └─ GroupReference[groupId = 5]
2024-07-15 12:46:26           Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.474Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.InlineProjections
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 10]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 5]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.475Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.PruneProjectColumns
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 5]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ Project[]
2024-07-15 12:46:26    │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26    └─ GroupReference[groupId = 6]
2024-07-15 12:46:26           Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.476Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.InlineProjections
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 11]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 6]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.486Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 8.15ms
2024-07-15 12:46:26 2024-07-15T19:46:26.495Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.63ms
2024-07-15 12:46:26 2024-07-15T19:46:26.496Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.PruneTableScanColumns
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 6]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar, $path:varchar, $file_size:bigint, $file_modified_time:timestamp(3) with time zone, $partition:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 ScanProject[table = hudi:hudi_db.people]
2024-07-15 12:46:26     Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26     _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26     _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26     _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26     _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26     _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26     id := id:int:REGULAR
2024-07-15 12:46:26     name := name:string:REGULAR
2024-07-15 12:46:26     age := age:int:REGULAR
2024-07-15 12:46:26     create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26     city := city:string:PARTITION_KEY
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.497Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.RemoveRedundantIdentityProjections
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 Project[]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ GroupReference[groupId = 12]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 GroupReference[groupId = 12]
2024-07-15 12:46:26     Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.505Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.68ms
2024-07-15 12:46:26 2024-07-15T19:46:26.506Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.514Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.44ms
2024-07-15 12:46:26 2024-07-15T19:46:26.515Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.523Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.83ms
2024-07-15 12:46:26 2024-07-15T19:46:26.524Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.535Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.44ms
2024-07-15 12:46:26 2024-07-15T19:46:26.536Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.UnaliasSymbolReferences:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.544Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.13ms
2024-07-15 12:46:26 2024-07-15T19:46:26.545Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.553Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.25ms
2024-07-15 12:46:26 2024-07-15T19:46:26.553Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.561Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.74ms
2024-07-15 12:46:26 2024-07-15T19:46:26.561Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.570Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.79ms
2024-07-15 12:46:26 2024-07-15T19:46:26.571Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.LimitPushDown:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.579Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.45ms
2024-07-15 12:46:26 2024-07-15T19:46:26.580Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.587Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.68ms
2024-07-15 12:46:26 2024-07-15T19:46:26.588Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.595Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.39ms
2024-07-15 12:46:26 2024-07-15T19:46:26.596Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.603Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.39ms
2024-07-15 12:46:26 2024-07-15T19:46:26.603Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.611Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.50ms
2024-07-15 12:46:26 2024-07-15T19:46:26.611Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.TransformQuantifiedComparisonApplyToCorrelatedJoin:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.619Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.23ms
2024-07-15 12:46:26 2024-07-15T19:46:26.620Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.627Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.76ms
2024-07-15 12:46:26 2024-07-15T19:46:26.628Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.635Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.00ms
2024-07-15 12:46:26 2024-07-15T19:46:26.636Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.643Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.45ms
2024-07-15 12:46:26 2024-07-15T19:46:26.644Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.CheckSubqueryNodesAreRewritten:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.651Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.16ms
2024-07-15 12:46:26 2024-07-15T19:46:26.651Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.665Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.02ms
2024-07-15 12:46:26 2024-07-15T19:46:26.666Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.StatsRecordingPlanOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.672Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.86ms
2024-07-15 12:46:26 2024-07-15T19:46:26.673Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.680Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.81ms
2024-07-15 12:46:26 2024-07-15T19:46:26.680Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.687Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.14ms
2024-07-15 12:46:26 2024-07-15T19:46:26.688Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.694Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.61ms
2024-07-15 12:46:26 2024-07-15T19:46:26.694Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.700Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.69ms
2024-07-15 12:46:26 2024-07-15T19:46:26.701Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.UnaliasSymbolReferences:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.707Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.94ms
2024-07-15 12:46:26 2024-07-15T19:46:26.708Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.715Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.01ms
2024-07-15 12:46:26 2024-07-15T19:46:26.715Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.727Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 11.22ms
2024-07-15 12:46:26 2024-07-15T19:46:26.727Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.735Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.33ms
2024-07-15 12:46:26 2024-07-15T19:46:26.736Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.742Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.78ms
2024-07-15 12:46:26 2024-07-15T19:46:26.743Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.750Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.33ms
2024-07-15 12:46:26 2024-07-15T19:46:26.750Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.757Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.08ms
2024-07-15 12:46:26 2024-07-15T19:46:26.757Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.764Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.19ms
2024-07-15 12:46:26 2024-07-15T19:46:26.765Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.StatsRecordingPlanOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.770Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.95ms
2024-07-15 12:46:26 2024-07-15T19:46:26.771Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.776Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.52ms
2024-07-15 12:46:26 2024-07-15T19:46:26.777Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.UnaliasSymbolReferences:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.783Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.76ms
2024-07-15 12:46:26 2024-07-15T19:46:26.784Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.792Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 7.04ms
2024-07-15 12:46:26 2024-07-15T19:46:26.792Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.IndexJoinOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.798Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.36ms
2024-07-15 12:46:26 2024-07-15T19:46:26.798Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.LimitPushDown:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.805Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.59ms
2024-07-15 12:46:26 2024-07-15T19:46:26.805Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.811Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.07ms
2024-07-15 12:46:26 2024-07-15T19:46:26.811Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.816Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.82ms
2024-07-15 12:46:26 2024-07-15T19:46:26.817Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.823Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.85ms
2024-07-15 12:46:26 2024-07-15T19:46:26.824Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.830Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.85ms
2024-07-15 12:46:26 2024-07-15T19:46:26.831Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.837Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.44ms
2024-07-15 12:46:26 2024-07-15T19:46:26.837Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.MetadataQueryOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.843Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.10ms
2024-07-15 12:46:26 2024-07-15T19:46:26.843Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.849Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.12ms
2024-07-15 12:46:26 2024-07-15T19:46:26.850Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.StatsRecordingPlanOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.856Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.57ms
2024-07-15 12:46:26 2024-07-15T19:46:26.856Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.862Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.43ms
2024-07-15 12:46:26 2024-07-15T19:46:26.863Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.869Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.76ms
2024-07-15 12:46:26 2024-07-15T19:46:26.870Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.StatsRecordingPlanOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.875Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.39ms
2024-07-15 12:46:26 2024-07-15T19:46:26.876Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.881Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.92ms
2024-07-15 12:46:26 2024-07-15T19:46:26.882Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.887Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.77ms
2024-07-15 12:46:26 2024-07-15T19:46:26.887Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.893Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.77ms
2024-07-15 12:46:26 2024-07-15T19:46:26.893Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.898Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.02ms
2024-07-15 12:46:26 2024-07-15T19:46:26.899Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.OptimizeMixedDistinctAggregations:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.905Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.17ms
2024-07-15 12:46:26 2024-07-15T19:46:26.905Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.911Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.68ms
2024-07-15 12:46:26 2024-07-15T19:46:26.911Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.919Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.10ms
2024-07-15 12:46:26 2024-07-15T19:46:26.925Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.49ms
2024-07-15 12:46:26 2024-07-15T19:46:26.925Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.iterative.IterativeOptimizer       Rule: io.trino.sql.planner.iterative.rule.DetermineTableScanNodePartitioning
2024-07-15 12:46:26 Before:
2024-07-15 12:46:26 TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26     Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26     _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26     _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26     city := city:string:PARTITION_KEY
2024-07-15 12:46:26     _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26     name := name:string:REGULAR
2024-07-15 12:46:26     create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26     _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26     id := id:int:REGULAR
2024-07-15 12:46:26     _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26     age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 After:
2024-07-15 12:46:26 TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26     Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26     _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26     _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26     city := city:string:PARTITION_KEY
2024-07-15 12:46:26     _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26     name := name:string:REGULAR
2024-07-15 12:46:26     create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26     _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26     id := id:int:REGULAR
2024-07-15 12:46:26     _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26     age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.931Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.82ms
2024-07-15 12:46:26 2024-07-15T19:46:26.931Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.936Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.82ms
2024-07-15 12:46:26 2024-07-15T19:46:26.937Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.942Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.91ms
2024-07-15 12:46:26 2024-07-15T19:46:26.943Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.948Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.96ms
2024-07-15 12:46:26 2024-07-15T19:46:26.948Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.954Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.15ms
2024-07-15 12:46:26 2024-07-15T19:46:26.955Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.960Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.17ms
2024-07-15 12:46:26 2024-07-15T19:46:26.961Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.UnaliasSymbolReferences:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.975Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.22ms
2024-07-15 12:46:26 2024-07-15T19:46:26.976Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.StatsRecordingPlanOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.982Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.90ms
2024-07-15 12:46:26 2024-07-15T19:46:26.982Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.StatsRecordingPlanOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.988Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.20ms
2024-07-15 12:46:26 2024-07-15T19:46:26.989Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:26 2024-07-15T19:46:26.994Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.39ms
2024-07-15 12:46:26 2024-07-15T19:46:26.995Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.StatsRecordingPlanOptimizer:
2024-07-15 12:46:26 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:26 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:26        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:26        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:26        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:26        city := city:string:PARTITION_KEY
2024-07-15 12:46:26        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:26        name := name:string:REGULAR
2024-07-15 12:46:26        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:26        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:26        id := id:int:REGULAR
2024-07-15 12:46:26        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:26        age := age:int:REGULAR
2024-07-15 12:46:26 
2024-07-15 12:46:27 2024-07-15T19:46:27.000Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.93ms
2024-07-15 12:46:27 2024-07-15T19:46:27.001Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.006Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.71ms
2024-07-15 12:46:27 2024-07-15T19:46:27.006Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.016Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 9.51ms
2024-07-15 12:46:27 2024-07-15T19:46:27.017Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.022Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.67ms
2024-07-15 12:46:27 2024-07-15T19:46:27.022Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.StatsRecordingPlanOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.029Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.83ms
2024-07-15 12:46:27 2024-07-15T19:46:27.029Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.rule.RemoveUnsupportedDynamicFilters:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.034Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.64ms
2024-07-15 12:46:27 2024-07-15T19:46:27.035Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.040Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.60ms
2024-07-15 12:46:27 2024-07-15T19:46:27.040Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.046Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.03ms
2024-07-15 12:46:27 2024-07-15T19:46:27.046Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.UnaliasSymbolReferences:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.052Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.28ms
2024-07-15 12:46:27 2024-07-15T19:46:27.052Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.058Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.40ms
2024-07-15 12:46:27 2024-07-15T19:46:27.058Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.068Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.80ms
2024-07-15 12:46:27 2024-07-15T19:46:27.068Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.AddLocalExchanges:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.074Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.96ms
2024-07-15 12:46:27 2024-07-15T19:46:27.074Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.079Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.78ms
2024-07-15 12:46:27 2024-07-15T19:46:27.080Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.086Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.85ms
2024-07-15 12:46:27 2024-07-15T19:46:27.087Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.093Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.74ms
2024-07-15 12:46:27 2024-07-15T19:46:27.094Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.102Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.68ms
2024-07-15 12:46:27 2024-07-15T19:46:27.103Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.HashGenerationOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.108Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.73ms
2024-07-15 12:46:27 2024-07-15T19:46:27.108Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.IterativeOptimizer:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.113Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.64ms
2024-07-15 12:46:27 2024-07-15T19:46:27.114Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.iterative.rule.RemoveUnsupportedDynamicFilters:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.119Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.64ms
2024-07-15 12:46:27 2024-07-15T19:46:27.120Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.sql.planner.LogicalPlanner     io.trino.sql.planner.optimizations.BeginTableWrite:
2024-07-15 12:46:27 Output[columnNames = [_hoodie_commit_time, _hoodie_commit_seqno, _hoodie_record_key, _hoodie_partition_path, _hoodie_file_name, id, name, age, create_ts, city]]
2024-07-15 12:46:27 │   Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27 └─ TableScan[table = hudi:hudi_db.people]
2024-07-15 12:46:27        Layout: [_hoodie_commit_time:varchar, _hoodie_commit_seqno:varchar, _hoodie_record_key:varchar, _hoodie_partition_path:varchar, _hoodie_file_name:varchar, id:integer, name:varchar, age:integer, create_ts:varchar, city:varchar]
2024-07-15 12:46:27        _hoodie_commit_time := _hoodie_commit_time:string:REGULAR
2024-07-15 12:46:27        _hoodie_partition_path := _hoodie_partition_path:string:REGULAR
2024-07-15 12:46:27        city := city:string:PARTITION_KEY
2024-07-15 12:46:27        _hoodie_record_key := _hoodie_record_key:string:REGULAR
2024-07-15 12:46:27        name := name:string:REGULAR
2024-07-15 12:46:27        create_ts := create_ts:string:REGULAR
2024-07-15 12:46:27        _hoodie_commit_seqno := _hoodie_commit_seqno:string:REGULAR
2024-07-15 12:46:27        id := id:int:REGULAR
2024-07-15 12:46:27        _hoodie_file_name := _hoodie_file_name:string:REGULAR
2024-07-15 12:46:27        age := age:int:REGULAR
2024-07-15 12:46:27 
2024-07-15 12:46:27 2024-07-15T19:46:27.134Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.45ms
2024-07-15 12:46:27 2024-07-15T19:46:27.147Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 5.47ms
2024-07-15 12:46:27 2024-07-15T19:46:27.156Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.73ms
2024-07-15 12:46:27 2024-07-15T19:46:27.159Z    DEBUG   dispatcher-query-4      io.trino.execution.StageStateMachine    Stage 20240715_194625_00000_23mm5.0 is PLANNED
2024-07-15 12:46:27 2024-07-15T19:46:27.161Z    DEBUG   dispatcher-query-4      io.trino.execution.QueryStateMachine    Query 20240715_194625_00000_23mm5 is STARTING
2024-07-15 12:46:27 2024-07-15T19:46:27.164Z    DEBUG   stage-scheduler io.trino.execution.scheduler.PipelinedStageExecution    Pipelined stage execution 20240715_194625_00000_23mm5.0 is PLANNED
2024-07-15 12:46:27 2024-07-15T19:46:27.173Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 6.29ms
2024-07-15 12:46:27 2024-07-15T19:46:27.179Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getTableReq(req=GetTableRequest(dbName:hudi_db, tblName:people, capabilities:ClientCapabilities(values:[INSERT_ONLY_TABLES]))) succeeded in 4.63ms
2024-07-15 12:46:27 2024-07-15T19:46:27.190Z    INFO    Query-20240715_194625_00000_23mm5-187   org.apache.hudi.common.table.HoodieTableMetaClient      Loading HoodieTableMetaClient from s3a://warehouse/people
2024-07-15 12:46:27 2024-07-15T19:46:27.207Z    INFO    Query-20240715_194625_00000_23mm5-187   org.apache.hudi.common.table.HoodieTableConfig  Loading table properties from s3a://warehouse/people/.hoodie/hoodie.properties
2024-07-15 12:46:27 2024-07-15T19:46:27.212Z    INFO    Query-20240715_194625_00000_23mm5-187   org.apache.hudi.common.table.HoodieTableMetaClient      Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from s3a://warehouse/people
2024-07-15 12:46:27 2024-07-15T19:46:27.225Z    INFO    Query-20240715_194625_00000_23mm5-187   org.apache.hudi.common.table.timeline.HoodieActiveTimeline      Loaded instants upto : Option{val=[20240715194105692__replacecommit__COMPLETED]}
2024-07-15 12:46:27 2024-07-15T19:46:27.226Z    INFO    Query-20240715_194625_00000_23mm5-187   org.apache.hudi.common.table.view.FileSystemViewManager Creating InMemory based view for basePath s3a://warehouse/people
2024-07-15 12:46:27 2024-07-15T19:46:27.241Z    INFO    Query-20240715_194625_00000_23mm5-187   org.apache.hudi.common.table.view.AbstractTableFileSystemView   Took 14 ms to read  1 instants, 0 replaced file groups
2024-07-15 12:46:27 2024-07-15T19:46:27.243Z    INFO    Query-20240715_194625_00000_23mm5-187   org.apache.hudi.common.util.ClusteringUtils     Found 0 files in pending clustering operations
2024-07-15 12:46:27 2024-07-15T19:46:27.261Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     selectedForExecution: [PipelinedStageStateMachine{stageId=20240715_194625_00000_23mm5.0, state=PLANNED}]
2024-07-15 12:46:27 2024-07-15T19:46:27.262Z    DEBUG   Query-20240715_194625_00000_23mm5-187   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     fragmentDependency: isDirected: true, allowsSelfLoops: false, nodes: [0], edges: [], fragmentTopology: isDirected: true, allowsSelfLoops: false, nodes: [0], edges: [], sortedFragments: [0], stagesByFragmentId: {0=PipelinedStageStateMachine{stageId=20240715_194625_00000_23mm5.0, state=PLANNED}}
2024-07-15 12:46:27 2024-07-15T19:46:27.264Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     scheduledStages: []
2024-07-15 12:46:27 2024-07-15T19:46:27.265Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     blockedFragments: []
2024-07-15 12:46:27 2024-07-15T19:46:27.265Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     selectedForExecution: []
2024-07-15 12:46:27 2024-07-15T19:46:27.265Z    DEBUG   hudi-split-manager-0    io.trino.plugin.hive.metastore.thrift.ThriftHiveMetastoreClient Invocation of getPartitionNames(db_name='hudi_db', tbl_name='people', max_parts=-1) succeeded in 15.61ms
2024-07-15 12:46:27 2024-07-15T19:46:27.265Z    DEBUG   stage-scheduler io.trino.execution.scheduler.PipelinedStageExecution    Pipelined stage execution 20240715_194625_00000_23mm5.0 is SCHEDULING
2024-07-15 12:46:27 2024-07-15T19:46:27.269Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.SourcePartitionedScheduler stage id: 20240715_194625_00000_23mm5.0, node: 0; blocked on next split batch
2024-07-15 12:46:27 2024-07-15T19:46:27.270Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.SourcePartitionedScheduler stage id: 20240715_194625_00000_23mm5.0, node: 0; assigned 0 splits (blocked reason WAITING_FOR_SOURCE)
2024-07-15 12:46:27 2024-07-15T19:46:27.270Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     scheduledStages: []
2024-07-15 12:46:27 2024-07-15T19:46:27.270Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     blockedFragments: []
2024-07-15 12:46:27 2024-07-15T19:46:27.270Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     selectedForExecution: []
2024-07-15 12:46:27 2024-07-15T19:46:27.270Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.SourcePartitionedScheduler stage id: 20240715_194625_00000_23mm5.0, node: 0; transitioning to SPLITS_SCHEDULED
2024-07-15 12:46:27 2024-07-15T19:46:27.273Z    DEBUG   dispatcher-query-4      io.trino.execution.StageStateMachine    Stage 20240715_194625_00000_23mm5.0 is SCHEDULING
2024-07-15 12:46:27 2024-07-15T19:46:27.280Z    DEBUG   dispatcher-query-4      io.trino.execution.StageStateMachine    Stage 20240715_194625_00000_23mm5.0 is RUNNING
2024-07-15 12:46:27 2024-07-15T19:46:27.282Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.SourcePartitionedScheduler stage id: 20240715_194625_00000_23mm5.0, node: 0; transitioning to FINISHED
2024-07-15 12:46:27 2024-07-15T19:46:27.283Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     scheduledStages: [PipelinedStageStateMachine{stageId=20240715_194625_00000_23mm5.0, state=SCHEDULED}]
2024-07-15 12:46:27 2024-07-15T19:46:27.283Z    DEBUG   stage-scheduler io.trino.execution.scheduler.PipelinedStageExecution    Pipelined stage execution 20240715_194625_00000_23mm5.0 is SCHEDULED
2024-07-15 12:46:27 2024-07-15T19:46:27.283Z    DEBUG   dispatcher-query-1      io.trino.execution.QueryStateMachine    Query 20240715_194625_00000_23mm5 is RUNNING
2024-07-15 12:46:27 2024-07-15T19:46:27.320Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     blockedFragments: []
2024-07-15 12:46:27 2024-07-15T19:46:27.320Z    DEBUG   Query-20240715_194625_00000_23mm5-198   io.trino.execution.scheduler.policy.PhasedExecutionSchedule     selectedForExecution: []
2024-07-15 12:46:27 2024-07-15T19:46:27.325Z    DEBUG   task-notification-0     io.trino.execution.TaskStateMachine     Task 20240715_194625_00000_23mm5.0.0.0 is RUNNING
2024-07-15 12:46:27 2024-07-15T19:46:27.422Z    DEBUG   Task-20240715_194625_00000_23mm5.0.0.0-140      io.trino.execution.executor.TaskExecutor        Task scheduled 20240715_194625_00000_23mm5.0.0.0
2024-07-15 12:46:27 2024-07-15T19:46:27.433Z    DEBUG   stage-scheduler io.trino.execution.scheduler.PipelinedStageExecution    Pipelined stage execution 20240715_194625_00000_23mm5.0 is RUNNING
2024-07-15 12:46:27 2024-07-15T19:46:27.437Z    DEBUG   20240715_194625_00000_23mm5.0.0.0-0-92  io.trino.execution.executor.TaskExecutor        Split 20240715_194625_00000_23mm5.0.0.0-0 io.trino.split.EmptySplit@55918216 (start = 1.03319404799098E8, wall = 11 ms, cpu = 8 ms, wait = 0 ms, calls = 1) is finished
2024-07-15 12:46:27 2024-07-15T19:46:27.439Z    DEBUG   task-notification-4     io.trino.execution.TaskStateMachine     Task 20240715_194625_00000_23mm5.0.0.0 is FLUSHING
2024-07-15 12:46:27 2024-07-15T19:46:27.443Z    DEBUG   http-worker-184 io.trino.execution.SqlTask      Aborting task 20240715_194625_00000_23mm5.0.0.0 output 0
2024-07-15 12:46:27 2024-07-15T19:46:27.443Z    DEBUG   task-notification-1     io.trino.execution.TaskStateMachine     Task 20240715_194625_00000_23mm5.0.0.0 is FINISHED
2024-07-15 12:46:27 2024-07-15T19:46:27.444Z    DEBUG   stage-scheduler io.trino.execution.scheduler.PipelinedStageExecution    Pipelined stage execution 20240715_194625_00000_23mm5.0 is FLUSHING
2024-07-15 12:46:27 2024-07-15T19:46:27.445Z    DEBUG   Task-20240715_194625_00000_23mm5.0.0.0-208      io.trino.execution.executor.TaskExecutor        Task finished or failed 20240715_194625_00000_23mm5.0.0.0
2024-07-15 12:46:27 2024-07-15T19:46:27.448Z    DEBUG   dispatcher-query-0      io.trino.execution.StageStateMachine    Stage 20240715_194625_00000_23mm5.0 is PENDING
2024-07-15 12:46:27 2024-07-15T19:46:27.448Z    DEBUG   stage-scheduler io.trino.execution.scheduler.PipelinedStageExecution    Pipelined stage execution 20240715_194625_00000_23mm5.0 is FINISHED
2024-07-15 12:46:27 2024-07-15T19:46:27.448Z    DEBUG   dispatcher-query-0      io.trino.execution.StageStateMachine    Stage 20240715_194625_00000_23mm5.0 is FINISHED
2024-07-15 12:46:27 2024-07-15T19:46:27.449Z    DEBUG   dispatcher-query-0      io.trino.execution.QueryStateMachine    Query 20240715_194625_00000_23mm5 is FINISHING
2024-07-15 12:46:27 2024-07-15T19:46:27.455Z    DEBUG   dispatcher-query-0      io.trino.execution.QueryStateMachine    Query 20240715_194625_00000_23mm5 is FINISHED
2024-07-15 12:46:27 2024-07-15T19:46:27.466Z    INFO    dispatcher-query-4      io.trino.event.QueryMonitor     TIMELINE: Query 20240715_194625_00000_23mm5 :: FINISHED :: elapsed 1710ms :: planning 803ms :: waiting 607ms :: scheduling 887ms :: running 8ms :: finishing 12ms :: begin 2024-07-15T19:46:25.745Z :: end 2024-07-15T19:46:27.455Z

@alberttwong
Copy link
Contributor Author

Comment from @yihua

Trino 418 depends on Hudi 0.12.3 while Iceberg table with Hudi metadata requires Hudi 0.14.0+ so Trino 418 does not work in your use case.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants