anvanna commented on issue #8891:
URL: https://github.com/apache/iceberg/issues/8891#issuecomment-1774003254
@pvary i think the insert is ok as below:
0: jdbc:hive2://hadoop-maste:2> insert into table_g values (300, 'iceberg');
INFO : Compiling
command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b):
insert into table_g values (300, 'iceberg')
INFO : Semantic Analysis Completed (retrial = false)
INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0,
type:bigint, comment:null), FieldSchema(name:_col1, type:string,
comment:null)], properties:null)
INFO : Completed compiling
command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b); Time
taken: 1.609 seconds
INFO : Executing
command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b):
insert into table_g values (300, 'iceberg')
INFO : Query ID = hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b
INFO : Total jobs = 1
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Starting task [Stage-1:DDL] in serial mode
INFO : Launching Job 1 out of 1
INFO : Starting task [Stage-2:MAPRED] in serial mode
INFO : Subscribed to counters: [] for queryId:
hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b
INFO : Tez session hasn't been created yet. Opening session
INFO : Dag name: insert into table_g values (300, 'iceberg') (Stage-2)
INFO : Status: Running (Executing on YARN cluster with App id
application_1697615344511_0012)
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 .......... container SUCCEEDED 1 1 0 0
0 0
----------------------------------------------------------------------------------------------
VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 4.55 s
----------------------------------------------------------------------------------------------
INFO : Status: DAG finished successfully in 4.50 seconds
INFO :
INFO : Query Execution Summary
INFO :
----------------------------------------------------------------------------------------------
INFO : OPERATION DURATION
INFO :
----------------------------------------------------------------------------------------------
INFO : Compile Query 1.61s
INFO : Prepare Plan 3.99s
INFO : Get Query Coordinator (AM) 0.00s
INFO : Submit Plan 0.49s
INFO : Start DAG 0.58s
INFO : Run DAG 4.50s
INFO :
----------------------------------------------------------------------------------------------
INFO :
INFO : Task Execution Summary
INFO :
----------------------------------------------------------------------------------------------
INFO : VERTICES DURATION(ms) CPU_TIME(ms) GC_TIME(ms)
INPUT_RECORDS OUTPUT_RECORDS
INFO :
----------------------------------------------------------------------------------------------
INFO : Map 1 2479.00 7,560 129
3 0
INFO :
----------------------------------------------------------------------------------------------
INFO :
INFO : org.apache.tez.common.counters.DAGCounter:
INFO : NUM_SUCCEEDED_TASKS: 1
INFO : TOTAL_LAUNCHED_TASKS: 1
INFO : DATA_LOCAL_TASKS: 1
INFO : AM_CPU_MILLISECONDS: 2580
INFO : AM_GC_TIME_MILLIS: 21
INFO : File System Counters:
INFO : HDFS_BYTES_WRITTEN: 701
INFO : HDFS_WRITE_OPS: 1
INFO : HDFS_OP_CREATE: 1
INFO : org.apache.tez.common.counters.TaskCounter:
INFO : GC_TIME_MILLIS: 129
INFO : TASK_DURATION_MILLIS: 2602
INFO : CPU_MILLISECONDS: 7560
INFO : PHYSICAL_MEMORY_BYTES: 859832320
INFO : VIRTUAL_MEMORY_BYTES: 2864087040
INFO : COMMITTED_HEAP_BYTES: 859832320
INFO : INPUT_RECORDS_PROCESSED: 4
INFO : INPUT_SPLIT_LENGTH_BYTES: 1
INFO : OUTPUT_RECORDS: 0
INFO : HIVE:
INFO : CREATED_FILES: 1
INFO : DESERIALIZE_ERRORS: 0
INFO : RECORDS_IN_Map_1: 3
INFO : RECORDS_OUT_1_default.table_g: 1
INFO : RECORDS_OUT_INTERMEDIATE_Map_1: 0
INFO : RECORDS_OUT_OPERATOR_FS_5: 1
INFO : RECORDS_OUT_OPERATOR_MAP_0: 0
INFO : RECORDS_OUT_OPERATOR_SEL_1: 1
INFO : RECORDS_OUT_OPERATOR_SEL_3: 1
INFO : RECORDS_OUT_OPERATOR_TS_0: 1
INFO : RECORDS_OUT_OPERATOR_UDTF_2: 1
INFO : TaskCounter_Map_1_INPUT__dummy_table:
INFO : INPUT_RECORDS_PROCESSED: 4
INFO : INPUT_SPLIT_LENGTH_BYTES: 1
INFO : TaskCounter_Map_1_OUTPUT_out_Map_1:
INFO : OUTPUT_RECORDS: 0
INFO : Starting task [Stage-4:DDL] in serial mode
INFO : Completed executing
command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b); Time
taken: 9.566 seconds
INFO : OK
No rows affected (11.23 seconds)
2. and the parquet files & .metadata.json was created
[hdfs@hadoop-master ~]$ hdfs dfs -ls
/user/hive/warehouse/default/table_g/dataFound 3 items-rw-r--r-- 3 hive hdfs
673 2023-10-20 16:56
/user/hive/warehouse/default/table_g/data/00000-0-hive_20231020165640_da5c38e9-b556-4e7f-b125-156e0d0b5679-job_1697615344511_0005-00001.parquet-rw-r--r--
3 hive hdfs 673 2023-10-20 17:38
/user/hive/warehouse/default/table_g/data/00000-0-hive_20231020173840_17952753-a875-42a5-b572-979c08249888-job_1697615344511_0011-00001.parquet-rw-r--r--
3 hive hdfs 701 2023-10-22 12:48
/user/hive/warehouse/default/table_g/data/00000-0-hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b-job_1697615344511_0012-00001.parquet[hdfs@hadoop-master
~]$ hdfs dfs -ls /user/hive/warehouse/default/table_g/metadataFound 1
items-rw-r--r-- 3 hive hdfs 1357 2023-10-20 16:55
/user/hive/warehouse/default/table_g/metadata/00000-c64d7b49-d2c6-4cf5-b4b1-0d75a3fb98c6.metadata.json
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
