[ https://issues.apache.org/jira/browse/IMPALA-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998859#comment-16998859 ]
authur wang commented on IMPALA-9258: ------------------------------------- this is our query info: 0: jdbc:hive2://wg3232.hadoop.com:10000/defau> select count(*) from gl_hisdb.tbl_chhis_accqr_transaction_inf where hp_settle_dt = '20190815'; INFO : Compiling command(queryId=hive_20191218141818_434572dc-0796-4619-b489-525602cd7625): select count(*) from gl_hisdb.tbl_chhis_accqr_transaction_inf where hp_settle_dt = '20190815' INFO : Semantic Analysis Completed INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_c0, type:bigint, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20191218141818_434572dc-0796-4619-b489-525602cd7625); Time taken: 0.256 seconds INFO : Executing command(queryId=hive_20191218141818_434572dc-0796-4619-b489-525602cd7625): select count(*) from gl_hisdb.tbl_chhis_accqr_transaction_inf where hp_settle_dt = '20190815' WARN : INFO : Query ID = hive_20191218141818_434572dc-0796-4619-b489-525602cd7625 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Number of reduce tasks determined at compile time: 1 INFO : In order to change the average load for a reducer (in bytes): INFO : set hive.exec.reducers.bytes.per.reducer=<number> INFO : In order to limit the maximum number of reducers: INFO : set hive.exec.reducers.max=<number> INFO : In order to set a constant number of reducers: INFO : set mapreduce.job.reduces=<number> INFO : number of splits:1 INFO : Submitting tokens for job: job_1576632415577_0011 INFO : Executing with tokens: [Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:ns4, Ident: (token for hive: HDFS_DELEGATION_TOKEN owner=hive/wg3232.hadoop....@cvbg.com, renewer=yarn, realUser=, issueDate=1576649898477, maxDate=1577254698477, sequenceNumber=5304183, masterKeyId=49)] INFO : The url to track the job: http://wg3226.hadoop.com:8088/proxy/application_1576632415577_0011/ INFO : Starting Job = job_1576632415577_0011, Tracking URL = http://wg3226.hadoop.com:8088/proxy/application_1576632415577_0011/ INFO : Kill Command = /opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/hadoop/bin/hadoop job -kill job_1576632415577_0011 INFO : Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1 INFO : 2019-12-18 14:18:27,282 Stage-1 map = 0%, reduce = 0% INFO : 2019-12-18 14:18:35,449 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 2.19 sec INFO : 2019-12-18 14:18:41,573 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 4.65 sec INFO : MapReduce Total cumulative CPU time: 4 seconds 650 msec INFO : Ended Job = job_1576632415577_0011 INFO : MapReduce Jobs Launched: INFO : Stage-Stage-1: Map: 1 Reduce: 1 Cumulative CPU: 4.65 sec HDFS Read: 14570 HDFS Write: 104 HDFS EC Read: 0 SUCCESS INFO : Total MapReduce CPU Time Spent: 4 seconds 650 msec INFO : Completed executing command(queryId=hive_20191218141818_434572dc-0796-4619-b489-525602cd7625); Time taken: 24.31 seconds INFO : OK +-------+ | _c0 | +-------+ | 1309 | +-------+ 1 row selected (24.616 seconds) 0: jdbc:hive2://wg3232.hadoop.com:10000/defau> 0: jdbc:hive2://wg3232.hadoop.com:21050/defau> select count(*) from gl_hisdb.tbl_chhis_accqr_transaction_inf where hp_settle_dt = '20190815'; 0 +-----------+ | count(*) | +-----------+ +-----------+ No rows selected (0.046 seconds) 0: jdbc:hive2://wg3232.hadoop.com:21050/defau> > impala and hive query result are different > ------------------------------------------- > > Key: IMPALA-9258 > URL: https://issues.apache.org/jira/browse/IMPALA-9258 > Project: IMPALA > Issue Type: Bug > Components: Clients > Affects Versions: Impala 3.2.0 > Environment: CDH6.2.1 > Reporter: authur wang > Priority: Major > Labels: newbie > Attachments: user_inf.zip > > > After we use mapreduce to generate rcfiles, we find that the results between > hive and impala are different. The hive query will generate the right result > while impala will get wrong result. > > the attachment is the data files. > > the ddl of the table is : > CREATE EXTERNAL TABLE user_inf ( > id BIGINT, > user_id STRING, > cert_id STRING, > name STRING, > mobile STRING, > access_id STRING, > status STRING, > channel STRING, > rec_crt_ts STRING, > rec_upd_ts STRING, > ver INT > ) > STORED AS RCFILE > LOCATION '/user_inf' -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org