[ https://issues.apache.org/jira/browse/TEZ-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mustafa Iman reassigned TEZ-3420: --------------------------------- Assignee: Mustafa Iman (was: Richard Zhang) > Parallel queries to HS2/Tez not thread safe (local mode) > -------------------------------------------------------- > > Key: TEZ-3420 > URL: https://issues.apache.org/jira/browse/TEZ-3420 > Project: Apache Tez > Issue Type: Bug > Affects Versions: 0.8.4 > Environment: HiveServer2 1.2.1 Local mode + Tez > Reporter: Uday Chitragar > Assignee: Mustafa Iman > Priority: Major > Attachments: hive.log.submit.gz > > > When running parallel queries (simultaneous connections by two beeline > clients to HS2), I get the following exception (full debug attached), > interestingly running the queries one after the other completes without any > problem. The partition location and actual files seem to get mixed up across > the DAGS > > The setup is Hive (1.2.1) and Tez (0.8.4) running in local mode. > {noformat} > 2016-08-25 15:45:41,333 DEBUG > [TezTaskEventRouter{attempt_1472136335089_0001_1_01_000000_0}]: > impl.ShuffleInputEventHandlerImpl > (ShuffleInputEventHandlerImpl.java:processDataMovementEvent(127)) - DME > srcIdx: 0, targetIndex: 9, attemptNum > : 0, payload: [hasEmptyPartitions: true, host: , port: 0, pathComponent: , > runDuration: 0] > 2016-08-25 15:45:41,557 ERROR [TezChild]: tez.MapRecordSource > (MapRecordSource.java:processRow(90)) - java.lang.IllegalStateException: > Invalid input path > file:/acorn/QC/OraExtract/20160131/Devices/Devices_extract_20160229T080613_3 > at > org.apache.hadoop.hive.ql.exec.MapOperator.getNominalPath(MapOperator.java:415) > at > org.apache.hadoop.hive.ql.exec.MapOperator.cleanUpInputFileChangedOp(MapOperator.java:457) > at > org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1069) > at > org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:501) > > > > 2016-08-25 15:45:41,817 INFO [TezChild]: io.HiveContextAwareRecordReader > (HiveContextAwareRecordReader.java:doNext(326)) – > Cannot get partition description from > file:/acorn/QC/reportlib/VM_ValEdit.24656because cannot find dir = file:/ac > orn/QC/reportlib/VM_ValEdit.24656 in pathToPartitionInfo: > [file:/acorn/QC/OraExtract/20160131/Devices] > {noformat} > Perhaps clashing directories for intermediate data might be causing an issue? -- This message was sent by Atlassian Jira (v8.3.4#803005)