[jira] [Created] (HIVE-29232) set hive.exec.parallel=true; 引发同一个sql，并行stage的map.xml文件路径重复，导致任务偶现出错

[lkl (Jira)]

lkl created HIVE-29232:
--------------------------

             Summary: set hive.exec.parallel=true; 
引发同一个sql，并行stage的map.xml文件路径重复，导致任务偶现出错
                 Key: HIVE-29232
                 URL: https://issues.apache.org/jira/browse/HIVE-29232
             Project: Hive
          Issue Type: Bug
          Components: Query Planning
    Affects Versions: 4.0.1, 3.1.3, 2.3.7
         Environment: protected int pathId=10000

 

改成

 

protected AtomicInteger pathid = new AtomicInteger(10000);
            Reporter: lkl
             Fix For: 4.0.1
         Attachments: 111.png

int pathId=10000

 

public Path getMRTmpPath() {

return new Path(getMRScratchDir(), MR_PREFIX + nextPathId());

}

 

// 这段代码在并发执行时可能出现返回值一样的情况

private String nextPathId() {

return Integer.toString(pathid++);

}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)