[
https://issues.apache.org/jira/browse/OOZIE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060874#comment-15060874
]
Rohini Palaniswamy commented on OOZIE-2380:
-------------------------------------------
bq. I created an internal jira for our hadoop team leaving it to them to create
the Apache one. Will create an Apache one as well and link it to that jira.
Found that they already filed the jira and fixed it in Hadoop 2.7.2. It is
MAPREDUCE-6472.
So it would also be good to make it as a server level configurable setting in
Oozie to set java.io.tmpdir to ./tmp instead of doing it always. It can either
- be false by default and folks having versions < Hadoop 2.7.2 can turn it
on.
- be true by default and folks having Hadoop 2.7.2+ can turn it off. Can make
it false by default in future release of Oozie after Hadoop 2.7 is widely
adopted.
[~rkanter], thoughts? I don't have a preference for either. Do you have any
idea on the general hadoop 2.x version in wide adoption?
> Oozie Hive action failed with wrong tmp path
> --------------------------------------------
>
> Key: OOZIE-2380
> URL: https://issues.apache.org/jira/browse/OOZIE-2380
> Project: Oozie
> Issue Type: Bug
> Components: core
> Affects Versions: 4.2.0
> Reporter: Sergey Svinarchuk
> Assignee: Sergey Svinarchuk
> Labels: patch
> Fix For: trunk
>
> Attachments: OOZIE-2380-1.patch
>
>
> Hive action with command "show tables" or "show databases" failed
> {code}
> 22257 [uber-SubtaskRunner] ERROR org.apache.hadoop.hive.ql.Driver - FAILED:
> IllegalArgumentException java.net.URISyntaxException: Relative path in
> absolute URI:
> file:./tmp/mapr/b79b1ef5-c8a4-4da9-a307-b4f9045c7bb9/hive_2015-10-01_11-30$
> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative
> path in absolute URI:
> file:./tmp/mapr/b79b1ef5-c8a4-4da9-a307-b4f9045c7bb9/hive_2015-10-01_11-30-46_978_7012892802177357645-1
> at org.apache.hadoop.fs.Path.initialize(Path.java:217)
> at org.apache.hadoop.fs.Path.<init>(Path.java:208)
> at org.apache.hadoop.hive.ql.Context.getScratchDir(Context.java:284)
> at
> org.apache.hadoop.hive.ql.Context.getLocalScratchDir(Context.java:319)
> at org.apache.hadoop.hive.ql.Context.getLocalTmpPath(Context.java:414)
> at
> org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:337)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122)
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:311)
> at
> org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:409)
> at
> org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:425)
> at
> org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:714)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
> at org.apache.oozie.action.hadoop.HiveMain.runHive(HiveMain.java:306)
> at org.apache.oozie.action.hadoop.HiveMain.run(HiveMain.java:290)
> at
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:47)
> at org.apache.oozie.action.hadoop.HiveMain.main(HiveMain.java:68)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:230)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:458)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:348)
> at
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370)
> at
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295)
> at
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181)
> at
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.net.URISyntaxException: Relative path in absolute URI:
> file:./tmp/mapr/b79b1ef5-c8a4-4da9-a307-b4f9045c7bb9/hive_2015-10-01_11-30-46_978_7012892802177357645-1
> at java.net.URI.checkPath(URI.java:1804)
> at java.net.URI.<init>(URI.java:752)
> at org.apache.hadoop.fs.Path.initialize(Path.java:214)
> ... 42 more
> 22257 [uber-SubtaskRunner] INFO org.apache.hadoop.hive.ql.log.PerfLogger -
> </PERFLOG method=compile start=1443688246930 end=1443688247907 duration=977
> from=org.apache.hadoop.hive.ql.Driver>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
