[jira] [Commented] (OOZIE-3326) Sqoop Action should support tez delegation tokens for hive-import
[ https://issues.apache.org/jira/browse/OOZIE-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770834#comment-16770834 ] Denes Bodo commented on OOZIE-3326: --- I managed to fix the issue found by findbugs and updated the patches. Unfortunately I cannot see any review on review board. Have you pushed the "publish" button? > Sqoop Action should support tez delegation tokens for hive-import > - > > Key: OOZIE-3326 > URL: https://issues.apache.org/jira/browse/OOZIE-3326 > Project: Oozie > Issue Type: Bug > Components: action >Reporter: Brian Goerlitz >Assignee: Brian Goerlitz >Priority: Major > Attachments: OOZIE-3326_003.patch, OOZIE-3326_004.patch, > OOZIE-3326_005.patch, OZIE-3326_001.patch, OZIE-3326_002.patch > > > SqoopMain needs to support tez delegation tokens for hive-imports. > Implementation is similar to that of HiveMain and Hive2Main. > At present, hive-import will fail to start a tez session in secure > environment. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (94 issues) Subscriber: ooziedaily Key Summary OOZIE-3432 When use configuration oozie.service.ProxyUserService.root.hosts, oozie-error.log shows Invalid configuration defined https://issues.apache.org/jira/browse/OOZIE-3432 OOZIE-3418 Upgrade to Guava 27 https://issues.apache.org/jira/browse/OOZIE-3418 OOZIE-3409 Oozie Server : Memory leak in EL evaluation https://issues.apache.org/jira/browse/OOZIE-3409 OOZIE-3404 The env variable of SPARK_HOME needs to be set when running pySpark https://issues.apache.org/jira/browse/OOZIE-3404 OOZIE-3395 Findbugs is no longer maintained https://issues.apache.org/jira/browse/OOZIE-3395 OOZIE-3375 Can't use empty in coordinator https://issues.apache.org/jira/browse/OOZIE-3375 OOZIE-3367 Using && in EL expressions in oozie bundle.xml files generates parse errors https://issues.apache.org/jira/browse/OOZIE-3367 OOZIE-3366 Update workflow status and subworkflow status on suspend command https://issues.apache.org/jira/browse/OOZIE-3366 OOZIE-3364 Rerunning Oozie bundle jobs starts the coordinators in indeterminate order https://issues.apache.org/jira/browse/OOZIE-3364 OOZIE-3362 When killed, SSH action should kill the spawned processes on target host https://issues.apache.org/jira/browse/OOZIE-3362 OOZIE-3326 Sqoop Action should support tez delegation tokens for hive-import https://issues.apache.org/jira/browse/OOZIE-3326 OOZIE-3320 Oozie ShellAction should support absolute bash file path https://issues.apache.org/jira/browse/OOZIE-3320 OOZIE-3319 Log SSH action callback error output https://issues.apache.org/jira/browse/OOZIE-3319 OOZIE-3301 Update NOTICE file https://issues.apache.org/jira/browse/OOZIE-3301 OOZIE-3274 Remove slf4j https://issues.apache.org/jira/browse/OOZIE-3274 OOZIE-3266 Coord action rerun support RERUN_SKIP_NODES option https://issues.apache.org/jira/browse/OOZIE-3266 OOZIE-3265 properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to appear together https://issues.apache.org/jira/browse/OOZIE-3265 OOZIE-3261 Set up mvn clean to delete the "build" directory as well https://issues.apache.org/jira/browse/OOZIE-3261 OOZIE-3256 refactor OozieCLI class https://issues.apache.org/jira/browse/OOZIE-3256 OOZIE-3249 [tools] Instrumentation log parser https://issues.apache.org/jira/browse/OOZIE-3249 OOZIE-3199 Let system property restriction configurable https://issues.apache.org/jira/browse/OOZIE-3199 OOZIE-3196 Authorization: restrict world readability by user https://issues.apache.org/jira/browse/OOZIE-3196 OOZIE-3179 Adding a configurable config-default.xml location to a workflow https://issues.apache.org/jira/browse/OOZIE-3179 OOZIE-3170 Oozie Diagnostic Bundle tool fails with NPE due to missing service class https://issues.apache.org/jira/browse/OOZIE-3170 OOZIE-3137 Add support for log4j2 in HiveMain https://issues.apache.org/jira/browse/OOZIE-3137 OOZIE-3135 Configure log4j2 in SqoopMain https://issues.apache.org/jira/browse/OOZIE-3135 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues.apache.org/jira/browse/OOZIE-3091 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues.apache.org/jira/browse/OOZIE-3062 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues.apache.org/jira/browse/OOZIE-2927 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues.apache.org/jira/browse/OOZIE-2834 OOZIE-2833 when using uber mode the regex pattern used in the extractHeapSizeMB method does not allow heap sizes specified in bytes. https://issues.apache.org/jira/browse/OOZIE-2833 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions https://issues.apache.org/jira/browse/OOZIE-2812 OOZIE-2795 Create lib directory or symlink for Oozie CLI during packaging https://issues.apache.org/jira/browse/OOZIE-2795 OOZIE-2784 Include WEEK as a parameter in the Coordinator Expression Language Evaulator https://issues.apache.org/jira/browse/OOZIE-2784 OOZIE-2779 Mask
[jira] [Commented] (OOZIE-3432) When use configuration oozie.service.ProxyUserService.root.hosts, oozie-error.log shows Invalid configuration defined
[
https://issues.apache.org/jira/browse/OOZIE-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770718#comment-16770718
]
duan xiong commented on OOZIE-3432:
---
Hi,[~kmarton]. Can you help me review this? Thank you
> When use configuration oozie.service.ProxyUserService.root.hosts,
> oozie-error.log shows Invalid configuration defined
> -
>
> Key: OOZIE-3432
> URL: https://issues.apache.org/jira/browse/OOZIE-3432
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Affects Versions: 5.0.0
>Reporter: duan xiong
>Assignee: duan xiong
>Priority: Critical
> Attachments: oozie-3432-001.patch
>
>
> When use Oozie5.0.0, add configuration:
>
> {code:java}
> oozie.service.ProxyUserService.proxyuser.root.hosts
> oozie.service.ProxyUserService.proxyuser.root.groups{code}
>
> in oozie-site,I start oozie service,Oozie log shows:
>
> {code:java}
> SERVER[] Invalid configuration
> defined,[oozie.service.ProxyUserService.proxyuser.root.hosts]
> SERVER[] Invalid configuration
> defined,[oozie.service.ProxyUserService.proxyuser.root.groups]{code}
> It is not reasonable. Because It is oozie's configuration, not user-defined
> configuration，So It should't shows WARN.
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (OOZIE-3261) Set up mvn clean to delete the "build" directory as well
[
https://issues.apache.org/jira/browse/OOZIE-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770717#comment-16770717
]
duan xiong commented on OOZIE-3261:
---
Hi,[~kmarton] Hi,Can you help me review this, Thank you!
> Set up mvn clean to delete the "build" directory as well
>
>
> Key: OOZIE-3261
> URL: https://issues.apache.org/jira/browse/OOZIE-3261
> Project: Oozie
> Issue Type: Improvement
> Components: build
>Reporter: Peter Cseh
>Assignee: duan xiong
>Priority: Major
> Labels: newbie
> Attachments: oozie-3261-001.patch
>
>
> There are folders named build in every project we have. They are taking up a
> ton of space and not cleaned away when executing "mvn clean"
> {noformat}
> >> [84] 13:52 : oozie (master) :: du -sh */*/build
> 6.9M sharelib/distcp/build
> 174M sharelib/hive/build
> 1.8G sharelib/pig/build
> 665M sharelib/spark/build
> 498M sharelib/sqoop/build
> 7.3M sharelib/streaming/build
> >> [85] 13:53 : oozie (master) :: du -sh */build
> 23M core/build
> 7.8M minitest/build
> 6.2M tools/build
> {noformat}
> They are containing a bunch of files generated during executions in the
> MiniCluster:
> {noformat}
> sharelib/spark/build/test/data/dfs//data/data1/current/BP-1306731421-172.30.65.43-1527256082477/current/finalized/subdir0/subdir4/blk_1073742879
> sharelib/spark/build/test/data/dfs//data/data1/current/BP-1306731421-172.30.65.43-1527256082477/current/finalized/subdir0/subdir4/blk_1073742863_2039.meta
> sharelib/spark/build/test/data/dfs//data/data1/current/BP-1306731421-172.30.65.43-1527256082477/current/finalized/subdir0/subdir4/blk_1073743029_2205.meta
> sharelib/spark/build/test/data/dfs//data/data1/current/BP-1306731421-172.30.65.43-1527256082477/current/finalized/subdir0/subdir4/blk_1073742975_2151.meta
> {noformat}
> "mvn clean" should be configured to clean these folders up as well.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Resolved] (OOZIE-1282) Typo in html Quick Start guide when creating Oozie DB
[
https://issues.apache.org/jira/browse/OOZIE-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andras Salamon resolved OOZIE-1282.
---
Resolution: Duplicate
> Typo in html Quick Start guide when creating Oozie DB
> -
>
> Key: OOZIE-1282
> URL: https://issues.apache.org/jira/browse/OOZIE-1282
> Project: Oozie
> Issue Type: Bug
> Components: docs
>Affects Versions: 3.3.1
>Reporter: Erick Tryzelaar
>Priority: Minor
>
> Good morning,
> I found an odd error in the [Quick Start
> guide|http://oozie.apache.org/docs/3.3.1/DG_QuickStart.html] on the line when
> you create the Oozie DB:
> {code}
> $ bin/ooziedb.sh create -sqlfile oozie.sql -runValidate DB Connection.
> DONE
> Check DB schema does not exist
> DONE
> ...
> {code}
> The error is that "Validate DB Connection" should be on it's own line. Oddly
> enough, if you look at the
> [DG_QuickStart.twiki|http://svn.apache.org/viewvc/oozie/trunk/docs/src/site/twiki/DG_QuickStart.twiki?view=markup]
> in the repository, the line is correct:
> {code}
> 139
> 140 $ bin/ooziedb.sh create -sqlfile oozie.sql -run
> 141
> 142 Validate DB Connection.
> 143 DONE
> ...
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (OOZIE-1282) Typo in html Quick Start guide when creating Oozie DB
[
https://issues.apache.org/jira/browse/OOZIE-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770326#comment-16770326
]
Andras Salamon commented on OOZIE-1282:
---
t was still wrong in 5.0.0:
[http://oozie.apache.org/docs/5.0.0/DG_QuickStart.html]
But it's good in 5.1.0: [http://oozie.apache.org/docs/5.1.0/DG_QuickStart.html]
Most likely fixed by OOZIE-2734
> Typo in html Quick Start guide when creating Oozie DB
> -
>
> Key: OOZIE-1282
> URL: https://issues.apache.org/jira/browse/OOZIE-1282
> Project: Oozie
> Issue Type: Bug
> Components: docs
>Affects Versions: 3.3.1
>Reporter: Erick Tryzelaar
>Priority: Minor
>
> Good morning,
> I found an odd error in the [Quick Start
> guide|http://oozie.apache.org/docs/3.3.1/DG_QuickStart.html] on the line when
> you create the Oozie DB:
> {code}
> $ bin/ooziedb.sh create -sqlfile oozie.sql -runValidate DB Connection.
> DONE
> Check DB schema does not exist
> DONE
> ...
> {code}
> The error is that "Validate DB Connection" should be on it's own line. Oddly
> enough, if you look at the
> [DG_QuickStart.twiki|http://svn.apache.org/viewvc/oozie/trunk/docs/src/site/twiki/DG_QuickStart.twiki?view=markup]
> in the repository, the line is correct:
> {code}
> 139
> 140 $ bin/ooziedb.sh create -sqlfile oozie.sql -run
> 141
> 142 Validate DB Connection.
> 143 DONE
> ...
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
