I skipped following patches due to conflicts in rc0. OOZIE-3072 oozie.service.HadoopAccessorService.action.configurations should overwrite default values set in Hadoop's configuration files (gezapeti)
OOZIE-3018 Use Hadoop's CredentialProvider for passwords in SchemaCheckerService (andras.piros via gezapeti) On Tue, Nov 14, 2017 at 3:23 PM, satish saley <satishsale...@gmail.com> wrote: > Hi, > > I have combined the above two lists, also included couple of JIRAs I filed > today. I will go ahead I put fix versions on these. > > 1. OOZIE-3095 Job submit command is not logged in audit log (puru) > > 2. OOZIE-3031 Coord job with only unresolved dependencies doesn't > timeout > > (puru via satishsaley) > > 3. OOZIE-3079 Filtering coordinators returns bundle id as null > (satishsaley) > > 4. OOZIE-3078 PasswordMasker throws NPE with null arguments (asasvari) > > 5. OOZIE-3072 oozie.service.HadoopAccessorService.action. > configurations > > should overwrite default values set in Hadoop's configuration files > > (gezapeti) > > 6. OOZIE-2885 Running Spark actions should not need Hive on the > classpath > > (satishsaley) > > 7. OOZIE-3058 nocleanup option is missing in oozie-coordinator-0.5.xsd > > (satishsaley) > > 8. OOZIE-3036 Spark 2.2.0 support: tell Spark not to get any > delegation tokens > > (andras.piros via gezapeti) > > 9. OOZIE-3028 Oozie Pig Action fails with no python dependencies > (dbist13 via > > rohini) > > 10. OOZIE-3018 Use Hadoop's CredentialProvider for passwords in > > SchemaCheckerService (andras.piros via gezapeti) > > 11. OOZIE-2984 Parse spark-defaults.conf values with spaces without > needing the > > quotes (andras.piros via gezapeti) > > 12. OOZIE-2923 Improve Spark options parsing (andras.piros via gezapeti) > > 13. OOZIE-2863 SLACalculatorMemory.loadOnRestart causing delay in server > start > > (puru via satishsaley) > > 14. OOZIE-2862 Coord change command doesn't change job to running if job > was > > killed without creating any actions (puru) > > 15. OOZIE-2807 Oozie gets RM delegation token even for checking job > status > > (satishsaley) > > 16. OOZIE-2811 Add support for filtering out properties from > > SparkConfigurationService (gezapeti via rkanter) > > 17. OOZIE-2802 Spark action failure on Spark 2.1.0 due to duplicate > sharelibs > > (gezapeti via rkanter) > > 18. OOZIE-2803 Mask passwords when printing out configs/args in > MapReduceMain > > and SparkMain (pbacsko via rkanter) > > 19. OOZIE-2799 Setting log location for spark sql on hive (satishsaley) > > 20. OOZIE-2792 Hive2 action is not parsing Spark application ID from log > file > > properly when Hive is on Spark (zhengxb2005 via rkanter) > > 21. OOZIE-2786 Pass Oozie workflow ID and settings to Spark application > > configuration (zhengxb2005 via rkanter) > > 22. OOZIE-2790 log4j configuration is not passed to spark executors > > (satishsaley) > > 23. OOZIE-2787 Oozie distributes application jar twice making the spark > job > > fail (satishsaley) > > 24. OOZIE-2777 Config-default.xml longer than 64k results in > > java.io.UTFDataFormatException (gezapeti via harsh) > > 25. OOZIE-2771 Allow retrieving keystore and truststore passwords from > Hadoop > > Credential Provider (asasvari via abhishekbafna) > > 26. OOZIE-2748 NPE in LauncherMapper.printArgs() (pbacsko via rkanter) > > 27. OOZIE-2654 Zookeeper dependent services should not depend on > > Connectionstate to be valid before cleaning up (venkatnrangan via > > abhishekbafna) > > 28. OOZIE-2690 OOZIE NPE while executing kill() (abhishekbafna via > > jaydeepvishwakarma) > > 29. OOZIE-3100 Upgrade javax.mail:mail to 1.4.7 (andras.piros) > > 30. OOZIE-3077 SLA documentation fixes (satishsaley) > > 31. OOZIE-2886 Ensure consistent versioning of hadoop jars in sharelibs > (dbist13 via rkanter) > > 32. OOZIE-2747 README.txt is out of date (Jan Hentschel via rkanter) > > 33. OOZIE-2825 Custom Authentication doc page is not well formatted (Jan > Hentschel via rkanter) > > 34. OOZIE-3127 Remove redundant check for user > > 35. OOZIE-3126 Add option to allow list of users to access system config > > > > Regards, > > Satish > > > > On Tue, Nov 14, 2017 at 3:08 PM, Rohini Palaniswamy < > rohini.adi...@gmail.com> wrote: > >> Peter, >> OOZIE-3004 Forked action retry info is not working in your list is a >> bug fix for the feature OOZIE-2691 which is new in 5.0. So that cannot be >> included. But others are good to be included. >> >> Regards, >> Rohini >> >> On Tue, Nov 14, 2017 at 2:58 PM, Robert Kanter <rkan...@cloudera.com> >> wrote: >> >> > Sounds good to me. >> > >> > On Tue, Nov 14, 2017 at 10:09 AM, Peter Bacsko <pbac...@cloudera.com> >> > wrote: >> > >> > > Good idea. >> > > >> > > If I'm not mistaken, there's also a pending review/patch submitted by >> > > someone (apologies, but I forgot how it was) that cannot be applied to >> > the >> > > master anymore, at least not easily. It's worth checking that too >> > (perhaps >> > > there are more than one patch). >> > > >> > > Peter >> > > >> > > On Tue, Nov 14, 2017 at 5:07 PM, Peter Cseh <gezap...@cloudera.com> >> > wrote: >> > > >> > > > Hey! >> > > > >> > > > I agree, users wanting stability would appreciate a more stable >> 4.3.1 >> > or >> > > > even 4.4.0 to be released with improvements. >> > > > I think we could include the following issues as well: >> > > > OOZIE-3100 Upgrade javax.mail:mail to 1.4.7 (andras.piros) >> > > > OOZIE-3077 SLA documentation fixes (satishsaley) >> > > > OOZIE-2886 Ensure consistent versioning of hadoop jars in sharelibs >> > > > (dbist13 via rkanter) >> > > > OOZIE-2747 README.txt is out of date (Jan Hentschel via rkanter) >> > > > OOZIE-2825 Custom Authentication doc page is not well formatted (Jan >> > > > Hentschel via rkanter) >> > > > OOZIE-3004 Forked action retry info is not working >> > > > Most of these are minor improvements or user-facing fixes which >> would >> > be >> > > > nice to get through the door. >> > > > >> > > > BRs, >> > > > gp >> > > > >> > > > On Tue, Nov 14, 2017 at 12:56 AM, Rohini Palaniswamy < >> > > > rohini.adi...@gmail.com> wrote: >> > > > >> > > > > Hi folks, >> > > > > I think this would be a good time to do a patch release on 4.3 >> > > branch. >> > > > > The 5.0 release is going to be a major change with the move of >> > launcher >> > > > > from Mapreduce AM to Oozie AM and might take time to stabilize. >> So it >> > > > would >> > > > > be good to do one final patch release on 4.3 branch pulling in >> some >> > > > > important fixes and Spark action related fixes (Spark 2.x support) >> > that >> > > > > have gone in master so far. Satish has volunteered to be the >> Release >> > > > > Manager. >> > > > > >> > > > > Below is a initial list of jiras that I identified. >> > > > > >> > > > > >> > > > > OOZIE-3095 Job submit command is not logged in audit log (puru) >> > > > > OOZIE-3031 Coord job with only unresolved dependencies doesn't >> > timeout >> > > > > (puru via satishsaley) >> > > > > OOZIE-3079 Filtering coordinators returns bundle id as null >> > > (satishsaley) >> > > > > OOZIE-3078 PasswordMasker throws NPE with null arguments >> (asasvari) >> > > > > OOZIE-3072 oozie.service.HadoopAccessorSe >> rvice.action.configurations >> > > > > should overwrite default values set in Hadoop's configuration >> files >> > > > > (gezapeti) >> > > > > OOZIE-2885 Running Spark actions should not need Hive on the >> > classpath >> > > > > (satishsaley) >> > > > > OOZIE-3058 nocleanup option is missing in >> oozie-coordinator-0.5.xsd >> > > > > (satishsaley) >> > > > > OOZIE-3036 Spark 2.2.0 support: tell Spark not to get any >> delegation >> > > > tokens >> > > > > (andras.piros via gezapeti) >> > > > > OOZIE-3028 Oozie Pig Action fails with no python dependencies >> > (dbist13 >> > > > via >> > > > > rohini) >> > > > > OOZIE-3018 Use Hadoop's CredentialProvider for passwords in >> > > > > SchemaCheckerService (andras.piros via gezapeti) >> > > > > OOZIE-2984 Parse spark-defaults.conf values with spaces without >> > needing >> > > > the >> > > > > quotes (andras.piros via gezapeti) >> > > > > OOZIE-2923 Improve Spark options parsing (andras.piros via >> gezapeti) >> > > > > OOZIE-2863 SLACalculatorMemory.loadOnRestart causing delay in >> server >> > > > start >> > > > > (puru via satishsaley) >> > > > > OOZIE-2862 Coord change command doesn't change job to running if >> job >> > > was >> > > > > killed without creating any actions (puru) >> > > > > OOZIE-2807 Oozie gets RM delegation token even for checking job >> > status >> > > > > (satishsaley) >> > > > > OOZIE-2811 Add support for filtering out properties from >> > > > > SparkConfigurationService (gezapeti via rkanter) >> > > > > OOZIE-2802 Spark action failure on Spark 2.1.0 due to duplicate >> > > sharelibs >> > > > > (gezapeti via rkanter) >> > > > > OOZIE-2803 Mask passwords when printing out configs/args in >> > > MapReduceMain >> > > > > and SparkMain (pbacsko via rkanter) >> > > > > OOZIE-2799 Setting log location for spark sql on hive >> (satishsaley) >> > > > > OOZIE-2792 Hive2 action is not parsing Spark application ID from >> log >> > > file >> > > > > properly when Hive is on Spark (zhengxb2005 via rkanter) >> > > > > OOZIE-2786 Pass Oozie workflow ID and settings to Spark >> application >> > > > > configuration (zhengxb2005 via rkanter) >> > > > > OOZIE-2790 log4j configuration is not passed to spark executors >> > > > > (satishsaley) >> > > > > OOZIE-2787 Oozie distributes application jar twice making the >> spark >> > job >> > > > > fail (satishsaley) >> > > > > OOZIE-2777 Config-default.xml longer than 64k results in >> > > > > java.io.UTFDataFormatException (gezapeti via harsh) >> > > > > OOZIE-2771 Allow retrieving keystore and truststore passwords from >> > > Hadoop >> > > > > Credential Provider (asasvari via abhishekbafna) >> > > > > OOZIE-2748 NPE in LauncherMapper.printArgs() (pbacsko via rkanter) >> > > > > OOZIE-2654 Zookeeper dependent services should not depend on >> > > > > Connectionstate to be valid before cleaning up (venkatnrangan via >> > > > > abhishekbafna) >> > > > > OOZIE-2690 OOZIE NPE while executing kill() (abhishekbafna via >> > > > > jaydeepvishwakarma) >> > > > > >> > > > > >> > > > > Please reply to this mail thread if you find other jiras that you >> > think >> > > > are >> > > > > important and should be part of 4.3.1. >> > > > > >> > > > > >> > > > > Regards, >> > > > > Rohini >> > > > > >> > > > >> > > > >> > > > >> > > > -- >> > > > Peter Cseh >> > > > Software Engineer >> > > > <http://www.cloudera.com> >> > > > >> > > >> > >> > >
