[jira] [Commented] (AMATERASU-4) Run an Amaterasu pipeline

2017-10-28 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223364#comment-16223364 ] Yaniv Rodenski commented on AMATERASU-4: Hi Shad, I've just moved the code from

[jira] [Created] (AMATERASU-6) Long running actions/pipelines

2017-11-16 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-6: -- Summary: Long running actions/pipelines Key: AMATERASU-6 URL: https://issues.apache.org/jira/browse/AMATERASU-6 Project: AMATERASU Issue Type: New Featu

[jira] [Created] (AMATERASU-7) Scheduled pipelines/actions

2017-11-16 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-7: -- Summary: Scheduled pipelines/actions Key: AMATERASU-7 URL: https://issues.apache.org/jira/browse/AMATERASU-7 Project: AMATERASU Issue Type: New Feature

[jira] [Created] (AMATERASU-8) Support for Jar/External actions

2017-11-16 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-8: -- Summary: Support for Jar/External actions Key: AMATERASU-8 URL: https://issues.apache.org/jira/browse/AMATERASU-8 Project: AMATERASU Issue Type: New Feat

[jira] [Created] (AMATERASU-9) Nested pipelines

2017-11-17 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-9: -- Summary: Nested pipelines Key: AMATERASU-9 URL: https://issues.apache.org/jira/browse/AMATERASU-9 Project: AMATERASU Issue Type: Bug Reporter

[jira] [Updated] (AMATERASU-9) Nested pipelines

2017-11-17 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-9: --- Issue Type: Improvement (was: Bug) > Nested pipelines > > >

[jira] [Created] (AMATERASU-10) Action level configuration

2017-11-17 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-10: --- Summary: Action level configuration Key: AMATERASU-10 URL: https://issues.apache.org/jira/browse/AMATERASU-10 Project: AMATERASU Issue Type: New Featur

[jira] [Created] (AMATERASU-11) Monitoring UI

2017-11-17 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-11: --- Summary: Monitoring UI Key: AMATERASU-11 URL: https://issues.apache.org/jira/browse/AMATERASU-11 Project: AMATERASU Issue Type: New Feature

[jira] [Created] (AMATERASU-12) Spark framework - support for spark streaming

2017-11-17 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-12: --- Summary: Spark framework - support for spark streaming Key: AMATERASU-12 URL: https://issues.apache.org/jira/browse/AMATERASU-12 Project: AMATERASU Iss

[jira] [Updated] (AMATERASU-6) Long running actions/pipelines

2017-11-26 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-6: --- Description: As a pipeline developer, I can define pipelines and actions to be long-running

[jira] [Updated] (AMATERASU-7) Scheduled pipelines/actions

2017-11-26 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-7: --- Description: As a pipeline developer, I can define a schedule in the maki.yml for my pipelin

[jira] [Updated] (AMATERASU-7) Scheduled pipelines/actions

2017-11-26 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-7: --- Description: As a pipeline developer, I can define a schedule in the maki.yml for my pipelin

[jira] [Created] (AMATERASU-13) make ama_context available in SparkSQL

2017-12-25 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-13: --- Summary: make ama_context available in SparkSQL Key: AMATERASU-13 URL: https://issues.apache.org/jira/browse/AMATERASU-13 Project: AMATERASU Issue Type

[jira] [Updated] (AMATERASU-13) make ama_context available in SparkSQL

2017-12-25 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-13: Issue Type: Improvement (was: Bug) > make ama_context available in SparkSQL > ---

[jira] [Updated] (AMATERASU-13) make ama_context available in SparkSQL

2017-12-25 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-13: Description: SparkSQL actions runner should support accessing datasets via ama_context, fo

[jira] [Updated] (AMATERASU-13) make ama_context available in SparkSQL

2017-12-25 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-13: Description: SparkSQL actions runner should support accessing datasets via ama_context, fo

[jira] [Created] (AMATERASU-14) Make SparkSQL exports explicit

2017-12-25 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-14: --- Summary: Make SparkSQL exports explicit Key: AMATERASU-14 URL: https://issues.apache.org/jira/browse/AMATERASU-14 Project: AMATERASU Issue Type: Improv

[jira] [Created] (AMATERASU-15) Implement executor notifications for YARN

2018-01-16 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-15: --- Summary: Implement executor notifications for YARN Key: AMATERASU-15 URL: https://issues.apache.org/jira/browse/AMATERASU-15 Project: AMATERASU Issue T

[jira] [Created] (AMATERASU-16) YARN - Deploy Amaterasu binaries only if they do not exist on HDFS

2018-01-16 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-16: --- Summary: YARN - Deploy Amaterasu binaries only if they do not exist on HDFS Key: AMATERASU-16 URL: https://issues.apache.org/jira/browse/AMATERASU-16 Project: A

[jira] [Created] (AMATERASU-17) SDK - add framework distribution capability

2018-01-18 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-17: --- Summary: SDK - add framework distribution capability Key: AMATERASU-17 URL: https://issues.apache.org/jira/browse/AMATERASU-17 Project: AMATERASU Issu

[jira] [Assigned] (AMATERASU-17) SDK - add framework distribution capability

2018-01-23 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-17: --- Assignee: Yaniv Rodenski > SDK - add framework distribution capability > -

[jira] [Assigned] (AMATERASU-15) Implement executor notifications for YARN

2018-01-23 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-15: --- Assignee: Eyal Ben Ivri > Implement executor notifications for YARN > -

[jira] [Assigned] (AMATERASU-2) Initialization of an Amaterasu job repository via the CLI

2018-01-23 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-2: -- Assignee: Nadav Har Tzvi > Initialization of an Amaterasu job repository via the CLI >

[jira] [Assigned] (AMATERASU-3) Scaffolding based on maki.yml

2018-01-23 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-3: -- Assignee: Nadav Har Tzvi > Scaffolding based on maki.yml > ---

[jira] [Assigned] (AMATERASU-1) Amaterasu CLI

2018-01-23 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-1: -- Assignee: Nadav Har Tzvi > Amaterasu CLI > - > > Key: AMAT

[jira] [Assigned] (AMATERASU-5) Allocated resources aren't cleaned up properly on crash/unexpected halt

2018-01-23 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-5: -- Assignee: Nadav Har Tzvi > Allocated resources aren't cleaned up properly on crash/une

[jira] [Assigned] (AMATERASU-4) Run an Amaterasu pipeline

2018-01-23 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-4: -- Assignee: Nadav Har Tzvi > Run an Amaterasu pipeline > - > >

[jira] [Closed] (AMATERASU-17) SDK - add framework distribution capability

2018-01-31 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski closed AMATERASU-17. --- Resolution: Done > SDK - add framework distribution capability > --

[jira] [Assigned] (AMATERASU-15) Implement executor notifications for YARN

2018-02-02 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-15: --- Assignee: Yaniv Rodenski (was: Eyal Ben Ivri) > Implement executor notifications f

[jira] [Resolved] (AMATERASU-15) Implement executor notifications for YARN

2018-02-10 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-15. - Resolution: Fixed > Implement executor notifications for YARN >

[jira] [Closed] (AMATERASU-15) Implement executor notifications for YARN

2018-02-10 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski closed AMATERASU-15. --- > Implement executor notifications for YARN > - > >

[jira] [Assigned] (AMATERASU-13) make ama_context available in SparkSQL

2018-02-11 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-13: --- Assignee: Yaniv Rodenski > make ama_context available in SparkSQL > ---

[jira] [Assigned] (AMATERASU-14) Make SparkSQL exports explicit

2018-02-11 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-14: --- Assignee: Yaniv Rodenski > Make SparkSQL exports explicit > ---

[jira] [Updated] (AMATERASU-17) SDK - add framework distribution capability

2018-02-16 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-17: Affects Version/s: 0.2.0-incubating > SDK - add framework distribution capability > -

[jira] [Updated] (AMATERASU-15) Implement executor notifications for YARN

2018-02-16 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-15: Affects Version/s: 0.2.0-incubating > Implement executor notifications for YARN >

[jira] [Updated] (AMATERASU-8) Support for Jar/External actions

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-8: --- Affects Version/s: 0.2.1-incubating > Support for Jar/External actions >

[jira] [Updated] (AMATERASU-11) Monitoring UI

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-11: Affects Version/s: 0.3.0-incubating > Monitoring UI > - > > Ke

[jira] [Updated] (AMATERASU-12) Spark framework - support for spark streaming

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-12?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-12: Affects Version/s: 0.3.0-incubating > Spark framework - support for spark streaming >

[jira] [Updated] (AMATERASU-9) Nested pipelines

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-9: --- Affects Version/s: 0.3.0-incubating > Nested pipelines > > >

[jira] [Updated] (AMATERASU-10) Action level configuration

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-10?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-10: Affects Version/s: 0.3.0-incubating > Action level configuration > ---

[jira] [Updated] (AMATERASU-14) Make SparkSQL exports explicit

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-14: Affects Version/s: 0.2.0-incubating > Make SparkSQL exports explicit > ---

[jira] [Updated] (AMATERASU-7) Scheduled pipelines/actions

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-7: --- Affects Version/s: 0.3.0-incubating > Scheduled pipelines/actions > -

[jira] [Updated] (AMATERASU-6) Long running actions/pipelines

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-6: --- Affects Version/s: 0.3.0-incubating > Long running actions/pipelines > -

[jira] [Updated] (AMATERASU-13) make ama_context available in SparkSQL

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-13: Affects Version/s: 0.2.0-incubating > make ama_context available in SparkSQL > ---

[jira] [Assigned] (AMATERASU-16) YARN - Deploy Amaterasu binaries only if they do not exist on HDFS

2018-02-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-16?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-16: --- Assignee: Eyal Ben Ivri Affects Version/s: 0.2.0-incubating > YARN - D

[jira] [Assigned] (AMATERASU-13) make ama_context available in SparkSQL

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-13: --- Assignee: (was: Yaniv Rodenski) > make ama_context available in SparkSQL >

[jira] [Resolved] (AMATERASU-13) make ama_context available in SparkSQL

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-13. - Resolution: Implemented > make ama_context available in SparkSQL > -

[jira] [Updated] (AMATERASU-16) YARN - Deploy Amaterasu binaries only if they do not exist on HDFS

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-16?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-16: Fix Version/s: 0.2.0-incubating > YARN - Deploy Amaterasu binaries only if they do not exi

[jira] [Updated] (AMATERASU-7) Scheduled pipelines/actions

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-7: --- Fix Version/s: 0.3.0-incubating > Scheduled pipelines/actions > --- >

[jira] [Updated] (AMATERASU-14) Make SparkSQL exports explicit

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-14: Fix Version/s: 0.2.0-incubating > Make SparkSQL exports explicit > ---

[jira] [Updated] (AMATERASU-6) Long running actions/pipelines

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-6: --- Fix Version/s: 0.3.0-incubating > Long running actions/pipelines > -

[jira] [Updated] (AMATERASU-8) Support for Jar/External actions

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-8: --- Fix Version/s: 0.2.1-incubating > Support for Jar/External actions >

[jira] [Updated] (AMATERASU-15) Implement executor notifications for YARN

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-15: Fix Version/s: 0.2.0-incubating > Implement executor notifications for YARN >

[jira] [Updated] (AMATERASU-13) make ama_context available in SparkSQL

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-13: Fix Version/s: 0.2.0-incubating > make ama_context available in SparkSQL > ---

[jira] [Updated] (AMATERASU-12) Spark framework - support for spark streaming

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-12?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-12: Fix Version/s: 0.3.0-incubating > Spark framework - support for spark streaming >

[jira] [Updated] (AMATERASU-17) SDK - add framework distribution capability

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-17: Fix Version/s: 0.2.0-incubating > SDK - add framework distribution capability > -

[jira] [Updated] (AMATERASU-11) Monitoring UI

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-11: Fix Version/s: 0.3.0-incubating > Monitoring UI > - > > Key: A

[jira] [Updated] (AMATERASU-10) Action level configuration

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-10?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-10: Fix Version/s: 0.3.0-incubating > Action level configuration > --

[jira] [Updated] (AMATERASU-9) Nested pipelines

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-9: --- Fix Version/s: 0.3.0-incubating > Nested pipelines > > > Key

[jira] [Resolved] (AMATERASU-16) YARN - Deploy Amaterasu binaries only if they do not exist on HDFS

2018-02-22 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-16?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-16. - Resolution: Done > YARN - Deploy Amaterasu binaries only if they do not exist on HDFS >

[jira] [Created] (AMATERASU-18) Containers are not influenced by

2018-02-24 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-18: --- Summary: Containers are not influenced by Key: AMATERASU-18 URL: https://issues.apache.org/jira/browse/AMATERASU-18 Project: AMATERASU Issue Type: Bug

[jira] [Updated] (AMATERASU-18) Containers are not influenced by framework configuration

2018-02-24 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-18: Summary: Containers are not influenced by framework configuration (was: Containers are no

[jira] [Assigned] (AMATERASU-18) Containers are not influenced by framework configuration

2018-02-24 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-18: --- Assignee: Eyal Ben Ivri > Containers are not influenced by framework configuration

[jira] [Updated] (AMATERASU-18) Containers are not influenced by framework configuration

2018-02-24 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-18: Description: Currently, the containers sizing (YARN and Mesos) is derived from the default

[jira] [Updated] (AMATERASU-18) Containers are not influenced by framework configuration

2018-02-24 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-18: Fix Version/s: 0.2.0-incubating > Containers are not influenced by framework configuration

[jira] [Created] (AMATERASU-19) Setup travis-ci release pipeline

2018-02-24 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-19: --- Summary: Setup travis-ci release pipeline Key: AMATERASU-19 URL: https://issues.apache.org/jira/browse/AMATERASU-19 Project: AMATERASU Issue Type: Task

[jira] [Assigned] (AMATERASU-19) Setup travis-ci release pipeline

2018-02-25 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-19?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-19: --- Assignee: Guy Peleg > Setup travis-ci release pipeline > --

[jira] [Resolved] (AMATERASU-14) Make SparkSQL exports explicit

2018-02-26 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-14. - Resolution: Fixed > Make SparkSQL exports explicit > -- > >

[jira] [Created] (AMATERASU-20) Build fails on travis containers

2018-03-25 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-20: --- Summary: Build fails on travis containers Key: AMATERASU-20 URL: https://issues.apache.org/jira/browse/AMATERASU-20 Project: AMATERASU Issue Type: Bug

[jira] [Assigned] (AMATERASU-20) Build fails on travis containers

2018-03-25 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-20: --- Assignee: Yaniv Rodenski > Build fails on travis containers > -

[jira] [Created] (AMATERASU-21) Fix Spark scala tests

2018-04-16 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-21: --- Summary: Fix Spark scala tests Key: AMATERASU-21 URL: https://issues.apache.org/jira/browse/AMATERASU-21 Project: AMATERASU Issue Type: Task Affect

[jira] [Commented] (AMATERASU-20) Build fails on travis containers

2018-04-16 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-20?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439421#comment-16439421 ] Yaniv Rodenski commented on AMATERASU-20: - Hi [~shad.amez] thanks for that, we a

[jira] [Resolved] (AMATERASU-20) Build fails on travis containers

2018-04-16 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-20. - Resolution: Fixed > Build fails on travis containers >

[jira] [Assigned] (AMATERASU-7) Scheduled pipelines/actions

2018-05-14 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-7: -- Assignee: Yaniv Rodenski > Scheduled pipelines/actions > --- >

[jira] [Created] (AMATERASU-23) Add executor classpath from framework configuration

2018-05-14 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-23: --- Summary: Add executor classpath from framework configuration Key: AMATERASU-23 URL: https://issues.apache.org/jira/browse/AMATERASU-23 Project: AMATERASU

[jira] [Created] (AMATERASU-24) Refactor Spark out of Amaterasu executor to it's own project

2018-05-15 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-24: --- Summary: Refactor Spark out of Amaterasu executor to it's own project Key: AMATERASU-24 URL: https://issues.apache.org/jira/browse/AMATERASU-24 Project: AMATERA

[jira] [Resolved] (AMATERASU-26) Pipeline tasks (sub-Yarn jobs) runs as "yarn" user instead of inhering the user in which the amaterasu job was submitted

2018-06-08 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-26. - Resolution: Fixed > Pipeline tasks (sub-Yarn jobs) runs as "yarn" user instead of inher

[jira] [Assigned] (AMATERASU-23) Add executor classpath from framework configuration

2018-06-09 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-23?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-23: --- Assignee: Yaniv Rodenski > Add executor classpath from framework configuration > -

[jira] [Created] (AMATERASU-33) Upgrade Gradle version to 4.8

2018-06-09 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-33: --- Summary: Upgrade Gradle version to 4.8 Key: AMATERASU-33 URL: https://issues.apache.org/jira/browse/AMATERASU-33 Project: AMATERASU Issue Type: Improve

[jira] [Assigned] (AMATERASU-33) Upgrade Gradle version to 4.8

2018-06-09 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-33: --- Assignee: Yaniv Rodenski > Upgrade Gradle version to 4.8 > ---

[jira] [Created] (AMATERASU-35) Generate the container command from the framework providere

2018-06-17 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-35: --- Summary: Generate the container command from the framework providere Key: AMATERASU-35 URL: https://issues.apache.org/jira/browse/AMATERASU-35 Project: AMATERAS

[jira] [Closed] (AMATERASU-21) Fix Spark scala tests

2018-06-17 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski closed AMATERASU-21. --- Resolution: Fixed > Fix Spark scala tests > - > > Key:

[jira] [Updated] (AMATERASU-23) Add executor classpath from framework configuration - Mesos

2018-06-18 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-23?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-23: Summary: Add executor classpath from framework configuration - Mesos (was: Add executor

[jira] [Created] (AMATERASU-36) Refactoring - leader: extract projects per resource manager + common

2018-06-18 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-36: --- Summary: Refactoring - leader: extract projects per resource manager + common Key: AMATERASU-36 URL: https://issues.apache.org/jira/browse/AMATERASU-36 Project:

[jira] [Created] (AMATERASU-37) Fix support for ssh keys auth

2018-06-30 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-37: --- Summary: Fix support for ssh keys auth Key: AMATERASU-37 URL: https://issues.apache.org/jira/browse/AMATERASU-37 Project: AMATERASU Issue Type: Improve

[jira] [Resolved] (AMATERASU-24) Refactor Spark out of Amaterasu executor to it's own project

2018-07-08 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-24?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-24. - Resolution: Fixed > Refactor Spark out of Amaterasu executor to it's own project >

[jira] [Created] (AMATERASU-44) Spark Scala - Move the persistence functionality from the runner implementation into AmaContext

2018-07-08 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-44: --- Summary: Spark Scala - Move the persistence functionality from the runner implementation into AmaContext Key: AMATERASU-44 URL: https://issues.apache.org/jira/browse/AMATER

[jira] [Created] (AMATERASU-45) PySpark: refactor the PySpark runtime into it's own component

2018-07-08 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-45: --- Summary: PySpark: refactor the PySpark runtime into it's own component Key: AMATERASU-45 URL: https://issues.apache.org/jira/browse/AMATERASU-45 Project: AMATER

[jira] [Created] (AMATERASU-46) PySpark - Move the persistence functionality from the runner implementation into ama_context

2018-07-08 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-46: --- Summary: PySpark - Move the persistence functionality from the runner implementation into ama_context Key: AMATERASU-46 URL: https://issues.apache.org/jira/browse/AMATERASU

[jira] [Updated] (AMATERASU-46) PySpark - Move the persistence functionality from the runner implementation into ama_context

2018-07-08 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-46?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-46: Fix Version/s: 0.2.1-incubating > PySpark - Move the persistence functionality from the r

[jira] [Resolved] (AMATERASU-33) Upgrade Gradle version to 4.8

2018-07-16 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-33. - Resolution: Fixed > Upgrade Gradle version to 4.8 > - > >

[jira] [Created] (AMATERASU-47) Create a framework dispatcher project for Spark

2018-07-16 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-47: --- Summary: Create a framework dispatcher project for Spark Key: AMATERASU-47 URL: https://issues.apache.org/jira/browse/AMATERASU-47 Project: AMATERASU I

[jira] [Assigned] (AMATERASU-47) Create a framework dispatcher project for Spark

2018-07-16 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-47: --- Assignee: Yaniv Rodenski > Create a framework dispatcher project for Spark > -

[jira] [Updated] (AMATERASU-47) Create a framework dispatcher project for Spark

2018-07-16 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski updated AMATERASU-47: Fix Version/s: 0.2.1-incubating > Create a framework dispatcher project for Spark > -

[jira] [Assigned] (AMATERASU-8) Support for Jar/External actions

2018-07-23 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-8: -- Assignee: Shad Amez > Support for Jar/External actions >

[jira] [Resolved] (AMATERASU-47) Create a framework dispatcher project for Spark

2018-07-26 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-47. - Resolution: Fixed > Create a framework dispatcher project for Spark > -

[jira] [Assigned] (AMATERASU-31) Investigate why PySpark actions on EMR require minimum of 2G memory

2018-07-26 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-31?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski reassigned AMATERASU-31: --- Assignee: Eyal Ben Ivri > Investigate why PySpark actions on EMR require minimum o

[jira] [Created] (AMATERASU-48) Create a spark-shell based setup provider for spark scala

2018-07-31 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-48: --- Summary: Create a spark-shell based setup provider for spark scala Key: AMATERASU-48 URL: https://issues.apache.org/jira/browse/AMATERASU-48 Project: AMATERASU

[jira] [Resolved] (AMATERASU-35) Generate the container command from the framework providere

2018-08-05 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-35?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski resolved AMATERASU-35. - Resolution: Fixed > Generate the container command from the framework providere > -

[jira] [Closed] (AMATERASU-23) Add executor classpath from framework configuration - Mesos

2018-08-05 Thread Yaniv Rodenski (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-23?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaniv Rodenski closed AMATERASU-23. --- Resolution: Invalid > Add executor classpath from framework configuration - Mesos > ---

  1   2   >