[jira] [Updated] (MAPREDUCE-4393) PaaS on YARN: an YARN application to demonstrate that YARN can be used as a PaaS
[ https://issues.apache.org/jira/browse/MAPREDUCE-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4393: - Status: Open (was: Patch Available) Jaigak - I spent some more thinking about this in light of MAPREDUCE-4495. Unfortunately, it seems that we are running the risk of turning YARN into an 'umbrella' project by accepting applications built on top of YARN into the project itself... Essentially, as folks like Chris Mattman have pointed out in MAPREDUCE-4495, the PaaS prototype is better off being a standalone project in Apache Incubator since the Apache Software Foundation frowns upon one 'umbrella' project housing several smaller projects i.e. YARN vis-a-vis PaaS, Workflow AM etc. If you are interested, I'm more than happy to help you through the Apache Incubator process and we collaborate via the Incubator. Do you mind doing that? Thanks! > PaaS on YARN: an YARN application to demonstrate that YARN can be used as a > PaaS > > > Key: MAPREDUCE-4393 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4393 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: examples >Affects Versions: 0.23.1 >Reporter: Jaigak Song >Assignee: Jaigak Song > Fix For: 3.0.0 > > Attachments: HADOOPasPAAS_Architecture.pdf, MAPREDUCE-4393.patch, > MAPREDUCE-4393.patch, MAPREDUCE-4393.patch, MAPREDUCE4393.patch, > MAPREDUCE4393.patch > > Original Estimate: 336h > Time Spent: 336h > Remaining Estimate: 0h > > This application is to demonstrate that YARN can be used for non-mapreduce > applications. As Hadoop has already been adopted and deployed widely and its > deployment in future will be highly increased, we thought that it's a good > potential to be used as PaaS. > I have implemented a proof of concept to demonstrate that YARN can be used as > a PaaS (Platform as a Service). I have done a gap analysis against VMware's > Cloud Foundry and tried to achieve as many PaaS functionalities as possible > on YARN. > I'd like to check in this POC as a YARN example application. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4393) PaaS on YARN: an YARN application to demonstrate that YARN can be used as a PaaS
[ https://issues.apache.org/jira/browse/MAPREDUCE-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaigak Song updated MAPREDUCE-4393: --- Attachment: MAPREDUCE4393.patch Please bear with me as I'm new to this Hadoop development environment. The attached patch works fine (i.e. test-patch.sh produced +1 overall result) on my ubuntu machine. Let's see how it goes this time. > PaaS on YARN: an YARN application to demonstrate that YARN can be used as a > PaaS > > > Key: MAPREDUCE-4393 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4393 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: examples >Affects Versions: 0.23.1 >Reporter: Jaigak Song >Assignee: Jaigak Song > Fix For: 3.0.0 > > Attachments: HADOOPasPAAS_Architecture.pdf, MAPREDUCE-4393.patch, > MAPREDUCE-4393.patch, MAPREDUCE-4393.patch, MAPREDUCE4393.patch, > MAPREDUCE4393.patch > > Original Estimate: 336h > Remaining Estimate: 336h > > This application is to demonstrate that YARN can be used for non-mapreduce > applications. As Hadoop has already been adopted and deployed widely and its > deployment in future will be highly increased, we thought that it's a good > potential to be used as PaaS. > I have implemented a proof of concept to demonstrate that YARN can be used as > a PaaS (Platform as a Service). I have done a gap analysis against VMware's > Cloud Foundry and tried to achieve as many PaaS functionalities as possible > on YARN. > I'd like to check in this POC as a YARN example application. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4393) PaaS on YARN: an YARN application to demonstrate that YARN can be used as a PaaS
[ https://issues.apache.org/jira/browse/MAPREDUCE-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaigak Song updated MAPREDUCE-4393: --- Attachment: MAPREDUCE4393.patch Finally I could successfully run 'dec-support.sh' with a positive overall result. > PaaS on YARN: an YARN application to demonstrate that YARN can be used as a > PaaS > > > Key: MAPREDUCE-4393 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4393 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: examples >Affects Versions: 0.23.1 >Reporter: Jaigak Song >Assignee: Jaigak Song > Fix For: 3.0.0 > > Attachments: HADOOPasPAAS_Architecture.pdf, MAPREDUCE-4393.patch, > MAPREDUCE-4393.patch, MAPREDUCE-4393.patch, MAPREDUCE4393.patch > > Original Estimate: 336h > Remaining Estimate: 336h > > This application is to demonstrate that YARN can be used for non-mapreduce > applications. As Hadoop has already been adopted and deployed widely and its > deployment in future will be highly increased, we thought that it's a good > potential to be used as PaaS. > I have implemented a proof of concept to demonstrate that YARN can be used as > a PaaS (Platform as a Service). I have done a gap analysis against VMware's > Cloud Foundry and tried to achieve as many PaaS functionalities as possible > on YARN. > I'd like to check in this POC as a YARN example application. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4393) PaaS on YARN: an YARN application to demonstrate that YARN can be used as a PaaS
[ https://issues.apache.org/jira/browse/MAPREDUCE-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaigak Song updated MAPREDUCE-4393: --- Attachment: MAPREDUCE-4393.patch Fixed most of the errors reported from QA automatic build: javadoc, findBugs, audit ... > PaaS on YARN: an YARN application to demonstrate that YARN can be used as a > PaaS > > > Key: MAPREDUCE-4393 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4393 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: examples >Affects Versions: 0.23.1 >Reporter: Jaigak Song >Assignee: Jaigak Song > Fix For: 3.0.0 > > Attachments: HADOOPasPAAS_Architecture.pdf, MAPREDUCE-4393.patch, > MAPREDUCE-4393.patch, MAPREDUCE-4393.patch > > Original Estimate: 336h > Remaining Estimate: 336h > > This application is to demonstrate that YARN can be used for non-mapreduce > applications. As Hadoop has already been adopted and deployed widely and its > deployment in future will be highly increased, we thought that it's a good > potential to be used as PaaS. > I have implemented a proof of concept to demonstrate that YARN can be used as > a PaaS (Platform as a Service). I have done a gap analysis against VMware's > Cloud Foundry and tried to achieve as many PaaS functionalities as possible > on YARN. > I'd like to check in this POC as a YARN example application. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4393) PaaS on YARN: an YARN application to demonstrate that YARN can be used as a PaaS
[ https://issues.apache.org/jira/browse/MAPREDUCE-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaigak Song updated MAPREDUCE-4393: --- Attachment: MAPREDUCE-4393.patch Included the doc into the patch so that it can avoid build failures. Also, I applied some svn ignores before creating the path. But the actual application is same as before. > PaaS on YARN: an YARN application to demonstrate that YARN can be used as a > PaaS > > > Key: MAPREDUCE-4393 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4393 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: examples >Affects Versions: 0.23.1 >Reporter: Jaigak Song >Assignee: Jaigak Song > Fix For: 3.0.0 > > Attachments: HADOOPasPAAS_Architecture.pdf, MAPREDUCE-4393.patch, > MAPREDUCE-4393.patch > > Original Estimate: 336h > Remaining Estimate: 336h > > This application is to demonstrate that YARN can be used for non-mapreduce > applications. As Hadoop has already been adopted and deployed widely and its > deployment in future will be highly increased, we thought that it's a good > potential to be used as PaaS. > I have implemented a proof of concept to demonstrate that YARN can be used as > a PaaS (Platform as a Service). I have done a gap analysis against VMware's > Cloud Foundry and tried to achieve as many PaaS functionalities as possible > on YARN. > I'd like to check in this POC as a YARN example application. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4393) PaaS on YARN: an YARN application to demonstrate that YARN can be used as a PaaS
[ https://issues.apache.org/jira/browse/MAPREDUCE-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaigak Song updated MAPREDUCE-4393: --- Attachment: HADOOPasPAAS_Architecture.pdf Architecture document for the application > PaaS on YARN: an YARN application to demonstrate that YARN can be used as a > PaaS > > > Key: MAPREDUCE-4393 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4393 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: examples >Affects Versions: 0.23.1 >Reporter: Jaigak Song >Assignee: Jaigak Song > Fix For: 3.0.0 > > Attachments: HADOOPasPAAS_Architecture.pdf, MAPREDUCE-4393.patch > > Original Estimate: 336h > Remaining Estimate: 336h > > This application is to demonstrate that YARN can be used for non-mapreduce > applications. As Hadoop has already been adopted and deployed widely and its > deployment in future will be highly increased, we thought that it's a good > potential to be used as PaaS. > I have implemented a proof of concept to demonstrate that YARN can be used as > a PaaS (Platform as a Service). I have done a gap analysis against VMware's > Cloud Foundry and tried to achieve as many PaaS functionalities as possible > on YARN. > I'd like to check in this POC as a YARN example application. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4393) PaaS on YARN: an YARN application to demonstrate that YARN can be used as a PaaS
[ https://issues.apache.org/jira/browse/MAPREDUCE-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4393: - Assignee: Jaigak Song Status: Patch Available (was: Open) Jaigak - thanks for the patch, I'll look into it. Typically we mark the jira as 'Patch Available' when you want it reviewed, I've done it for you here. > PaaS on YARN: an YARN application to demonstrate that YARN can be used as a > PaaS > > > Key: MAPREDUCE-4393 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4393 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: examples >Affects Versions: 0.23.1 >Reporter: Jaigak Song >Assignee: Jaigak Song > Fix For: 3.0.0 > > Attachments: MAPREDUCE-4393.patch > > Original Estimate: 336h > Remaining Estimate: 336h > > This application is to demonstrate that YARN can be used for non-mapreduce > applications. As Hadoop has already been adopted and deployed widely and its > deployment in future will be highly increased, we thought that it's a good > potential to be used as PaaS. > I have implemented a proof of concept to demonstrate that YARN can be used as > a PaaS (Platform as a Service). I have done a gap analysis against VMware's > Cloud Foundry and tried to achieve as many PaaS functionalities as possible > on YARN. > I'd like to check in this POC as a YARN example application. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4393) PaaS on YARN: an YARN application to demonstrate that YARN can be used as a PaaS
[ https://issues.apache.org/jira/browse/MAPREDUCE-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaigak Song updated MAPREDUCE-4393: --- Attachment: MAPREDUCE-4393.patch Please review the changes (actually they are all new files). Thanks! > PaaS on YARN: an YARN application to demonstrate that YARN can be used as a > PaaS > > > Key: MAPREDUCE-4393 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4393 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: examples >Affects Versions: 0.23.1 >Reporter: Jaigak Song > Fix For: 3.0.0 > > Attachments: MAPREDUCE-4393.patch > > Original Estimate: 336h > Remaining Estimate: 336h > > This application is to demonstrate that YARN can be used for non-mapreduce > applications. As Hadoop has already been adopted and deployed widely and its > deployment in future will be highly increased, we thought that it's a good > potential to be used as PaaS. > I have implemented a proof of concept to demonstrate that YARN can be used as > a PaaS (Platform as a Service). I have done a gap analysis against VMware's > Cloud Foundry and tried to achieve as many PaaS functionalities as possible > on YARN. > I'd like to check in this POC as a YARN example application. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira