Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 On Tue, Feb 11, 2014 at 9:17 AM, Matt Massie mas...@berkeley.edu wrote: +1 -- Matt Massie UC, Berkeley AMPLab Twitter: @matt_massie https://twitter.com/matt_massie, @amplabhttps://twitter.com/amplab https://amplab.cs.berkeley.edu/ On Mon, Feb 10, 2014 at 11:12 PM, Zongheng Yang zonghen...@gmail.com wrote: +1 On Mon, Feb 10, 2014 at 10:21 PM, Reynold Xin r...@databricks.com wrote: Actually I made a mistake by saying binding. Just +1 here. On Mon, Feb 10, 2014 at 10:20 PM, Mattmann, Chris A (3980) chris.a.mattm...@jpl.nasa.gov wrote: Hi Nathan, anybody is welcome to to VOTE. Thank you. Only VOTEs from the Incubator PMC are what is considered binding, but I welcome and will tally all VOTEs provided. Cheers, Chris -Original Message- From: Nathan Kronenfeld nkronenf...@oculusinfo.com Reply-To: dev@spark.incubator.apache.org dev@spark.incubator.apache.org Date: Monday, February 10, 2014 9:44 PM To: dev@spark.incubator.apache.org dev@spark.incubator.apache.org Subject: Re: [VOTE] Graduation of Apache Spark from the Incubator Who is allowed to vote on stuff like this? On Mon, Feb 10, 2014 at 11:27 PM, Chris Mattmann mattm...@apache.orgwrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged.
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 (binding) On 02/11/2014 09:02 AM, Nick Pentreath wrote: +1 On Tue, Feb 11, 2014 at 9:17 AM, Matt Massie mas...@berkeley.edu wrote: +1 -- Matt Massie UC, Berkeley AMPLab Twitter: @matt_massie https://twitter.com/matt_massie, @amplabhttps://twitter.com/amplab https://amplab.cs.berkeley.edu/ On Mon, Feb 10, 2014 at 11:12 PM, Zongheng Yang zonghen...@gmail.com wrote: +1 On Mon, Feb 10, 2014 at 10:21 PM, Reynold Xin r...@databricks.com wrote: Actually I made a mistake by saying binding. Just +1 here. On Mon, Feb 10, 2014 at 10:20 PM, Mattmann, Chris A (3980) chris.a.mattm...@jpl.nasa.gov wrote: Hi Nathan, anybody is welcome to to VOTE. Thank you. Only VOTEs from the Incubator PMC are what is considered binding, but I welcome and will tally all VOTEs provided. Cheers, Chris -Original Message- From: Nathan Kronenfeld nkronenf...@oculusinfo.com Reply-To: dev@spark.incubator.apache.org dev@spark.incubator.apache.org Date: Monday, February 10, 2014 9:44 PM To: dev@spark.incubator.apache.org dev@spark.incubator.apache.org Subject: Re: [VOTE] Graduation of Apache Spark from the Incubator Who is allowed to vote on stuff like this? On Mon, Feb 10, 2014 at 11:27 PM, Chris Mattmann mattm...@apache.orgwrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged. -- Nathan Kronenfeld Senior Visualization Developer Oculus Info Inc 2 Berkeley Street, Suite 600, Toronto, Ontario M5A 4J5 Phone: +1-416-203-3003 x 238 Email: nkronenf...@oculusinfo.com
[GitHub] incubator-spark pull request: Java-api completeness
Github user NirmalReddy commented on the pull request: https://github.com/apache/incubator-spark/pull/475#issuecomment-34736734 @tdas Can you please verify this patch. Thanks !!
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
GitHub user jyotiska opened a pull request: https://github.com/apache/incubator-spark/pull/581 Added extra description on ValueError when one Spark context already exists I added extra description on the ValueError message, when more than one Spark context already exists. Added the current master name and the app name for easier understanding. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incubator-spark master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-spark/pull/581.patch commit 945e39a5d68daa7e5bab0d96cbd35d7c4b04eafb Author: jyotiska jyotiska...@gmail.com Date: 2014-02-08T07:29:09Z Added example python code for sort commit 6f98f1e313f4472a7c2207d36c4f0fbcebc95a8c Author: jyotiska jyotiska...@gmail.com Date: 2014-02-08T07:42:37Z Updated python example code sort.py commit 8ad8faf6c8e02ae1cd68565d98524edf165f54df Author: jyotiska jyotiska...@gmail.com Date: 2014-02-09T05:30:41Z Added comments in code on collect() method commit 92e23fea707ed6de551dc8d5ffa9b4f987683628 Author: jyotiska jyotiska...@gmail.com Date: 2014-02-11T13:40:15Z Added extra description on ValueError when one Spark context already running commit d90bea59f15738a00e03c9761ea27157ad2ef04d Author: jyotiska jyotiska...@gmail.com Date: 2014-02-11T13:55:12Z Merge remote-tracking branch 'upstream/master'
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-34758328 Can one of the admins verify this patch?
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user jyotiska closed the pull request at: https://github.com/apache/incubator-spark/pull/581
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
GitHub user jyotiska reopened a pull request: https://github.com/apache/incubator-spark/pull/581 Added extra description on ValueError when one Spark context already exists I added extra description on the ValueError message, when more than one Spark context already exists. Added the current master name and the app name for easier understanding. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incubator-spark master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-spark/pull/581.patch commit 945e39a5d68daa7e5bab0d96cbd35d7c4b04eafb Author: jyotiska jyotiska...@gmail.com Date: 2014-02-08T07:29:09Z Added example python code for sort commit 6f98f1e313f4472a7c2207d36c4f0fbcebc95a8c Author: jyotiska jyotiska...@gmail.com Date: 2014-02-08T07:42:37Z Updated python example code sort.py commit 8ad8faf6c8e02ae1cd68565d98524edf165f54df Author: jyotiska jyotiska...@gmail.com Date: 2014-02-09T05:30:41Z Added comments in code on collect() method commit 92e23fea707ed6de551dc8d5ffa9b4f987683628 Author: jyotiska jyotiska...@gmail.com Date: 2014-02-11T13:40:15Z Added extra description on ValueError when one Spark context already running commit d90bea59f15738a00e03c9761ea27157ad2ef04d Author: jyotiska jyotiska...@gmail.com Date: 2014-02-11T13:55:12Z Merge remote-tracking branch 'upstream/master'
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 On Mon, Feb 10, 2014 at 8:27 PM, Chris Mattmann mattm...@apache.org wrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged. -- Haoyuan Li Algorithms, Machines, People Lab, EECS, UC Berkeley http://www.cs.berkeley.edu/~haoyuan/
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 ! - Mridul On Tue, Feb 11, 2014 at 9:57 AM, Chris Mattmann mattm...@apache.org wrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged.
[GitHub] incubator-spark pull request: Add Security to Spark - Akka, Http, ...
Github user tgravescs commented on the pull request: https://github.com/apache/incubator-spark/pull/332#issuecomment-34763698 Sorry for my delay, I was on vacation last week. Thanks for the reviews, I'll go through them and respond. It sounds like you want 2 types of documents, more user docs which I'll look at adding more to the .md files and then a dev design doc. where do you want that to live? or were you just thinking more comments in the code? The SaslClient and SaslServer classes are java as the original was borrowed from Hadoop and then modified. We can convert to scala. Also note that I concentrated on spark on yarn for this. It still works for standalone deploy but probably isn't ideal as far as how the shared secret is actually created/configured.
Re:[VOTE] Graduation of Apache Spark from the Incubator
+1
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 -- GIRI IYENGAR, CTO VELOS.IO Simple. Powerful. Predictions. 440 NINTH AVE, 11TH FLOOR NEW YORK CITY, NY 10001 O: 917.525.2466x104 M: 914.924.7935 E: *giri.iyengar@v giri.iyen...@sociocast.comelos.io http://elos.io* W: *www.velos. http://www.sociocast.com/io*
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 Yours, Xuefeng Wu 吴雪峰 敬上 On 2014年2月11日, at 下午12:27, Chris Mattmann mattm...@apache.org wrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged.
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 !!! On 2/10/14, 9:27 PM, Chris Mattmann mattm...@apache.org wrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged.
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1. Tom On Tuesday, February 11, 2014 10:13 AM, Andrew Psaltis psaltis.and...@gmail.com wrote: +1 On Tue, Feb 11, 2014 at 8:50 AM, Giri Iyengar giri.iyen...@velos.io wrote: +1 -- GIRI IYENGAR, CTO VELOS.IO Simple. Powerful. Predictions. 440 NINTH AVE, 11TH FLOOR NEW YORK CITY, NY 10001 O: 917.525.2466x104 M: 914.924.7935 E: *giri.iyengar@v giri.iyen...@sociocast.comelos.io http://elos.io* W: *www.velos. http://www.sociocast.com/io*
Re: Proposal for JIRA and Pull Request Policy
+1 This is a bit aside, but are we also getting jenkins machine in the apache domain? Tom On Friday, February 7, 2014 1:54 AM, Kostas Sakellis kos...@cloudera.com wrote: +1 On Thursday, February 6, 2014, Sandy Ryza sandy.r...@cloudera.com wrote: +1 On Thu, Feb 6, 2014 at 4:10 PM, Mridul Muralidharan mri...@gmail.comjavascript:; wrote: +1 Would be great if the JIRA tag was 'clickable' to go to the actual JIRA :-) Regards, Mridul On Fri, Feb 7, 2014 at 5:35 AM, Patrick Wendell pwend...@gmail.comjavascript:; wrote: As a break out from the other thread. I'd like to propose two guidelines for pull requests. These guidelines are to make things easier to track for developers and users, and to help organize the large number of PR's that we are receiving. Thoughts? 1. Pull requests will require associated JIRA's. We will ask people to create a JIRA if there is none yet. 2. Pull request names should ideally convey: (a) The JIRA name (b) A title summarizing the patch (c) [optional prefix] The library it is related to (d) [optional prefix] WIP or RFC if it is not finished. Example names: SPARK-123: Add some feature to Spark [STREAMING] SPARK-123: Add some feature to Spark streaming [MLLIB] [WIP] SPARK-123: Some potentially useful feature for MLLib - Patrick
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Graduation-of-Apache-Spark-from-the-Incubator-tp1022p1082.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 Craig On Feb 10, 2014, at 8:27 PM, Chris Mattmann wrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org Craig L Russell Architect, Oracle http://db.apache.org/jdo 408 276-5638 mailto:craig.russ...@oracle.com P.S. A good JDO? O, Gasp!
Re: [VOTE] Graduation of Apache Spark from the Incubator
+ 1 (binding). Suresh On Feb 10, 2014, at 11:27 PM, Chris Mattmann mattm...@apache.org wrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged.
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-34782466 This tries to solve [SPARK-972](https://spark-project.atlassian.net/browse/SPARK-972)
Re: [VOTE] Graduation of Apache Spark from the Incubator
On Mon, Feb 10, 2014 at 8:27 PM, Chris Mattmann mattm...@apache.org wrote: [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. +1 (binding) Marvin Humphrey
Proposal for JIRA and Pull Request Policy
The ASF infra support all Hadoop and it's community projects CI requests, as well as other ASF projects. From my experience with other ASF projects the Jenkins support has been great. And also ASF infra is accepting help if you guys think you could spare time and knowledge. Henry On Tuesday, February 11, 2014, Mark Hamstra m...@clearstorydata.comjavascript:_e(%7B%7D,'cvml','m...@clearstorydata.com'); wrote: Whether that is a good idea or not depends largely, I think, on who will have control of that putative Apache Jenkins. The AMPLab-now-mostly-Databricks guys (i.e. Andy and others) who did the work of setting up, configuring and maintaining the current Jenkins have done a great job and have been very responsive when Jenkins has needed attention. I would require convincing that the Apache infra team could match that performance. On Tue, Feb 11, 2014 at 8:40 AM, Tom Graves tgraves...@yahoo.com wrote: +1 This is a bit aside, but are we also getting jenkins machine in the apache domain? Tom On Friday, February 7, 2014 1:54 AM, Kostas Sakellis kos...@cloudera.com wrote: +1 On Thursday, February 6, 2014, Sandy Ryza sandy.r...@cloudera.com wrote: +1 On Thu, Feb 6, 2014 at 4:10 PM, Mridul Muralidharan mri...@gmail.com javascript:; wrote: +1 Would be great if the JIRA tag was 'clickable' to go to the actual JIRA :-) Regards, Mridul On Fri, Feb 7, 2014 at 5:35 AM, Patrick Wendell pwend...@gmail.com javascript:; wrote: As a break out from the other thread. I'd like to propose two guidelines for pull requests. These guidelines are to make things easier to track for developers and users, and to help organize the large number of PR's that we are receiving. Thoughts? 1. Pull requests will require associated JIRA's. We will ask people to create a JIRA if there is none yet. 2. Pull request names should ideally convey: (a) The JIRA name (b) A title summarizing the patch (c) [optional prefix] The library it is related to (d) [optional prefix] WIP or RFC if it is not finished. Example names: SPARK-123: Add some feature to Spark [STREAMING] SPARK-123: Add some feature to Spark streaming [MLLIB] [WIP] SPARK-123: Some potentially useful feature for MLLib - Patrick
Re: Proposal for JIRA and Pull Request Policy
+1 to the proposal On Thursday, February 6, 2014, Patrick Wendell pwend...@gmail.com wrote: As a break out from the other thread. I'd like to propose two guidelines for pull requests. These guidelines are to make things easier to track for developers and users, and to help organize the large number of PR's that we are receiving. Thoughts? 1. Pull requests will require associated JIRA's. We will ask people to create a JIRA if there is none yet. 2. Pull request names should ideally convey: (a) The JIRA name (b) A title summarizing the patch (c) [optional prefix] The library it is related to (d) [optional prefix] WIP or RFC if it is not finished. Example names: SPARK-123: Add some feature to Spark [STREAMING] SPARK-123: Add some feature to Spark streaming [MLLIB] [WIP] SPARK-123: Some potentially useful feature for MLLib - Patrick
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34792614 Merged build triggered.
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34792615 Merged build started.
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34792737 Merged build finished.
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34792740 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12677/
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 (binding) -Jake On Mon, Feb 10, 2014 at 11:27 PM, Chris Mattmann mattm...@apache.orgwrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [VOTE] Graduation of Apache Spark from the Incubator
On Mon, Feb 10, 2014 at 8:27 PM, Chris Mattmann mattm...@apache.org wrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. +1 (binding) Thanks, Roman.
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34795845 Merged build triggered.
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34797009 Merged build started.
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-34796972 I understand. Maybe we can use a global variable to store the call site (line number?) and print it back along with the address. What do you think?
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34797008 Merged build triggered.
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user JoshRosen commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-34797494 I'd store the constructor's call site (filename + line number) as an instance variable inside SparkContext, since we already have the `SparkContext._active_spark_context` global to retrieve the running context.
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-34798126 Got it. I will work on it and report it back to you. I guess traceback module will be useful here.
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34798894 Merged build finished.
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34798895 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12678/
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user JoshRosen commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-34799232 You may be able to re-use the [`_extract_concise_traceback`](https://github.com/apache/incubator-spark/pull/311/files#diff-d6fe2792e44f6babc94aabfefc8b9bceR43) method in `rdd.py`.
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
GitHub user willb opened a pull request: https://github.com/apache/incubator-spark/pull/582 SPARK-1078: Replace lift-json with json4s-jackson. The aim of the Json4s project is to provide a common API for Scala JSON libraries. It is Apache-licensed, easier for downstream distributions to package, and mostly API-compatible with lift-json. Furthermore, the Jackson-backed implementation parses faster than lift-json on all but the smallest inputs. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incubator-spark json4s Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-spark/pull/582.patch commit 2c9f7f77849d83ab0b250c5fe80d8c599c2a8855 Author: William Benton s...@willbenton.com Date: 2014-02-11T17:11:56Z Replace lift-json with json4s-jackson. The aim of the Json4s project is to provide a common API for Scala JSON libraries. It is Apache-licensed, easier for downstream distributions to package, and mostly API-compatible with lift-json. Furthermore, the Jackson-backed implementation parses faster than lift-json on all but the smallest inputs. Squashed commit of the following: commit d07b75538af5c8c4f698834aa4203ff8def69872 commit c54addda88cd9369aaeb22c5485630bf76450452 commit 2c1387f2f8e4798be9c8d4535cf2853ca3982a91
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34799861 Can one of the admins verify this patch?
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34800114 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12679/
[GitHub] incubator-spark pull request: MLI-2: Add k-fold cross validation t...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/572#issuecomment-34800110 Merged build finished.
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34801246 Jenkins, add to whitelist.
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34801415 Merged build triggered.
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34801416 Merged build started.
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-34804481 I have used the _extract_concise_traceback to print the callsite of existing SparkContext. I guess this is what you had in mind.
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34804702 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12680/
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34804701 Merged build finished.
[GitHub] incubator-spark pull request: SPARK-1075 Fix doc in the Spark Stre...
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/577#issuecomment-34817976 Thanks. I've merged this.
[GitHub] incubator-spark pull request: SPARK-1072 Use binary search when ne...
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/571#issuecomment-34818238 Thanks. I've merged this.
Could someone with karma to add my userid hsaputra so I could assign issue in https://spark-project.atlassian.net?
Hi Guys, With ASF JIRA still in transfer mode, could someone with permission to add my userid hsaputra in https://spark-project.atlassian.net so I could assign issues and resolve them myself? CC @pwendell or @rxin Thanks, - Henry
Re: Could someone with karma to add my userid hsaputra so I could assign issue in https://spark-project.atlassian.net?
Thanks Reynold! =) - Henry On Tue, Feb 11, 2014 at 3:05 PM, Reynold Xin r...@databricks.com wrote: I added you to the dev list on jira for spark. On Tue, Feb 11, 2014 at 2:58 PM, Henry Saputra henry.sapu...@gmail.comwrote: Hi Guys, With ASF JIRA still in transfer mode, could someone with permission to add my userid hsaputra in https://spark-project.atlassian.net so I could assign issues and resolve them myself? CC @pwendell or @rxin Thanks, - Henry
[GitHub] incubator-spark pull request: SPARK-1075 Fix doc in the Spark Stre...
Github user hsaputra closed the pull request at: https://github.com/apache/incubator-spark/pull/577
Re: [VOTE] Graduation of Apache Spark from the Incubator
+1 (non-binding) On Tue, Feb 11, 2014 at 8:31 AM, Sean McNamara sean.mcnam...@webtrends.comwrote: +1 !!! On 2/10/14, 9:27 PM, Chris Mattmann mattm...@apache.org wrote: Hi Everyone, This is a new VOTE to decide if Apache Spark should graduate from the Incubator. Please VOTE on the resolution pasted below the ballot. I'll leave this VOTE open for at least 72 hours. Thanks! [ ] +1 Graduate Apache Spark from the Incubator. [ ] +0 Don't care. [ ] -1 Don't graduate Apache Spark from the Incubator because.. Here is my +1 binding for graduation. Cheers, Chris snip WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to fast and flexible large-scale data analysis on clusters. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the Apache Spark Project, be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Spark Project be and hereby is responsible for the creation and maintenance of software related to fast and flexible large-scale data analysis on clusters; and be it further RESOLVED, that the office of Vice President, Apache Spark be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Spark Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Spark Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Spark Project: * Mosharaf Chowdhury mosha...@apache.org * Jason Dai jason...@apache.org * Tathagata Das t...@apache.org * Ankur Dave ankurd...@apache.org * Aaron Davidson a...@apache.org * Thomas Dudziak to...@apache.org * Robert Evans bo...@apache.org * Thomas Graves tgra...@apache.org * Andy Konwinski and...@apache.org * Stephen Haberman steph...@apache.org * Mark Hamstra markhams...@apache.org * Shane Huang shane_hu...@apache.org * Ryan LeCompte ryanlecom...@apache.org * Haoyuan Li haoy...@apache.org * Sean McNamara mcnam...@apache.org * Mridul Muralidharam mridul...@apache.org * Kay Ousterhout kayousterh...@apache.org * Nick Pentreath mln...@apache.org * Imran Rashid iras...@apache.org * Charles Reiss wog...@apache.org * Josh Rosen joshro...@apache.org * Prashant Sharma prash...@apache.org * Ram Sriharsha har...@apache.org * Shivaram Venkataraman shiva...@apache.org * Patrick Wendell pwend...@apache.org * Andrew Xia xiajunl...@apache.org * Reynold Xin r...@apache.org * Matei Zaharia ma...@apache.org NOW, THEREFORE, BE IT FURTHER RESOLVED, that Matei Zaharia be appointed to the office of Vice President, Apache Spark, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Spark Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Spark podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Spark podling encumbered upon the Apache Incubator Project are hereafter discharged. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[GitHub] incubator-spark pull request: SPARK-1072 Use binary search when ne...
Github user liancheng commented on the pull request: https://github.com/apache/incubator-spark/pull/571#issuecomment-34825349 @aarondav I wonder is `@specialized` can be used here to avoid the type dispatching in `CollectionUtils`?
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34829822 Does json4s-jackson include any dependencies that lift-json doesn't? Does the versioning match? It seems that this version of json4s-jackson pulls in jackson 2.3.0, whereas currently our dependencies are pulling in 2.2.2. Are these versions binary compatible, or could we see issues crop up?
[GitHub] incubator-spark pull request: SPARK-1053. Don't require SPARK_YARN...
Github user colorant commented on the pull request: https://github.com/apache/incubator-spark/pull/553#issuecomment-34830448 @sryza I think this depends on what you mean to do with the yarn-client mode, for spark-shell, since it is already packaged in the assembly jar. you don't need to set the SPARK_YARN_APP_JAR env. And the yarn doc just happen to take spark-shell as an example. While for those user apps which are not packaged in the spark assembly jar, you will need it , for either yarn-standalone and yarn-client mode. ( while, there are also other ways to add them, say with --files etc, but this one is a shortcut and actually treat default local file URL format differently ).
[GitHub] incubator-spark pull request: SPARK-1053. Don't require SPARK_YARN...
Github user sryza commented on the pull request: https://github.com/apache/incubator-spark/pull/553#issuecomment-34830852 It's true that you may need it when running in yarn-client mode. And also true that you will not when running spark-shell. Because it depends, I think not requiring it is easiest. We could do something to try to figure out whether spark-shell is being run, and printing an error in that case, but that sounds like overkill to me. What do you think? The doc covers both cases and sets it in the example that doesn't use spark-shell.
[GitHub] incubator-spark pull request: SPARK-1053. Don't require SPARK_YARN...
Github user colorant commented on the pull request: https://github.com/apache/incubator-spark/pull/553#issuecomment-34831254 I agree that we do not need a hard check on it :) This patch looks good to me, I just wonder we might need a few more explanation to clarify why this one is not need in certain case like spark-shell :)
RE: Does yarn-stable still accept pull request?
Should be fixed in both alpha and stable code base, since we aim to support both version Best Regards, Raymond Liu -Original Message- From: Nan Zhu [mailto:zhunanmcg...@gmail.com] Sent: Wednesday, February 12, 2014 10:29 AM To: dev@spark.incubator.apache.org Subject: Does yarn-stable still accept pull request? Hi, all I’m a new user of spark-yarn I would like to create a pull request for an issue found in my usage, where should I modify the code, stable or alpha (the problem exists in both)? Best, -- Nan Zhu
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user willb commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34834423 The current version of json4s-jackson depends on paranamer 2.6, while the current version of lift-json depends on 2.4.1. That's the only difference that winds up getting pulled in by a Spark build, although json4s has an optional extension (not currently exercised by Spark AFAICT) to use joda-time 2.3 and joda-convert 1.5. Lift's dependencies on these joda libraries (also not exercised by Spark AFAICT) are on versions 2.1 and 1.2, respectively. FasterXML claims that subsequent Jackson minor releases in a major series are backwards-compatible; looking at the version history, it doesn't appear that anything critical has been removed from 2.2.2 to 2.3.
Re: proposal: replace lift-json with spray-json
I am not sure I fully understand this reasoning. I imagine that lift-json is only one of hundreds of packages that would have to be built if you wanted to build all of Spark's transitive dependencies from source. Additionally, to make sure I understand the impact -- this is only intended to simplify the process of packaging Spark on a new OS distribution that disallows pulling in binaries? On Sun, Feb 9, 2014 at 4:50 PM, Will Benton wi...@redhat.com wrote: Matei, sorry if I was unclear: I'm referring to downstream operating system distributions (like Fedora or Debian) that have policies requiring that all packages are built from source (using only tools already packaged in the distribution). So end-users (and distributions with different policies) don't have to build Lift to get the lift-json artifact, but it is a concern for many open-source communities. best, wb - Original Message - From: Matei Zaharia matei.zaha...@gmail.com To: dev@spark.incubator.apache.org Sent: Sunday, February 9, 2014 4:29:20 PM Subject: Re: proposal: replace lift-json with spray-json Will, why are you saying that downstream distributes need to build all of Lift to package lift-json? Spark just downloads it from Maven Central, where it's a JAR with no external dependencies. We don't have any dependency on the rest of lift. Matei On Feb 9, 2014, at 11:28 AM, Will Benton wi...@redhat.com wrote: lift-json is a nice library, but Lift is a pretty heavyweight dependency to track just for its JSON support. (lift-json is relatively self-contained as a dependency from an end-user's perspective, but downstream distributors need to build all of Lift in order to package the JSON support.) I understand that this has come up before (cf. SPARK-883) and that the uncertain future of JSON support in the Scala standard library is the motivator for relying on an external library. I'm proposing replacing lift-json in Spark with something more lightweight. I've evaluated apparent project liveness and dependency scope for most of the current Scala JSON libraries and believe the best candidate is spray-json (https://github.com/spray/spray-json), the JSON library used by the Spray HTTP toolkit. spray-json is Apache-licensed, actively developed, and builds and works independently of Spray with only one external dependency. It looks to me like a pretty straightforward change (although JsonProtocol.scala would be a little more verbose since it couldn't use the Lift JSON DSL), and I'd like to do it. I'm writing now to ask for some community feedback before making the change (and submitting a JIRA and PR). If no one has any serious objections (to the effort in general or to to the choice of spark-json in particular), I'll go ahead and do it, but if anyone has concerns, I'd be happy to discuss and address them before getting started. thanks, wb
[GitHub] incubator-spark pull request: Added extra description on ValueErro...
Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/581#issuecomment-34836413 I think for future improvements, it would be a good idea to move the traceback code to a separate file and use that to return callsite. Please start a JIRA ticket and assign it to me. I will submit a PR once I am done.
[GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34836430 Thanks for looking into it! The situation sounds fine for the next minor release, and I don't think this patch needs to be included in the next maintenance release anyway (following your very own [suggestion](http://mail-archives.apache.org/mod_mbox/spark-dev/201402.mbox/browser) on the dev list). While this patch looks good to me, I am not sure I fully understand the need for it. I posted my question on the [dev list thread](http://mail-archives.apache.org/mod_mbox/spark-dev/201402.mbox/%3C945190638.685798.1391974088596.JavaMail.zimbra%40redhat.com%3E). Besides the dependency change, you also mention performance improvements. [This benchmark](http://engineering.ooyala.com/blog/comparing-scala-json-libraries) does show Jackson outperforming lift on a particular workload, but do you have another source showing how the relative performance changes with input size?
Re: [GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
I think Aaron just meant 1.0.0 by the next minor release. On Tue, Feb 11, 2014 at 7:56 PM, Mark Hamstra m...@clearstorydata.com wrote: The situation sounds fine for the next minor release... I don't understand what you mean by this. According to my current understanding, the next release of Spark other than maintenance releases on 0.9.x is intended to be a major release, 1.0.0, and there are no plans for an intervening minor release, which would be 0.10.0. Thus the next minor release would be 1.1.0, and I fail to see why we would wait for that instead of putting the dependency change (assuming that it is something that we do, indeed, want) in 1.0.0. On Tue, Feb 11, 2014 at 7:51 PM, aarondav g...@git.apache.org wrote: Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34836430 Thanks for looking into it! The situation sounds fine for the next minor release, and I don't think this patch needs to be included in the next maintenance release anyway (following your very own [suggestion]( http://mail-archives.apache.org/mod_mbox/spark-dev/201402.mbox/browser) on the dev list). While this patch looks good to me, I am not sure I fully understand the need for it. I posted my question on the [dev list thread]( http://mail-archives.apache.org/mod_mbox/spark-dev/201402.mbox/%3C945190638.685798.1391974088596.JavaMail.zimbra%40redhat.com%3E). Besides the dependency change, you also mention performance improvements. [This benchmark]( http://engineering.ooyala.com/blog/comparing-scala-json-libraries) does show Jackson outperforming lift on a particular workload, but do you have another source showing how the relative performance changes with input size?
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
GitHub user colorant opened a pull request: https://github.com/apache/incubator-spark/pull/583 Minor fix for ZooKeeperPersistenceEngine to use configured working dir You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incubator-spark zookeeper Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-spark/pull/583.patch commit b4861ee75dbd5cb55ba40805cd58fc3a0cdc5159 Author: Raymond Liu raymond@intel.com Date: 2014-02-12T03:35:36Z Minor fix for ZooKeeperPersistenceEngine to use configured working dir
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34838201 Good catch! LGTM.
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34838194 Merged build started.
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34838371 Merged build triggered.
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user colorant commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34838369 oops, catch me ;) updated
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34838372 Merged build started.
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34838606 Merged build triggered.
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34838607 Merged build started.
[GitHub] incubator-spark pull request: Hadoop jar name
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/522#issuecomment-34839013 Build started.
[GitHub] incubator-spark pull request: Hadoop jar name
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/522#issuecomment-34839050 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12684/
[GitHub] incubator-spark pull request: Hadoop jar name
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/522#issuecomment-34839049 Build finished.
[GitHub] incubator-spark pull request: Hadoop jar name
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/522#issuecomment-34839244 @bijaybisht this is out of date with master - mind bringing it up to date?
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34839331 Merged build finished.
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34839550 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12682/
[GitHub] incubator-spark pull request: Hadoop jar name
Github user bijaybisht closed the pull request at: https://github.com/apache/incubator-spark/pull/522
[GitHub] incubator-spark pull request: Ported hadoopClient jar for 1.0.1 ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/584#issuecomment-34841291 Can one of the admins verify this patch?
[GitHub] incubator-spark pull request: Hadoop jar name
Github user bijaybisht commented on the pull request: https://github.com/apache/incubator-spark/pull/522#issuecomment-34841425 Pls merge #584 which is merge able now.
[GitHub] incubator-spark pull request: Adding assignRanks and assignUniqueI...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/578#issuecomment-34842337 Merged build started.
[GitHub] incubator-spark pull request: Adding assignRanks and assignUniqueI...
Github user mengxr commented on the pull request: https://github.com/apache/incubator-spark/pull/578#issuecomment-34842407 @rxin Thanks! Please see the updated code.
Re: [GitHub] incubator-spark pull request: SPARK-1078: Replace lift-json with j...
Sounds good, now that we are all clear on what we mean. Didn't mean to be a dick, just was a little confused on what you meant. On Tue, Feb 11, 2014 at 8:08 PM, Patrick Wendell pwend...@gmail.com wrote: I think Aaron just meant 1.0.0 by the next minor release. On Tue, Feb 11, 2014 at 7:56 PM, Mark Hamstra m...@clearstorydata.com wrote: The situation sounds fine for the next minor release... I don't understand what you mean by this. According to my current understanding, the next release of Spark other than maintenance releases on 0.9.x is intended to be a major release, 1.0.0, and there are no plans for an intervening minor release, which would be 0.10.0. Thus the next minor release would be 1.1.0, and I fail to see why we would wait for that instead of putting the dependency change (assuming that it is something that we do, indeed, want) in 1.0.0. On Tue, Feb 11, 2014 at 7:51 PM, aarondav g...@git.apache.org wrote: Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/582#issuecomment-34836430 Thanks for looking into it! The situation sounds fine for the next minor release, and I don't think this patch needs to be included in the next maintenance release anyway (following your very own [suggestion]( http://mail-archives.apache.org/mod_mbox/spark-dev/201402.mbox/browser) on the dev list). While this patch looks good to me, I am not sure I fully understand the need for it. I posted my question on the [dev list thread]( http://mail-archives.apache.org/mod_mbox/spark-dev/201402.mbox/%3C945190638.685798.1391974088596.JavaMail.zimbra%40redhat.com%3E ). Besides the dependency change, you also mention performance improvements. [This benchmark]( http://engineering.ooyala.com/blog/comparing-scala-json-libraries) does show Jackson outperforming lift on a particular workload, but do you have another source showing how the relative performance changes with input size?
[GitHub] incubator-spark pull request: Ported hadoopClient jar for 1.0.1 ...
Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/584#issuecomment-34843361 Jenkins, test this please.
[GitHub] incubator-spark pull request: Ported hadoopClient jar for 1.0.1 ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/584#issuecomment-34843445 Merged build started.
[GitHub] incubator-spark pull request: Ported hadoopClient jar for 1.0.1 ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/584#issuecomment-34843473 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12686/
[GitHub] incubator-spark pull request: Adding assignRanks and assignUniqueI...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/578#issuecomment-34843553 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12685/
[GitHub] incubator-spark pull request: Minor fix for ZooKeeperPersistenceEn...
Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/583#issuecomment-34843731 Merged into master and cherry-picked into branch-0.9 and branch-0.8.
[GitHub] incubator-spark pull request: Ported hadoopClient jar for 1.0.1 ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/584#issuecomment-34844919 Merged build started.
[GitHub] incubator-spark pull request: Ported hadoopClient jar for 1.0.1 ...
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/584#issuecomment-34844932 It's because branch-0.9 doesn't have the scalastyle stuff ...
[GitHub] incubator-spark pull request: Ported hadoopClient jar for 1.0.1 ...
Github user rxin commented on the pull request: https://github.com/apache/incubator-spark/pull/584#issuecomment-34844952 BTW Jenkins desire assertiveness. By asking him whether you could do this, he wouldn't do it ...
[GitHub] incubator-spark pull request: Ported hadoopClient jar for 1.0.1 ...
Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/584#issuecomment-34845592 Jenkins, retest this please.
