Re: Write access to wiki

Thanks Sean, I will send you the edit on the JIRA to keep email traffic low:-) Thanks Shane, comments in line. On Mon, Jan 11, 2016 at 2:50 PM, shane knapp wrote: > > Shane may be able to fill you in on how the Jenkins build is set up. > > > mark: yes. yes i can. :) > >

Re: Write access to wiki

> Shane may be able to fill you in on how the Jenkins build is set up. > mark: yes. yes i can. :) currently, we have a set of bash scripts and binary packages on our jenkins master that can turn a bare centos install in to a jenkins worker. i've also been porting over these bash tools in to

Re: BUILD FAILURE...again?! :( Spark Project External Flume on fire

I've got a hotfix which should address it: https://github.com/apache/spark/pull/10693 On Sun, Jan 10, 2016 at 11:50 PM, Jacek Laskowski wrote: > Hi, > > It appears that the last commit [1] broke the build. Is anyone working > on it? I can when told so. > > ➜ spark

Re: XML column not supported in Database

Hi Reynold, I did create a issue in JIRA. It is SPARK-12764 On Tue, Jan 12, 2016 at 4:55 AM, Reynold Xin wrote: > Can you file a JIRA ticket? Thanks. > > The URL is issues.apache.org/jira/browse/SPARK > > On Mon, Jan 11,

Write access to wiki

Hi all, May I please get write access to the useful tools wiki page? I did some investigation

Re: BUILD FAILURE...again?! :( Spark Project External Flume on fire

I confirm: I have the same issue. I tried Josh's PR and but the branch is not found: git pull https://github.com/JoshRosen/spark netty-hotfix As the issue is on Flume external, I'm not sure it's related. Let me take a look and eventually provide a fix. Regards JB -- Jean-Baptiste Onofré

Re: BUILD FAILURE...again?! :( Spark Project External Flume on fire

Hi, I've just git pull and it worked for me. Looks like https://github.com/apache/spark/commit/f13c7f8f7dc8766b0a42406b5c3639d6be55cf33 fixed the issue (or something in-between). Thanks for such a quick fix! p.s. Had time for swimming :-) Pozdrawiam, Jacek Jacek Laskowski |

Re: [discuss] dropping Python 2.6 support

FWIW, RHEL 6 still uses Python 2.6, although 2.7.8 and 3.3.2 are available through Red Hat Software Collections. See: https://www.softwarecollections.org/en/ I run an academic compute cluster on RHEL 6. We do, however, provide Python 2.7.x and 3.5.x via modulefiles. On Tue, Jan 5, 2016 at 8:45

Python custom partitioning

Hi, I am trying to implement Gap statistics on Spark, which aims to determine actual number of clusters for KMeans. Giving the range of possible Ks (e.g. K = 10), Gap will run KMeans for each K in the range. Since computation of Kmeans for K=10 takes more time than K=1,2,3,4 together, I would

Re: Dataset throws: Task not serializable

Hello Michael, Sorry for the late replay .. I was crossing the world the last few days. I actually tried both ... REPEL and SparkApp. The reported exception was in App. Unfortunately the data I have is not for distribution ... sorry about that. I saw it has been resolved.. I will try to

Re: [build system] jenkins wedged, had to do a quick restart

...aaand we're back up and building. shane On Mon, Jan 11, 2016 at 9:47 AM, shane knapp wrote: > jenkins looked to be wedged, and nothing was showing up in the logs. > i tried a restart, and am still looking in to the problem. > > we should be back up and building

[build system] jenkins wedged, had to do a quick restart

jenkins looked to be wedged, and nothing was showing up in the logs. i tried a restart, and am still looking in to the problem. we should be back up and building shortly. sorry for the inconvenience. shane - To unsubscribe,