Re: How to manually kick off an ASF -> github git sync

2018-11-19 Thread Xiao Li
That is how I did it in the past. It should work. On Mon, Nov 19, 2018 at 3:08 PM Sean Owen wrote: > I noticed the sync hasn't happened for about 2 days, and noticed > https://issues.apache.org/jira/browse/INFRA-17269 and also noticed > from there that we can trigger them manually, at >

How to manually kick off an ASF -> github git sync

2018-11-19 Thread Sean Owen
I noticed the sync hasn't happened for about 2 days, and noticed https://issues.apache.org/jira/browse/INFRA-17269 and also noticed from there that we can trigger them manually, at http://selfserve.apache.org . Neat. I tried it just now; let's see.

Re: [Structured Streaming] Kafka group.id is fixed

2018-11-19 Thread Cody Koeninger
Anastasios it looks like you already identified the two lines that need to change, the string interpolation that depends on UUID.randomUUID and metadataPath.hashCode. I'd factor that out into a function that returns the group id. That function would also need to take the "parameters" variable

Re: Jenkins down?

2018-11-19 Thread Xiao Li
Thanks, Shane! On Mon, Nov 19, 2018 at 12:15 PM Marco Gaido wrote: > Thanks Shane! > > Il giorno lun 19 nov 2018 alle ore 19:14 shane knapp > ha scritto: > >> alright, we're back and building. >> >> On Mon, Nov 19, 2018 at 10:11 AM shane knapp wrote: >> >>> thanks for the heads up... looks

Re: [Structured Streaming] Kafka group.id is fixed

2018-11-19 Thread Anastasios Zouzias
Hi Tom, I initiated an issue here: https://issues.apache.org/jira/browse/SPARK-26121 Feel free to edit/update the ticket. If someone familiar with the codebase has any suggestion on the proper way of fixing this, I could work on it. Best, Anastasios On Mon, Nov 19, 2018 at 4:31 PM Tom Graves

Re: Jenkins down?

2018-11-19 Thread Marco Gaido
Thanks Shane! Il giorno lun 19 nov 2018 alle ore 19:14 shane knapp ha scritto: > alright, we're back and building. > > On Mon, Nov 19, 2018 at 10:11 AM shane knapp wrote: > >> thanks for the heads up... looks like the backup process got wedged. >> i'll restart jenkins now. >> >> On Mon, Nov

Re: Make Scala 2.12 as default Scala version in Spark 3.0

2018-11-19 Thread shane knapp
> > > Maintaining a separate PR builder for 2.11 isn't so bad > i actually beg to differ... it's more of a PITA than you might realize managing more than one PRB (we have two already). a much better solution would be for the test launching code either in the PRB config, or scripts in the repo

Re: Jenkins down?

2018-11-19 Thread shane knapp
alright, we're back and building. On Mon, Nov 19, 2018 at 10:11 AM shane knapp wrote: > thanks for the heads up... looks like the backup process got wedged. > i'll restart jenkins now. > > On Mon, Nov 19, 2018 at 9:56 AM Sean Owen wrote: > >> Jenkins says it's shutting down; I assume shane

Re: Jenkins down?

2018-11-19 Thread shane knapp
thanks for the heads up... looks like the backup process got wedged. i'll restart jenkins now. On Mon, Nov 19, 2018 at 9:56 AM Sean Owen wrote: > Jenkins says it's shutting down; I assume shane needs to cycle it. > Note also that the Apache - github sync looks like it is stuck; > nothing has

Re: Jenkins down?

2018-11-19 Thread Sean Owen
Jenkins says it's shutting down; I assume shane needs to cycle it. Note also that the Apache - github sync looks like it is stuck; nothing has synced since yesterday: https://github.com/apache/spark/commits/master That might also be a factor in whatever you're observing. On Mon, Nov 19, 2018 at

Jenkins down?

2018-11-19 Thread Marco Gaido
Hi all, I see that Jenkins is not starting builds for the PRs today. Is it in maintenance? Thanks, Marco

Re: [Structured Streaming] Kafka group.id is fixed

2018-11-19 Thread Tom Graves
This makes sense to me and was going to propose something similar in order to be able to use the kafka acls more effectively as well, can you file a jira for it? Tom On Friday, November 9, 2018, 2:26:12 AM CST, Anastasios Zouzias wrote: Hi all, I run in the following situation with

Re: Coalesce behaviour

2018-11-19 Thread Sergey Zhemzhitsky
I've managed to spend some time digging deeper into this issue and it seems that for some cases it can be fixed pretty easily. I've raised a JIRA: https://issues.apache.org/jira/browse/SPARK-26114 ... and the corresponding pull request: https://github.com/apache/spark/pull/23083 It does not cover