Re: Possible lead on Jenkins <-> Github issue

[York, Brennon]

Sean, re: why Jenkins isn¹t posting, looking at that output it looks like
the issue is with the output of the following text:

\nYour branch is ahead of'origin/master' by 200 commits.
Your branch is ahead of 'origin/master' by 200 commits.


Not sure where its coming from (can¹t find it in the master branch), but
after the first line there is an actual newline character (not escaped to
print \n) which is destroying the JSON string from being uploaded to
Github for the post. Still looking into the code to see if I can pinpoint
it, but hope that helps.

On 4/25/15, 5:00 PM, "Sean Owen"  wrote:

>I know Jenkins hasn't been responding to requests to test today. I
>don't know if it's related, but I also noted that test results aren't
>quite posting:
>
>...
>Archiving unit tests logs...
>
>> Send successful.
>Attempting to post to Github...
> > http_code: 400.
> > api_response: {
>  "message": "Problems parsing JSON",
>  "documentation_url": "https://developer.github.com/v3";
>}
> > data: {"body": "  [Test build #701 has
>finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBu
>ilder/701/consoleFull)
>for   PR 5672 at commit
>[`0f1abd0`](https://github.com/apache/spark/commit/0f1abd01287cd33aa73a0b5
>574f95369b8d42910).\n
>* This patch **passes all tests**.\n * This patch merges cleanly.\n *
>This patch adds no public classes.\nYour branch is ahead of
>'origin/master' by 200 commits.
>Your branch is ahead of 'origin/master' by 200 commits.
> * This patch **adds the following new dependencies:**\n   *
>`tachyon-0.6.4.jar`\n   * `tachyon-client-0.6.4.jar`\n\n * This patch
>**removes the following dependencies:**\n   * `tachyon-0.5.0.jar`\n
>* `tachyon-client-0.5.0.jar`\n"}
>Recording test results
>
>Finished: SUCCESS
>
>-
>To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
>For additional commands, e-mail: dev-h...@spark.apache.org
>



The information contained in this e-mail is confidential and/or proprietary to 
Capital One and/or its affiliates. The information transmitted herewith is 
intended only for use by the individual or entity to which it is addressed.  If 
the reader of this message is not the intended recipient, you are hereby 
notified that any review, retransmission, dissemination, distribution, copying 
or other use of, or taking of any action in reliance upon this information is 
strictly prohibited. If you have received this communication in error, please 
contact the sender and delete the material from your computer.


-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Possible lead on Jenkins <-> Github issue

[Sean Owen]

I know Jenkins hasn't been responding to requests to test today. I
don't know if it's related, but I also noted that test results aren't
quite posting:

...
Archiving unit tests logs...

> Send successful.
Attempting to post to Github...
 > http_code: 400.
 > api_response: {
  "message": "Problems parsing JSON",
  "documentation_url": "https://developer.github.com/v3";
}
 > data: {"body": "  [Test build #701 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/701/consoleFull)
for   PR 5672 at commit
[`0f1abd0`](https://github.com/apache/spark/commit/0f1abd01287cd33aa73a0b5574f95369b8d42910).\n
* This patch **passes all tests**.\n * This patch merges cleanly.\n *
This patch adds no public classes.\nYour branch is ahead of
'origin/master' by 200 commits.
Your branch is ahead of 'origin/master' by 200 commits.
 * This patch **adds the following new dependencies:**\n   *
`tachyon-0.6.4.jar`\n   * `tachyon-client-0.6.4.jar`\n\n * This patch
**removes the following dependencies:**\n   * `tachyon-0.5.0.jar`\n
* `tachyon-client-0.5.0.jar`\n"}
Recording test results

Finished: SUCCESS

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Reminder about Spark 1.4.0 deadline of May 1st

[Patrick Wendell]

Hey All,

Just a friendly reminder that May 1st is the feature freeze for Spark
1.4, meaning major outstanding changes will need to land in the next
week.

After May 1st we'll package a release for testing and then go into the
normal triage process where bugs are prioritized and some smaller
features are allowed on a case by case basis (if they are
additive/feature flagged/etc).

As always, I'll invite the community to help participate in code
review of patches in the next week, since review bandwidth is the
single biggest determinant of how many features will get in. Please
also keep in mind that most active committers are working overtime
(nights/weekends) during this period and will try their best to help
usher in as many patches as possible, along with their own code.

As a reminder, release window dates are always maintained on the wiki
and are updated after each release according to our 3 month release
cadence:

https://cwiki.apache.org/confluence/display/SPARK/Wiki+Homepage

Thanks - and happy coding!
- Patrick

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

[Spark SQL] Generating new golden answer files for HiveComparisonTest

[Yin Huai]

Spark SQL developers,

If you are trying to add new tests based on HiveComparisonTest and want to
generate golden answer files with Hive 0.13.1, unfortunately, the setup
work is quite different from that for Hive 0.12. We have updated SQL readme
to include the new instruction for Hive 0.13.1. You can find it at the the
section of "Other dependencies for developers"
.

Please let me know if you still see any issue after setup your environment
based on this instruction.

Thanks,

Yin

Re: Contributing Documentation Changes

[Denny Lee]

Concur with the sentiment - we have a lot of solid external blog posts
ranging on a wide variety of topics. Whether it is a curated community wiki
or something ala spark-packages.org (but for content), what are your
thoughts about having curators to help with this?
On Sat, Apr 25, 2015 at 11:10 Patrick Wendell  wrote:

> It is true that in the past we've posted community tutorials on the
> site. Spark has grown a lot since then and it might be a better fit at
> this point to curate community tutorials on the wiki (something like
> the powered by page) and link to them from the documentation website.
>
> The documentation page overall could use some love, as it's pretty
> outdated.
>
> - Patrick
>
> On Sat, Apr 25, 2015 at 10:15 AM, Akhil Das 
> wrote:
> > I also want to add mine :/
> > Everyone wants to add it seems.
> >
> > Thanks
> > Best Regards
> >
> > On Fri, Apr 24, 2015 at 8:58 PM, madhu phatak 
> wrote:
> >
> >> Hi,
> >> I understand that. The following page
> >>
> >> http://spark.apache.org/documentation.html has a external
> tutorials,blogs
> >> section which points to other blog pages. I wanted to add there.
> >>
> >>
> >>
> >>
> >> Regards,
> >> Madhukara Phatak
> >> http://datamantra.io/
> >>
> >> On Fri, Apr 24, 2015 at 5:17 PM, Sean Owen  wrote:
> >>
> >> > I think that your own tutorials and such should live on your blog. The
> >> > goal isn't to pull in a bunch of external docs to the site.
> >> >
> >> > On Fri, Apr 24, 2015 at 12:57 AM, madhu phatak 
> >> > wrote:
> >> > > Hi,
> >> > >  As I was reading contributing to Spark wiki, it was mentioned that
> we
> >> > can
> >> > > contribute external links to spark tutorials. I have written many
> >> > >  of them in my
> >> blog.
> >> > It
> >> > > will be great if someone can add it to the spark website.
> >> > >
> >> > >
> >> > >
> >> > > Regards,
> >> > > Madhukara Phatak
> >> > > http://datamantra.io/
> >> >
> >>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
> For additional commands, e-mail: dev-h...@spark.apache.org
>
>

Re: Contributing Documentation Changes

[Patrick Wendell]

It is true that in the past we've posted community tutorials on the
site. Spark has grown a lot since then and it might be a better fit at
this point to curate community tutorials on the wiki (something like
the powered by page) and link to them from the documentation website.

The documentation page overall could use some love, as it's pretty outdated.

- Patrick

On Sat, Apr 25, 2015 at 10:15 AM, Akhil Das  wrote:
> I also want to add mine :/
> Everyone wants to add it seems.
>
> Thanks
> Best Regards
>
> On Fri, Apr 24, 2015 at 8:58 PM, madhu phatak  wrote:
>
>> Hi,
>> I understand that. The following page
>>
>> http://spark.apache.org/documentation.html has a external tutorials,blogs
>> section which points to other blog pages. I wanted to add there.
>>
>>
>>
>>
>> Regards,
>> Madhukara Phatak
>> http://datamantra.io/
>>
>> On Fri, Apr 24, 2015 at 5:17 PM, Sean Owen  wrote:
>>
>> > I think that your own tutorials and such should live on your blog. The
>> > goal isn't to pull in a bunch of external docs to the site.
>> >
>> > On Fri, Apr 24, 2015 at 12:57 AM, madhu phatak 
>> > wrote:
>> > > Hi,
>> > >  As I was reading contributing to Spark wiki, it was mentioned that we
>> > can
>> > > contribute external links to spark tutorials. I have written many
>> > >  of them in my
>> blog.
>> > It
>> > > will be great if someone can add it to the spark website.
>> > >
>> > >
>> > >
>> > > Regards,
>> > > Madhukara Phatak
>> > > http://datamantra.io/
>> >
>>

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Re: Contributing Documentation Changes

[Akhil Das]

I also want to add mine :/
Everyone wants to add it seems.

Thanks
Best Regards

On Fri, Apr 24, 2015 at 8:58 PM, madhu phatak  wrote:

> Hi,
> I understand that. The following page
>
> http://spark.apache.org/documentation.html has a external tutorials,blogs
> section which points to other blog pages. I wanted to add there.
>
>
>
>
> Regards,
> Madhukara Phatak
> http://datamantra.io/
>
> On Fri, Apr 24, 2015 at 5:17 PM, Sean Owen  wrote:
>
> > I think that your own tutorials and such should live on your blog. The
> > goal isn't to pull in a bunch of external docs to the site.
> >
> > On Fri, Apr 24, 2015 at 12:57 AM, madhu phatak 
> > wrote:
> > > Hi,
> > >  As I was reading contributing to Spark wiki, it was mentioned that we
> > can
> > > contribute external links to spark tutorials. I have written many
> > >  of them in my
> blog.
> > It
> > > will be great if someone can add it to the spark website.
> > >
> > >
> > >
> > > Regards,
> > > Madhukara Phatak
> > > http://datamantra.io/
> >
>