[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-05 Thread angelini
Github user angelini commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-128067957 @mengxr @davies I needed 4.9 to be able to serialize datetime's with tzinfos. If not, `df.write.parquet('...')` would throw an "Invalid pickle error" (

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127859321 @angelini There were some issues with the timezone support in 4.9-SNAPSHOT. A round trip doesn't return the original timezone info. But since as @davies mentioned we are

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127856633 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127856592 [Test build #39812 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39812/console) for PR 7950 at commit [`99a3336`](https://github.

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127825189 [Test build #39812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39812/consoleFull) for PR 7950 at commit [`99a3336`](https://gith

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127825104 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127825115 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127824734 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127824139 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127824031 [Test build #39789 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39789/console) for PR 7950 at commit [`99a3336`](https://github.

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127803404 Nevertheless, I wonder whether Pyrolite 4.9 contains other improvements that we might be interested in. --- If your project is set up for it, you can reply to this em

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127803309 @angelini Right now I do the serialization for date/datetime by ourselves now, not dependent on Pyrolite. --- If your project is set up for it, you can reply to this ema

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127803004 [Test build #39789 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39789/consoleFull) for PR 7950 at commit [`99a3336`](https://gith

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127802937 /cc @davies. @mengxr @angelini, thanks for submitting this. Do you mind filing a JIRA, since we require them for all dependency changes? https://issues.apac

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127802927 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127802857 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127802916 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127802422 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7950#issuecomment-127802265 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: Upgrade pyrolite to 4.9

2015-08-04 Thread angelini
GitHub user angelini opened a pull request: https://github.com/apache/spark/pull/7950 Upgrade pyrolite to 4.9 Includes: https://github.com/irmen/Pyrolite/pull/23 which fixes datetimes with timezones. @JoshRosen You can merge this pull request into a Git repository by runn