[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6012 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-17 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102763182 Thanks for fixing this! Merging to master and branch-1.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102756134 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102756132 [Test build #32927 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32927/consoleFull) for PR 6012 at commit [`2663957`](https://git

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102756136 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102747431 [Test build #32927 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32927/consoleFull) for PR 6012 at commit [`2663957`](https://gith

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102747381 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102747386 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-16 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102747335 @liancheng updated. Please take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-16 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-102743939 @viirya Sorry for the late reply, I missed this PR while working on #6090. This fix LGTM, could you please rebase this PR? Notice that `fsBasedParquet.scala` was renam

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-101981141 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-101981143 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-101981132 [Test build #32691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32691/consoleFull) for PR 6012 at commit [`6ac7d93`](https://git

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-14 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-101950939 LGTM /cc @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-101950808 [Test build #32691 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32691/consoleFull) for PR 6012 at commit [`6ac7d93`](https://gith

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-101950601 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-101950613 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-14 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-101950267 @marmbrus #6090 was merged. But this problem is still there. I updated the codes. Please take a look. Thanks. --- If your project is set up for it, you can reply to thi

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-09 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100575395 Yep! On May 9, 2015 7:46 PM, "Liang-Chi Hsieh" wrote: > OK. I see. You meant liancheng#6 > . > > —

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-09 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100575243 OK. I see. You meant https://github.com/liancheng/spark/pull/6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-09 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100573978 Yes, but look at the linked PR that replaces the parquet support with this new API. On May 9, 2015 7:18 PM, "Liang-Chi Hsieh" wrote: > @marmbrus

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-09 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100573786 @marmbrus After checking #5526, I think this part of codes is still be there to use. So maybe this pr is still needed. --- If your project is set up for it, you can repl

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-09 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100544416 I think this codepath is going to be deleted, but we should make sure that #5526 does not suffer from the same issue. /cc @liancheng --- If your project is se

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-09 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100470509 good catch --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100332706 [Test build #32246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32246/consoleFull) for PR 6012 at commit [`b0fc09b`](https://git

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100332716 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100332713 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100305054 [Test build #32246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32246/consoleFull) for PR 6012 at commit [`b0fc09b`](https://gith

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100304323 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6012#issuecomment-100304351 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7447][SQL] Don't re-merge Parquet schem...

2015-05-08 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/6012 [SPARK-7447][SQL] Don't re-merge Parquet schema when the relation is deserialized JIRA: https://issues.apache.org/jira/browse/SPARK-7447 `MetadataCache` in `ParquetRelation2` is annotated