[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[ericl]

Github user ericl commented on the issue:

https://github.com/apache/spark/pull/15725
  
After some local experimental, I think that is actually a red herring. 
`spark.sql.hive.metastorePartitionPruning` defaults to true now, so omitting it 
has no effect. Also, I am not able to reproduce the failure locally by setting 
any of the spark confs. (Haven't tried the hive confs since there are so many, 
but I don't see anything obviously different there).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[viirya]

Github user viirya commented on the issue:

https://github.com/apache/spark/pull/15725
  
`HiveTableScanSuite` changes the config 
`spark.sql.hive.metastorePartitionPruning` to false in the end.

In the failed test run, `HiveTableScanSuite` runs before `SQLQuerySuite`. 
In the successful run, `HiveTableScanSuite` runs after `SQLQuerySuite`.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[viirya]

Github user viirya commented on the issue:

https://github.com/apache/spark/pull/15725
  
Should be HiveTableScanSuite. I think.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[ericl]

Github user ericl commented on the issue:

https://github.com/apache/spark/pull/15725
  
Oh wow, so it's deterministically broken, but some suite must be leaking a
conf that disables the flag. This explains why I couldn't find a preceding
suite to blame for the flake - it's merely the absence of a suite that
causes the failure.

On Tue, Nov 1, 2016, 11:43 PM Liang-Chi Hsieh 
wrote:

> spark.sql.hive.metastorePartitionPruning is seen in failed test, not in
> successful test.
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> , or 
mute
> the thread
> 

> .
>



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[viirya]

Github user viirya commented on the issue:

https://github.com/apache/spark/pull/15725
  
`spark.sql.hive.metastorePartitionPruning` is seen in failed test, not in 
successful test.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/15725
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/15725
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67950/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/15725
  
**[Test build #67950 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67950/consoleFull)**
 for PR 15725 at commit 
[`0dca3ac`](https://github.com/apache/spark/commit/0dca3ac4dec6efbc3a52a6c995bc43296358a449).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/15725
  
**[Test build #67950 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67950/consoleFull)**
 for PR 15725 at commit 
[`0dca3ac`](https://github.com/apache/spark/commit/0dca3ac4dec6efbc3a52a6c995bc43296358a449).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[JoshRosen]

Github user JoshRosen commented on the issue:

https://github.com/apache/spark/pull/15725
  
Jenkins, retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[ericl]

Github user ericl commented on the issue:

https://github.com/apache/spark/pull/15725
  
Oh cool it flaked on that run

jenkins retest this please. // let's try to get a successful run for 
comparison


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/15725
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67944/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[AmplabJenkins]

Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/15725
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/15725
  
**[Test build #67944 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67944/consoleFull)**
 for PR 15725 at commit 
[`0dca3ac`](https://github.com/apache/spark/commit/0dca3ac4dec6efbc3a52a6c995bc43296358a449).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[yhuai]

Github user yhuai commented on the issue:

https://github.com/apache/spark/pull/15725
  
lgtm


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[ericl]

Github user ericl commented on the issue:

https://github.com/apache/spark/pull/15725
  
@rxin 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[SparkQA]

Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/15725
  
**[Test build #67944 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67944/consoleFull)**
 for PR 15725 at commit 
[`0dca3ac`](https://github.com/apache/spark/commit/0dca3ac4dec6efbc3a52a6c995bc43296358a449).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #15725: [SPARK-18167] Print out spark confs, and hive confs when...

[ericl]

Github user ericl commented on the issue:

https://github.com/apache/spark/pull/15725
  
This also enables the test. @marmbrus feel free to revert this patch as 
soon as we have a sample failure output.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org