[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/11571#issuecomment-193608028
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52623/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/11571#issuecomment-193608023
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/11571#issuecomment-193607352
  
**[Test build #52623 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52623/consoleFull)**
 for PR 11571 at commit 
[`a64a0a4`](https://github.com/apache/spark/commit/a64a0a4bb9dad43b837678f06f45e7a15215826f).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[mwws]

Github user mwws closed the pull request at:

https://github.com/apache/spark/pull/11571


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[mwws]

Github user mwws commented on the pull request:

https://github.com/apache/spark/pull/11571#issuecomment-193562023
  
OK, thanks for the explanation, I will close this PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[rxin]

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/11571#issuecomment-193560334
  
But this can only be added to 2.0 (we won't be able to change an existing 
release). If users already need to change the constructor in order to use it, 
why don't they just create a SQLContext/SparkSession?



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[mwws]

Github user mwws commented on the pull request:

https://github.com/apache/spark/pull/11571#issuecomment-19338
  
@rxin HiveContext is heavily used by many users now, and many of them still 
coupled with old spark version. As this change would be trivial but not 
constructive, I think there is not conflict with the context combination work.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[rxin]

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/11571#issuecomment-193555075
  
Thanks for the pull request. So we are actually going to deprecate 
HiveContext because it has been one of the most confusing contexts in Spark.

See more in https://issues.apache.org/jira/browse/SPARK-13485


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/11571#issuecomment-193553927
  
**[Test build #52623 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52623/consoleFull)**
 for PR 11571 at commit 
[`a64a0a4`](https://github.com/apache/spark/commit/a64a0a4bb9dad43b837678f06f45e7a15215826f).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-13737][SQL][wip]Add getOrCreate method ...

[mwws]

GitHub user mwws opened a pull request:

https://github.com/apache/spark/pull/11571

[SPARK-13737][SQL][wip]Add getOrCreate method for HiveContext

There is a "getOrCreate" method in SQLContext, which is useful to 
recoverable streaming application with SQL operation. 

https://spark.apache.org/docs/latest/streaming-programming-guide.html#dataframe-and-sql-operations
But the corresponding method is missing in HiveContext.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mwws/spark SPARK-HiveGetOrCreate

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/11571.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #11571


commit a64a0a4bb9dad43b837678f06f45e7a15215826f
Author: mwws 
Date:   2016-03-08T01:48:38Z

Add getOrCreate method for HiveContext




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org