[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread tgravescs
Github user tgravescs commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r38089726
  
--- Diff: docs/sql-programming-guide.md ---
@@ -1696,12 +1711,16 @@ version specified by users. An isolated classloader 
is used here to avoid depend
   property can be one of three options:
   ol
 licodebuiltin/code/li
-Use Hive 0.13.1, which is bundled with the Spark assembly jar when 
code-Phive/code is
+Use Hive 1.2.1, which is bundled with the Spark assembly jar when 
code-Phive/code is
 enabled. When this option is chosen, 
codespark.sql.hive.metastore.version/code must be
-either code0.13.1/code or not defined.
+either code1.2.1/code or not defined.
 licodemaven/code/li
-Use Hive jars of specified version downloaded from Maven 
repositories.
-liA classpath in the standard format for both Hive and 
Hadoop./li
+Use Hive jars of specified version downloaded from Maven 
repositories.  This configuration
+is not generally recommended for production deployments. 
+liA classpath in the standard format for the JVM.  This 
classpath must include all of Hive 
+and its dependencies, including the correct version of Hadoop.  
These jars only need to be
+present on the driver, but if you are running in yarn client mode 
then you must ensure
--- End diff --

These jars aren't needed by the executors at all?   If that is the case the 
only time they need to be shipped is in yarn cluster mode.  




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread tgravescs
Github user tgravescs commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135508637
  
thanks LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135509928
  
  [Test build #41704 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41704/consoleFull)
 for   PR 8441 at commit 
[`f3fdf62`](https://github.com/apache/spark/commit/f3fdf625b0b092984d8d5f0e733a130ff9ff92b4).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread marmbrus
Github user marmbrus commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r38126088
  
--- Diff: docs/sql-programming-guide.md ---
@@ -1696,12 +1711,16 @@ version specified by users. An isolated classloader 
is used here to avoid depend
   property can be one of three options:
   ol
 licodebuiltin/code/li
-Use Hive 0.13.1, which is bundled with the Spark assembly jar when 
code-Phive/code is
+Use Hive 1.2.1, which is bundled with the Spark assembly jar when 
code-Phive/code is
 enabled. When this option is chosen, 
codespark.sql.hive.metastore.version/code must be
-either code0.13.1/code or not defined.
+either code1.2.1/code or not defined.
 licodemaven/code/li
-Use Hive jars of specified version downloaded from Maven 
repositories.
-liA classpath in the standard format for both Hive and 
Hadoop./li
+Use Hive jars of specified version downloaded from Maven 
repositories.  This configuration
+is not generally recommended for production deployments. 
+liA classpath in the standard format for the JVM.  This 
classpath must include all of Hive 
+and its dependencies, including the correct version of Hadoop.  
These jars only need to be
+present on the driver, but if you are running in yarn client mode 
then you must ensure
--- End diff --

Correct, they are only used by the driver to get metadata.  Thanks for the 
clarification on cluster vs client.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135508406
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135513991
  
  [Test build #41704 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41704/console)
 for   PR 8441 at commit 
[`f3fdf62`](https://github.com/apache/spark/commit/f3fdf625b0b092984d8d5f0e733a130ff9ff92b4).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135508384
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135514142
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41704/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135514140
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8441


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread marmbrus
Github user marmbrus commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135519881
  
Thanks guys!  Merged to master and 1.5


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread rxin
Github user rxin commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r37953102
  
--- Diff: docs/sql-programming-guide.md ---
@@ -1988,6 +2005,27 @@ options.
 
 # Migration Guide
 
+## Upgrading From Spark SQL 1.4 to 1.5
+
+ - Optimized execution using manually managed memory (Tungsten) is now 
enabled by default, along with
+   code generation for expression evaluation.  These features can both be 
disabled by setting
+   `spark.sql.tungsten.enabled` to `false.
+ - Parquet schema merging is no longer enabled by default.  It can be 
re-enabled by setting 
+   `spark.sql.parquet.mergeSchema` to `true`.
+ - Resolution of strings to columns in python now supports using dots 
(`.`) to qualify the column or 
+   access nested values.  For example `df['table.column.nestedField']`.  
However, this means that if 
+   your column name contains any dots you must now escape them using 
backticks.   
--- End diff --

should give an example of using backticks here


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread rxin
Github user rxin commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r37953140
  
--- Diff: docs/sql-programming-guide.md ---
@@ -1988,6 +2005,27 @@ options.
 
 # Migration Guide
 
+## Upgrading From Spark SQL 1.4 to 1.5
+
+ - Optimized execution using manually managed memory (Tungsten) is now 
enabled by default, along with
+   code generation for expression evaluation.  These features can both be 
disabled by setting
+   `spark.sql.tungsten.enabled` to `false.
+ - Parquet schema merging is no longer enabled by default.  It can be 
re-enabled by setting 
+   `spark.sql.parquet.mergeSchema` to `true`.
+ - Resolution of strings to columns in python now supports using dots 
(`.`) to qualify the column or 
+   access nested values.  For example `df['table.column.nestedField']`.  
However, this means that if 
+   your column name contains any dots you must now escape them using 
backticks.   
+ - In-memory columnar storage partition pruning is on by default. It can 
be disabled by setting
+   `spark.sql.inMemoryColumnarStorage.partitionPruning` to `false`.
+ - Unlimited precision decimal columns are no longer supported, instead 
Spark SQL enforces a maximum
--- End diff --

should also mention that timestamp precision is now 1us, rather than 1ns.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread cloud-fan
Github user cloud-fan commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-134939560
  
In JDBC part we give an example of how to include extra jars by 
`SPARK_CLASSPATH=postgresql-9.3-1102-jdbc41.jar bin/spark-shell`. However, 
`SPARK_CLASSPATH` is deprecated, should we update that?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread rxin
Github user rxin commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r37953029
  
--- Diff: docs/sql-programming-guide.md ---
@@ -870,12 +886,11 @@ saveDF(select(df, name, age), 
namesAndAges.parquet, parquet)
 
 Save operations can optionally take a `SaveMode`, that specifies how to 
handle existing data if
 present.  It is important to realize that these save modes do not utilize 
any locking and are not
-atomic.  Thus, it is not safe to have multiple writers attempting to write 
to the same location.
-Additionally, when performing a `Overwrite`, the data will be deleted 
before writing out the
+atomic.  Additionally, when performing a `Overwrite`, the data will be 
deleted before writing out the
 new data.
 
 table class=table
-trthScala/Java/ththPython/ththMeaning/th/tr
+trthScala/Java/ththAny Language/ththMeaning/th/tr
--- End diff --

Python/R rather than Any Language?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r37964191
  
--- Diff: docs/sql-programming-guide.md ---
@@ -11,7 +11,7 @@ title: Spark SQL and DataFrames
 
 Spark SQL is a Spark module for structured data processing. It provides a 
programming abstraction called DataFrames and can also act as distributed SQL 
query engine.
 
-For how to enable Hive support, please refer to the [Hive 
Tables](#hive-tables) section.
+Spark SQL can also be used to read from data from an existing Hive 
installation.  For more on how to configure this feature, please refer to the 
[Hive Tables](#hive-tables) section.
--- End diff --

typo? should be `...read data from...`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread tgravescs
Github user tgravescs commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135015171
  
Perhaps this is a separate jira but the build doc needs to be updated for 
building with hive also.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread tgravescs
Github user tgravescs commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r37981427
  
--- Diff: docs/sql-programming-guide.md ---
@@ -1667,12 +1682,14 @@ version specified by users. An isolated classloader 
is used here to avoid depend
   property can be one of three options:
   ol
 licodebuiltin/code/li
-Use Hive 0.13.1, which is bundled with the Spark assembly jar when 
code-Phive/code is
+Use Hive 1.2.1, which is bundled with the Spark assembly jar when 
code-Phive/code is
 enabled. When this option is chosen, 
codespark.sql.hive.metastore.version/code must be
-either code0.13.1/code or not defined.
+either code1.2.1/code or not defined.
 licodemaven/code/li
-Use Hive jars of specified version downloaded from Maven 
repositories.
-liA classpath in the standard format for both Hive and 
Hadoop./li
+Use Hive jars of specified version downloaded from Maven 
repositories.  This configuration
+is not generally recommended for production deployments. 
+liA classpath in the standard format for the JVM.  This 
classpath must include all of Hive 
--- End diff --

It might be nice if we could  say something about the jars either need to 
be installed on the cluster or on yarn shipped with your application.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread rxin
Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135295332
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread marmbrus
Github user marmbrus commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r38056282
  
--- Diff: docs/sql-programming-guide.md ---
@@ -870,12 +886,11 @@ saveDF(select(df, name, age), 
namesAndAges.parquet, parquet)
 
 Save operations can optionally take a `SaveMode`, that specifies how to 
handle existing data if
 present.  It is important to realize that these save modes do not utilize 
any locking and are not
-atomic.  Thus, it is not safe to have multiple writers attempting to write 
to the same location.
-Additionally, when performing a `Overwrite`, the data will be deleted 
before writing out the
+atomic.  Additionally, when performing a `Overwrite`, the data will be 
deleted before writing out the
 new data.
 
 table class=table
-trthScala/Java/ththPython/ththMeaning/th/tr
+trthScala/Java/ththAny Language/ththMeaning/th/tr
--- End diff --

It works in scala too though?  I wasn't really sure what to do here.  We 
could also just delete the other column?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread marmbrus
Github user marmbrus commented on a diff in the pull request:

https://github.com/apache/spark/pull/8441#discussion_r38056679
  
--- Diff: docs/sql-programming-guide.md ---
@@ -1988,6 +2005,27 @@ options.
 
 # Migration Guide
 
+## Upgrading From Spark SQL 1.4 to 1.5
+
+ - Optimized execution using manually managed memory (Tungsten) is now 
enabled by default, along with
+   code generation for expression evaluation.  These features can both be 
disabled by setting
+   `spark.sql.tungsten.enabled` to `false.
+ - Parquet schema merging is no longer enabled by default.  It can be 
re-enabled by setting 
+   `spark.sql.parquet.mergeSchema` to `true`.
+ - Resolution of strings to columns in python now supports using dots 
(`.`) to qualify the column or 
+   access nested values.  For example `df['table.column.nestedField']`.  
However, this means that if 
+   your column name contains any dots you must now escape them using 
backticks.   
--- End diff --

Haha, I didn't know how to escape backticks and was lazy...


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135256210
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135256094
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135257305
  
  [Test build #41663 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41663/consoleFull)
 for   PR 8441 at commit 
[`4ca2b96`](https://github.com/apache/spark/commit/4ca2b96916ec382fbd3d308a67d09d387d2b3aeb).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135262562
  
  [Test build #41663 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41663/console)
 for   PR 8441 at commit 
[`4ca2b96`](https://github.com/apache/spark/commit/4ca2b96916ec382fbd3d308a67d09d387d2b3aeb).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135262620
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-135262622
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41663/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-25 Thread marmbrus
GitHub user marmbrus opened a pull request:

https://github.com/apache/spark/pull/8441

[SPARK-9148][SPARK-10252][SQL] Update SQL Programming Guide



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/marmbrus/spark documentation

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8441.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8441


commit f11c1693627d9417db1dbf3dca764c63f484ad1b
Author: Michael Armbrust mich...@databricks.com
Date:   2015-08-26T01:33:43Z

[SPARK-9148][SPARK-10252][SQL] Update SQL Programming Guide




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-134786088
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-25 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-134786378
  
  [Test build #41581 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41581/consoleFull)
 for   PR 8441 at commit 
[`f11c169`](https://github.com/apache/spark/commit/f11c1693627d9417db1dbf3dca764c63f484ad1b).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-134786103
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-134789036
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-25 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-134788968
  
  [Test build #41581 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41581/console)
 for   PR 8441 at commit 
[`f11c169`](https://github.com/apache/spark/commit/f11c1693627d9417db1dbf3dca764c63f484ad1b).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `class FPGrowthModel[Item: ClassTag] @Since(1.3.0) (`
  * `  class FreqItemset[Item] @Since(1.3.0) (`
  * `  class FreqSequence[Item] @Since(1.5.0) (`
  * `class PrefixSpanModel[Item] @Since(1.5.0) (`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8441#issuecomment-134789038
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41581/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org