spark git commit: [SPARK-4397][Core] Cleanup 'import SparkContext._' in core

2014-12-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master 64f3175bf -> 6dfe38a03 [SPARK-4397][Core] Cleanup 'import SparkContext._' in core This PR cleans up `import SparkContext._` in core for SPARK-4397(#3262) to prove it really works well. Author: zsxwing Closes #3530 from zsxwing/SPARK-439

spark git commit: [SPARK-4686] Link to allowed master URLs is broken

2014-12-02 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/master 6dfe38a03 -> d9a148ba6 [SPARK-4686] Link to allowed master URLs is broken The link points to the old scala programming guide; it should point to the submitting applications page. This should be backported to 1.1.2 (it's been broken as of

spark git commit: [SPARK-4686] Link to allowed master URLs is broken

2014-12-02 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/branch-1.2 3783e15f0 -> b97c27ff2 [SPARK-4686] Link to allowed master URLs is broken The link points to the old scala programming guide; it should point to the submitting applications page. This should be backported to 1.1.2 (it's been broken as

spark git commit: [SPARK-4686] Link to allowed master URLs is broken

2014-12-02 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/branch-1.1 91eadd2d8 -> f333e4f27 [SPARK-4686] Link to allowed master URLs is broken The link points to the old scala programming guide; it should point to the submitting applications page. This should be backported to 1.1.2 (it's been broken as

spark git commit: Indent license header properly for interfaces.scala.

2014-12-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master d9a148ba6 -> b1f8fe316 Indent license header properly for interfaces.scala. A very small nit update. Author: Reynold Xin Closes #3552 from rxin/license-header and squashes the following commits: df8d1a4 [Reynold Xin] Indent license head

spark git commit: [SPARK-4536][SQL] Add sqrt and abs to Spark SQL DSL

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.2 b97c27ff2 -> 1850d90b9 [SPARK-4536][SQL] Add sqrt and abs to Spark SQL DSL Spark SQL has embeded sqrt and abs but DSL doesn't support those functions. Author: Kousuke Saruta Closes #3401 from sarutak/dsl-missing-operator and squashes

spark git commit: [SPARK-4536][SQL] Add sqrt and abs to Spark SQL DSL

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master b1f8fe316 -> e75e04f98 [SPARK-4536][SQL] Add sqrt and abs to Spark SQL DSL Spark SQL has embeded sqrt and abs but DSL doesn't support those functions. Author: Kousuke Saruta Closes #3401 from sarutak/dsl-missing-operator and squashes the

spark git commit: [SPARK-4663][sql]add finally to avoid resource leak

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master e75e04f98 -> 69b6fed20 [SPARK-4663][sql]add finally to avoid resource leak Author: baishuo Closes #3526 from baishuo/master-trycatch and squashes the following commits: d446e14 [baishuo] correct the code style b36bf96 [baishuo] correct t

spark git commit: [SPARK-4663][sql]add finally to avoid resource leak

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.2 1850d90b9 -> aa3d369a6 [SPARK-4663][sql]add finally to avoid resource leak Author: baishuo Closes #3526 from baishuo/master-trycatch and squashes the following commits: d446e14 [baishuo] correct the code style b36bf96 [baishuo] corre

spark git commit: [SPARK-4676][SQL] JavaSchemaRDD.schema may throw NullType MatchError if sql has null

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 69b6fed20 -> 106642760 [SPARK-4676][SQL] JavaSchemaRDD.schema may throw NullType MatchError if sql has null val jsc = new org.apache.spark.api.java.JavaSparkContext(sc) val jhc = new org.apache.spark.sql.hive.api.java.JavaHiveContext(jsc)

spark git commit: [SPARK-4676][SQL] JavaSchemaRDD.schema may throw NullType MatchError if sql has null

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.2 aa3d369a6 -> 06129cde4 [SPARK-4676][SQL] JavaSchemaRDD.schema may throw NullType MatchError if sql has null val jsc = new org.apache.spark.api.java.JavaSparkContext(sc) val jhc = new org.apache.spark.sql.hive.api.java.JavaHiveContext(j

spark git commit: [SPARK-4593][SQL] Return null when denominator is 0

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.2 06129cde4 -> 97dc2384a [SPARK-4593][SQL] Return null when denominator is 0 SELECT max(1/0) FROM src would return a very large number, which is obviously not right. For hive-0.12, hive would return `Infinity` for 1/0, while for hive-0.13

spark git commit: [SPARK-4593][SQL] Return null when denominator is 0

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 106642760 -> f6df609dc [SPARK-4593][SQL] Return null when denominator is 0 SELECT max(1/0) FROM src would return a very large number, which is obviously not right. For hive-0.12, hive would return `Infinity` for 1/0, while for hive-0.13.1,

spark git commit: [SPARK-4670] [SQL] wrong symbol for bitwise not

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master f6df609dc -> 1f5ddf17e [SPARK-4670] [SQL] wrong symbol for bitwise not We should use `~` instead of `-` for bitwise NOT. Author: Daoyuan Wang Closes #3528 from adrian-wang/symbol and squashes the following commits: affd4ad [Daoyuan Wang

spark git commit: [SPARK-4670] [SQL] wrong symbol for bitwise not

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.2 97dc2384a -> adc5d6f09 [SPARK-4670] [SQL] wrong symbol for bitwise not We should use `~` instead of `-` for bitwise NOT. Author: Daoyuan Wang Closes #3528 from adrian-wang/symbol and squashes the following commits: affd4ad [Daoyuan

spark git commit: [SPARK-4695][SQL] Get result using executeCollect

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 1f5ddf17e -> 3ae0cda83 [SPARK-4695][SQL] Get result using executeCollect Using ```executeCollect``` to collect the result, because executeCollect is a custom implementation of collect in spark sql which better than rdd's collect Author: w

spark git commit: [SPARK-4695][SQL] Get result using executeCollect

2014-12-02 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.2 adc5d6f09 -> 658fe8f1a [SPARK-4695][SQL] Get result using executeCollect Using ```executeCollect``` to collect the result, because executeCollect is a custom implementation of collect in spark sql which better than rdd's collect Autho

spark git commit: Minor nit style cleanup in GraphX.

2014-12-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3ae0cda83 -> 2d4f6e70f Minor nit style cleanup in GraphX. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2d4f6e70 Tree: http://git-wip-us.apache.org/repos/asf/spark/tr

spark git commit: [Release] Translate unknown author names automatically

2014-12-02 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 2d4f6e70f -> 5da21f07d [Release] Translate unknown author names automatically Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5da21f07 Tree: http://git-wip-us.apache.or

spark git commit: [Release] Translate unknown author names automatically

2014-12-02 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.2 658fe8f1a -> 5e026a3e6 [Release] Translate unknown author names automatically Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5e026a3e Tree: http://git-wip-us.apach

spark git commit: [Release] Translate unknown author names automatically

2014-12-02 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.1 f333e4f27 -> aec20af1f [Release] Translate unknown author names automatically Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/aec20af1 Tree: http://git-wip-us.apach

spark git commit: [SPARK-4672][GraphX]Perform checkpoint() on PartitionsRDD to shorten the lineage

2014-12-02 Thread ankurdave
Repository: spark Updated Branches: refs/heads/master 5da21f07d -> fc0a1475e [SPARK-4672][GraphX]Perform checkpoint() on PartitionsRDD to shorten the lineage The related JIRA is https://issues.apache.org/jira/browse/SPARK-4672 Iterative GraphX applications always have long lineage, while chec

spark git commit: [SPARK-4672][GraphX]Perform checkpoint() on PartitionsRDD to shorten the lineage

2014-12-02 Thread ankurdave
Repository: spark Updated Branches: refs/heads/branch-1.2 5e026a3e6 -> f1859fc18 [SPARK-4672][GraphX]Perform checkpoint() on PartitionsRDD to shorten the lineage The related JIRA is https://issues.apache.org/jira/browse/SPARK-4672 Iterative GraphX applications always have long lineage, while

spark git commit: [SPARK-4672][GraphX]Non-transient PartitionsRDDs will lead to StackOverflow error

2014-12-02 Thread ankurdave
Repository: spark Updated Branches: refs/heads/master fc0a1475e -> 17c162f66 [SPARK-4672][GraphX]Non-transient PartitionsRDDs will lead to StackOverflow error The related JIRA is https://issues.apache.org/jira/browse/SPARK-4672 In a nutshell, if `val partitionsRDD` in EdgeRDDImpl and VertexR

spark git commit: [SPARK-4672][GraphX]Non-transient PartitionsRDDs will lead to StackOverflow error

2014-12-02 Thread ankurdave
Repository: spark Updated Branches: refs/heads/branch-1.2 f1859fc18 -> 528cce8bc [SPARK-4672][GraphX]Non-transient PartitionsRDDs will lead to StackOverflow error The related JIRA is https://issues.apache.org/jira/browse/SPARK-4672 In a nutshell, if `val partitionsRDD` in EdgeRDDImpl and Ver