spark git commit: [SPARK-6263] [MLLIB] Python MLlib API missing items: Utils

2015-07-01 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 31b4a3d7f - 184de91d1 [SPARK-6263] [MLLIB] Python MLlib API missing items: Utils Implement missing API in pyspark. MLUtils * appendBias * loadVectors `kFold` is also missing however I am not sure `ClassTag` can be passed or restored

spark git commit: [SPARK-8308] [MLLIB] add missing save load for python example

2015-07-01 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 184de91d1 - 201291335 [SPARK-8308] [MLLIB] add missing save load for python example jira: https://issues.apache.org/jira/browse/SPARK-8308 1. add some missing save/load in python examples. , LogisticRegression, LinearRegression and

spark git commit: [SPARK-8763] [PYSPARK] executing run-tests.py with Python 2.6 fails with absence of subprocess.check_output function

2015-07-01 Thread davies
Repository: spark Updated Branches: refs/heads/master 97652416e - fdcad6ef4 [SPARK-8763] [PYSPARK] executing run-tests.py with Python 2.6 fails with absence of subprocess.check_output function Running run-tests.py with Python 2.6 cause following error: ``` Running PySpark tests. Output is

spark git commit: [SPARK-8621] [SQL] support empty string as column name

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4137f769b - 31b4a3d7f [SPARK-8621] [SQL] support empty string as column name improve the empty check in `parseAttributeName` so that we can allow empty string as column name. Close https://github.com/apache/spark/pull/7117 Author:

spark git commit: [SPARK-8621] [SQL] support empty string as column name

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 214550b83 - 2f85d8ee0 [SPARK-8621] [SQL] support empty string as column name improve the empty check in `parseAttributeName` so that we can allow empty string as column name. Close https://github.com/apache/spark/pull/7117 Author:

spark git commit: [SPARK-8765] [MLLIB] [PYTHON] removed flaky python PIC test

2015-07-01 Thread meng
Repository: spark Updated Branches: refs/heads/master 201291335 - b8faa3287 [SPARK-8765] [MLLIB] [PYTHON] removed flaky python PIC test See failure: [https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36133/console] CC yanboliang mengxr Author: Joseph K. Bradley

spark git commit: [SPARK-3444] [CORE] Restore INFO level after log4j test.

2015-07-01 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 bcfb37bf6 - 228aabe24 [SPARK-3444] [CORE] Restore INFO level after log4j test. Otherwise other tests don't log anything useful... Author: Marcelo Vanzin van...@cloudera.com Closes #7140 from vanzin/SPARK-3444 and squashes the

spark git commit: [SPARK-7820] [BUILD] Fix Java8-tests suite compile and test error under sbt

2015-07-01 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.4 2f85d8ee0 - bcfb37bf6 [SPARK-7820] [BUILD] Fix Java8-tests suite compile and test error under sbt Author: jerryshao saisai.s...@intel.com Closes #7120 from jerryshao/SPARK-7820 and squashes the following commits: 6902439 [jerryshao]

spark git commit: [QUICKFIX] [SQL] fix copy of generated row

2015-07-01 Thread davies
Repository: spark Updated Branches: refs/heads/master 9f7db3486 - 3083e1764 [QUICKFIX] [SQL] fix copy of generated row copy() of generated Row doesn't check nullability of columns Author: Davies Liu dav...@databricks.com Closes #7163 from davies/fix_copy and squashes the following commits:

spark git commit: [SPARK-3444] [CORE] Restore INFO level after log4j test.

2015-07-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3083e1764 - 1ce642890 [SPARK-3444] [CORE] Restore INFO level after log4j test. Otherwise other tests don't log anything useful... Author: Marcelo Vanzin van...@cloudera.com Closes #7140 from vanzin/SPARK-3444 and squashes the following

spark git commit: [SPARK-8752][SQL] Add ExpectsInputTypes trait for defining expected input types.

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 69c5dee2f - 4137f769b [SPARK-8752][SQL] Add ExpectsInputTypes trait for defining expected input types. This patch doesn't actually introduce any code that uses the new ExpectsInputTypes. It just adds the trait so others can use it. Also

spark git commit: [SPARK-7714] [SPARKR] SparkR tests should use more specific expectations than expect_true

2015-07-01 Thread shivaram
Repository: spark Updated Branches: refs/heads/master fdcad6ef4 - 69c5dee2f [SPARK-7714] [SPARKR] SparkR tests should use more specific expectations than expect_true 1. Update the pattern 'expect_true(a == b)' to 'expect_equal(a, b)'. 2. Update the pattern 'expect_true(inherits(a, b))' to

spark git commit: [SPARK-8748][SQL] Move castability test out from Cast case class into Cast object.

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 64c14618d - 365c14055 [SPARK-8748][SQL] Move castability test out from Cast case class into Cast object. This patch moved resolve function in Cast case class into the companion object, and renamed it canCast. We can then use this in the

spark git commit: [SPARK-8749][SQL] Remove HiveTypeCoercion trait.

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 365c14055 - fc3a6fe67 [SPARK-8749][SQL] Remove HiveTypeCoercion trait. Moved all the rules into the companion object. Author: Reynold Xin r...@databricks.com Closes #7147 from rxin/SPARK-8749 and squashes the following commits: c1c6dc0

spark git commit: [SQL] [MINOR] remove internalRowRDD in DataFrame

2015-07-01 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master fc3a6fe67 - 0eee06158 [SQL] [MINOR] remove internalRowRDD in DataFrame Developers have already familiar with `queryExecution.toRDD` as internal row RDD, and we should not add new concept. Author: Wenchen Fan cloud0...@outlook.com Closes

spark git commit: [SPARK-8750][SQL] Remove the closure in functions.callUdf.

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0eee06158 - 97652416e [SPARK-8750][SQL] Remove the closure in functions.callUdf. Author: Reynold Xin r...@databricks.com Closes #7148 from rxin/calludf-closure and squashes the following commits: 00df372 [Reynold Xin] Fixed index out of

spark git commit: [SPARK-8770][SQL] Create BinaryOperator abstract class.

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3a342dedc - 9fd13d561 [SPARK-8770][SQL] Create BinaryOperator abstract class. Our current BinaryExpression abstract class is not for generic binary expressions, i.e. it requires left/right children to have the same type. However, due to

spark git commit: [SPARK-8754] [YARN] YarnClientSchedulerBackend doesn't stop gracefully in failure conditions

2015-07-01 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 17def3957 - 5b468cf0c [SPARK-8754] [YARN] YarnClientSchedulerBackend doesn't stop gracefully in failure conditions In YarnClientSchedulerBackend.stop(), added a check for monitorThread. Author: Devaraj K deva...@apache.org Closes

spark git commit: [SPARK-7820] [BUILD] Fix Java8-tests suite compile and test error under sbt

2015-07-01 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 75b9fe4c5 - 9f7db3486 [SPARK-7820] [BUILD] Fix Java8-tests suite compile and test error under sbt Author: jerryshao saisai.s...@intel.com Closes #7120 from jerryshao/SPARK-7820 and squashes the following commits: 6902439 [jerryshao] fix

spark git commit: [SPARK-8766] support non-ascii character in column names

2015-07-01 Thread davies
Repository: spark Updated Branches: refs/heads/master 1ce642890 - f958f27e2 [SPARK-8766] support non-ascii character in column names Use UTF-8 to encode the name of column in Python 2, or it may failed to encode with default encoding ('ascii'). This PR also fix a bug when there is Java

spark git commit: [SPARK-8770][SQL] Create BinaryOperator abstract class.

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master f958f27e2 - 272778999 [SPARK-8770][SQL] Create BinaryOperator abstract class. Our current BinaryExpression abstract class is not for generic binary expressions, i.e. it requires left/right children to have the same type. However, due to

spark git commit: Revert [SPARK-8770][SQL] Create BinaryOperator abstract class.

2015-07-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 272778999 - 3a342dedc Revert [SPARK-8770][SQL] Create BinaryOperator abstract class. This reverts commit 272778999823ed79af92280350c5869a87a21f29. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-8766] support non-ascii character in column names

2015-07-01 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.4 228aabe24 - 17def3957 [SPARK-8766] support non-ascii character in column names Use UTF-8 to encode the name of column in Python 2, or it may failed to encode with default encoding ('ascii'). This PR also fix a bug when there is Java