Repository: spark
Updated Branches:
refs/heads/master 52c3439a8 - 57cd1e86d
[SPARK-6893][ML] default pipeline parameter handling in python
Same as #5431 but for Python. jkbradley
Author: Xiangrui Meng m...@databricks.com
Closes #5534 from mengxr/SPARK-6893 and squashes the following
Repository: spark
Updated Branches:
refs/heads/master 837055059 - 6179a9483
SPARK-4783 [CORE] System.exit() calls in SparkContext disrupt applications
embedding Spark
Avoid `System.exit(1)` in `TaskSchedulerImpl` and convert to `SparkException`;
ensure scheduler calls `sc.stop()` even when
Repository: spark
Updated Branches:
refs/heads/master 6179a9483 - de4fa6b6d
[SPARK-4194] [core] Make SparkContext initialization exception-safe.
SparkContext has a very long constructor, where multiple things are
initialized, multiple threads are spawned, and multiple opportunities
for
Repository: spark
Updated Branches:
refs/heads/master 57cd1e86d - 837055059
[Streaming][minor] Remove additional quote and unneeded imports
Author: jerryshao saisai.s...@intel.com
Closes #5540 from jerryshao/minor-fix and squashes the following commits:
ebaa646 [jerryshao] Minor fix
Repository: spark
Updated Branches:
refs/heads/master de4fa6b6d - 3ae37b93a
[SPARK-6694][SQL]SparkSQL CLI must be able to specify an option --database on
the command line.
SparkSQL CLI has an option --database as follows.
But, the option --database is ignored.
```
$ spark-sql --help
:
CLI
Repository: spark
Updated Branches:
refs/heads/master ef3fb801a - 55f553a97
[SPARK-6855] [SPARKR] Set R includes to get the right collate order.
This prevents tools like devtools::document creating invalid collate orders
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #5462
Repository: spark
Updated Tags: refs/tags/v1.3.0-rc3 [deleted] 4aaf48d46
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.3.1-rc1 [deleted] 0dcb5d9f3
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.3.1-rc3 [deleted] 3e8391327
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.2.2 [created] 7531b50e4
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.2.2-rc1 [deleted] 7531b50e4
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.3.0-rc1 [deleted] f97b0d4a6
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Author: pwendell
Date: Thu Apr 16 22:59:24 2015
New Revision: 8636
Log:
Spark 1.2.2 Release
Added:
release/spark/spark-1.2.2/
- copied from r8635, dev/spark/spark-1.2.2-rc1/
Removed:
dev/spark/spark-1.2.2-rc1/
-
[SPARK-4897] [PySpark] Python 3 support
This PR update PySpark to support Python 3 (tested with 3.4).
Known issue: unpickle array from Pyrolite is broken in Python 3, those tests
are skipped.
TODO: ec2/spark-ec2.py is not fully tested with python3.
Author: Davies Liu dav...@databricks.com
http://git-wip-us.apache.org/repos/asf/spark/blob/04e44b37/python/pyspark/sql/types.py
--
diff --git a/python/pyspark/sql/types.py b/python/pyspark/sql/types.py
deleted file mode 100644
index ef76d84..000
---
Repository: spark
Updated Branches:
refs/heads/master 5fe434335 - 6183b5e2c
[SPARK-6911] [SQL] improve accessor for nested types
Support access columns by index in Python:
```
df[df[0] 3].collect()
[Row(age=5, name=u'Bob')]
```
Access items in ArrayType or MapType
```
Repository: spark
Updated Branches:
refs/heads/master 6183b5e2c - d96608674
[SQL][Minor] Fix foreachUp of treenode
`foreachUp` should runs the given function recursively on [[children]] then on
this node(just like transformUp). The current implementation does not follow
this.
This will
Author: pwendell
Date: Thu Apr 16 23:43:24 2015
New Revision: 8638
Log:
Spark 1.3.1
Added:
release/spark/spark-1.3.1/
- copied from r8637, dev/spark/spark-1.3.1-rc3/
Removed:
dev/spark/spark-1.3.1-rc3/
-
To
http://git-wip-us.apache.org/repos/asf/spark/blob/04e44b37/python/pyspark/sql/_types.py
--
diff --git a/python/pyspark/sql/_types.py b/python/pyspark/sql/_types.py
new file mode 100644
index 000..492c0cb
--- /dev/null
+++
Author: pwendell
Date: Thu Apr 16 23:41:53 2015
New Revision: 8637
Log:
Spark 1.3.1 RC3
Added:
dev/spark/spark-1.3.1-rc3/
dev/spark/spark-1.3.1-rc3/spark-1.3.1-bin-cdh4.tgz (with props)
dev/spark/spark-1.3.1-rc3/spark-1.3.1-bin-cdh4.tgz.asc (with props)
Repository: spark
Updated Branches:
refs/heads/master e5949c287 - 8220d5265
[SPARK-6972][SQL] Add Coalesce to DataFrame
Author: Michael Armbrust mich...@databricks.com
Closes #5545 from marmbrus/addCoalesce and squashes the following commits:
9fdf3f6 [Michael Armbrust] [SPARK-6972][SQL] Add
Repository: spark
Updated Branches:
refs/heads/master d96608674 - 1e43851d6
[SPARK-6899][SQL] Fix type mismatch when using codegen with Average on
DecimalType
JIRA https://issues.apache.org/jira/browse/SPARK-6899
Author: Liang-Chi Hsieh vii...@gmail.com
Closes #5517 from
Author: pwendell
Date: Thu Apr 16 22:58:43 2015
New Revision: 8635
Log:
Adding Spark 1.2.2 RC1
Added:
dev/spark/spark-1.2.2-rc1/
dev/spark/spark-1.2.2-rc1/spark-1.2.2-bin-cdh4.tgz (with props)
dev/spark/spark-1.2.2-rc1/spark-1.2.2-bin-cdh4.tgz.asc (with props)
Repository: spark
Updated Branches:
refs/heads/master 1e43851d6 - e5949c287
[SPARK-6966][SQL] Use correct ClassLoader for JDBC Driver
Otherwise we cannot add jars with drivers after the fact.
Author: Michael Armbrust mich...@databricks.com
Closes #5543 from marmbrus/jdbcClassloader and
Repository: spark
Updated Tags: refs/tags/v1.2.1-rc3 [deleted] b6eaf77d4
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.3.0-rc2 [deleted] 3af26870e
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.3.0-snapshot1 [deleted] d97bfc6f2
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.3.1-rc2 [deleted] 7c4473aa5
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/master 04e44b37c - 5fe434335
SPARK-6927 [SQL] Sorting Error when codegen on
Fix this error by adding BinaryType comparor in GenerateOrdering.
JIRA https://issues.apache.org/jira/browse/SPARK-6927
Author: äºå³¤ chensong...@alibaba-inc.com
Repository: spark
Updated Branches:
refs/heads/master 3ae37b93a - ef3fb801a
[SPARK-6934][Core] Use 'spark.akka.askTimeout' for the ask timeout
Fixed my mistake in #4588
Author: zsxwing zsxw...@gmail.com
Closes #5529 from zsxwing/SPARK-6934 and squashes the following commits:
9890b2d
30 matches
Mail list logo
