Author: pwendell
Date: Wed Sep 26 05:17:17 2018
New Revision: 29697
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_09_25_22_02-3f20305 docs
[This commit notification would consist of 1472 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/branch-2.2 4f10aff40 -> ef3616825
[MINOR][PYTHON] Use a helper in `PythonUtils` instead of direct accessing Scala
package
## What changes were proposed in this pull request?
This PR proposes to use add a helper in `PythonUtils` instead of
[SPARKR] Match pyspark features in SparkR communication protocol
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ef361682
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ef361682
Diff:
Author: pwendell
Date: Wed Sep 26 03:17:32 2018
New Revision: 29683
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_25_20_02-473d0d8 docs
[This commit notification would consist of 1485 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/master cb77a6689 -> 473d0d862
[SPARK-25514][SQL] Generating pretty JSON by to_json
## What changes were proposed in this pull request?
The PR introduces new JSON option `pretty` which allows to turn on
`DefaultPrettyPrinter` of `Jackson`'s Json
Repository: spark
Updated Branches:
refs/heads/master 8c2edf46d -> cb77a6689
[SPARK-21291][R] add R partitionBy API in DataFrame
## What changes were proposed in this pull request?
add R partitionBy API in write.df
I didn't add bucketBy in write.df. The last line of write.df is
```
write <-
Repository: spark
Updated Branches:
refs/heads/branch-2.4 f91247f81 -> 3f203050a
[SPARK-24324][PYTHON][FOLLOW-UP] Rename the Conf to
spark.sql.legacy.execution.pandas.groupedMap.assignColumnsByName
## What changes were proposed in this pull request?
Add the legacy prefix for
Repository: spark
Updated Branches:
refs/heads/master 9bb3a0c67 -> 8c2edf46d
[SPARK-24324][PYTHON][FOLLOW-UP] Rename the Conf to
spark.sql.legacy.execution.pandas.groupedMap.assignColumnsByName
## What changes were proposed in this pull request?
Add the legacy prefix for
Author: pwendell
Date: Wed Sep 26 01:16:56 2018
New Revision: 29678
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_09_25_18_02-f91247f docs
[This commit notification would consist of 1472 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/branch-2.4 544f86a69 -> f91247f81
[SPARK-25422][CORE] Don't memory map blocks streamed to disk.
After data has been streamed to disk, the buffers are inserted into the
memory store in some cases (eg., with broadcast blocks). But broadcast
code
Repository: spark
Updated Branches:
refs/heads/master 66d29870c -> 9bb3a0c67
[SPARK-25422][CORE] Don't memory map blocks streamed to disk.
After data has been streamed to disk, the buffers are inserted into the
memory store in some cases (eg., with broadcast blocks). But broadcast
code also
Author: pwendell
Date: Tue Sep 25 21:17:02 2018
New Revision: 29675
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_09_25_14_02-544f86a docs
[This commit notification would consist of 1472 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Author: pwendell
Date: Tue Sep 25 19:17:33 2018
New Revision: 29672
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_25_12_02-66d2987 docs
[This commit notification would consist of 1485 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/branch-2.4 a709718da -> 544f86a69
[SPARK-25495][SS] FetchedData.reset should reset all fields
## What changes were proposed in this pull request?
`FetchedData.reset` should reset `_nextOffsetInFetchedData` and
`_offsetAfterPoll`. Otherwise it
Repository: spark
Updated Branches:
refs/heads/master 04db03537 -> 66d29870c
[SPARK-25495][SS] FetchedData.reset should reset all fields
## What changes were proposed in this pull request?
`FetchedData.reset` should reset `_nextOffsetInFetchedData` and
`_offsetAfterPoll`. Otherwise it will
Repository: spark
Updated Branches:
refs/heads/master 9cbd001e2 -> 04db03537
[SPARK-25486][TEST] Refactor SortBenchmark to use main method
## What changes were proposed in this pull request?
Refactor SortBenchmark to use main method.
Generate benchmark result:
```
[PYSPARK][SQL] Updates to RowQueue
Tested with updates to RowQueueSuite
(cherry picked from commit 6d742d1bd71aa3803dce91a830b37284cb18cf70)
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4f10aff4
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-2.2 bd12eb75d -> 4f10aff40
[SPARK-25253][PYSPARK] Refactor local connection & auth code
This eliminates some duplication in the code to connect to a server on
localhost to talk directly to the jvm. Also it gives consistent ipv6 and error
[PYSPARK] Updates to pyspark broadcast
(cherry picked from commit 09dd34cb1706f2477a89174d6a1a0f17ed5b0a65)
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dd0e7cf5
Tree:
Author: pwendell
Date: Tue Sep 25 15:17:19 2018
New Revision: 29666
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_25_08_02-9cbd001 docs
[This commit notification would consist of 1485 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Author: pwendell
Date: Tue Sep 25 13:17:02 2018
New Revision: 29662
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_09_25_06_02-a709718 docs
[This commit notification would consist of 1472 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/branch-2.4 4ca4ef7b9 -> a709718da
[SPARK-23907][SQL] Revert regr_* functions entirely
## What changes were proposed in this pull request?
This patch reverts entirely all the regr_* functions added in SPARK-23907.
These were added by mgaido91
Repository: spark
Updated Branches:
refs/heads/master 7d8f5b62c -> 9cbd001e2
[SPARK-23907][SQL] Revert regr_* functions entirely
## What changes were proposed in this pull request?
This patch reverts entirely all the regr_* functions added in SPARK-23907.
These were added by mgaido91 (and
Author: pwendell
Date: Tue Sep 25 07:17:33 2018
New Revision: 29652
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_25_00_02-7d8f5b6 docs
[This commit notification would consist of 1485 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Tags: refs/tags/v2.3.2 [created] 02b510728
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
25 matches
Mail list logo
