This is an automated email from the ASF dual-hosted git repository.
jshao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from eef5e6d [SPARK-29113][DOC] Fix some annotation errors and remove
meaningless annotations in project
add 0b6775e
This is an automated email from the ASF dual-hosted git repository.
jshao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 6d32dee [SPARK-28475][CORE] Add regex
This is an automated email from the ASF dual-hosted git repository.
jshao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from b94fa97 [SPARK-28345][SQL][PYTHON] PythonUDF predicate should be able
to pushdown to join
add be4a552 [SPARK
This is an automated email from the ASF dual-hosted git repository.
jshao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 378ed67 [SPARK-28202][CORE][TEST] Avoid noises
Repository: spark-website
Updated Branches:
refs/heads/asf-site 74d902cdc -> 8b7444182
Update my affiliation
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8b744418
Tree: http://git-wip-us.apache.org/repos
Update some missing changes for 2.3.2 release
`downloads.md` and `_post` should be updated to use new 2.3.2 release. Sorry
about missing it.
Author: jerryshao
Closes #150 from jerryshao/update-2.3.2.
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us
Repository: spark-website
Updated Branches:
refs/heads/asf-site 546f35143 -> 74d902cdc
http://git-wip-us.apache.org/repos/asf/spark-website/blob/74d902cd/site/releases/spark-release-1-3-0.html
--
diff --git a/site/releases/spar
http://git-wip-us.apache.org/repos/asf/spark-website/blob/74d902cd/site/news/spark-2-3-0-released.html
--
diff --git a/site/news/spark-2-3-0-released.html
b/site/news/spark-2-3-0-released.html
index 022adba..e36b8b3 100644
--- a/s
Repository: spark-website
Updated Branches:
refs/heads/asf-site 04a27dbf1 -> 546f35143
Empty commit to trigger asf to github sync
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/546f3514
Tree: http://git-wi
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/cov.html
--
diff --git a/site/docs/2.3.2/api/R/cov.html b/site/docs/2.3.2/api/R/cov.html
new file mode 100644
index 000..ec96abb
--- /dev/
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/index-all.html
--
diff --git a/site/docs/2.3.2/api/java/index-all.html
b/site/docs/2.3.2/api/java/index-all.html
new file mode 100644
inde
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/allclasses-noframe.html
--
diff --git a/site/docs/2.3.2/api/java/allclasses-noframe.html
b/site/docs/2.3.2/api/java/allclasses-noframe.htm
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/ExceptionFailure.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/ExceptionFailure.html
b/site/docs/2.3.2/a
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/SparkContext.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/SparkContext.html
b/site/docs/2.3.2/api/java/
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/allclasses-frame.html
--
diff --git a/site/docs/2.3.2/api/java/allclasses-frame.html
b/site/docs/2.3.2/api/java/allclasses-frame.html
new
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/00Index.html
--
diff --git a/site/docs/2.3.2/api/R/00Index.html
b/site/docs/2.3.2/api/R/00Index.html
new file mode 100644
index 000..ec58
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/NarrowDependency.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/NarrowDependency.html
b/site/docs/2.3.2/a
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/column_datetime_diff_functions.html
--
diff --git a/site/docs/2.3.2/api/R/column_datetime_diff_functions.html
b/site/docs/2.3.2/api/R/column_
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/Accumulable.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/Accumulable.html
b/site/docs/2.3.2/api/java/or
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/FetchFailed.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/FetchFailed.html
b/site/docs/2.3.2/api/java/or
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/InternalAccumulator.output$.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/InternalAccumulator.output$.ht
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/spark.survreg.html
--
diff --git a/site/docs/2.3.2/api/R/spark.survreg.html
b/site/docs/2.3.2/api/R/spark.survreg.html
new file mode 100644
i
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/Resubmitted.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/Resubmitted.html
b/site/docs/2.3.2/api/java/or
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/spark.gbt.html
--
diff --git a/site/docs/2.3.2/api/R/spark.gbt.html
b/site/docs/2.3.2/api/R/spark.gbt.html
new file mode 100644
index 000
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaDoubleRDD.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaDoubleRDD.html
b/site
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/function/MapGroupsWithStateFunction.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/func
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/function/CoGroupFunction.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/function/CoGrou
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/SparkFirehoseListener.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/SparkFirehoseListener.html
b/site/d
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/SparkEnv.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/SparkEnv.html
b/site/docs/2.3.2/api/java/org/apac
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/constant-values.html
--
diff --git a/site/docs/2.3.2/api/java/constant-values.html
b/site/docs/2.3.2/api/java/constant-values.html
new fil
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaRDDLike.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaRDDLike.html
b/site/doc
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/TaskCommitDenied.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/TaskCommitDenied.html
b/site/docs/2.3.2/a
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/summary.html
--
diff --git a/site/docs/2.3.2/api/R/summary.html
b/site/docs/2.3.2/api/R/summary.html
new file mode 100644
index 000..0cd3
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaFutureAction.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaFutureAction.html
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/00frame_toc.html
--
diff --git a/site/docs/2.3.2/api/R/00frame_toc.html
b/site/docs/2.3.2/api/R/00frame_toc.html
new file mode 100644
index 0
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/AccumulatorParam.Int
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/_layouts/global.html
--
diff --git a/_layouts/global.html b/_layouts/global.html
index 874138f..03a34db 100644
--- a/_layouts/global.html
+++ b/_layouts/global.html
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/schema.html
--
diff --git a/site/docs/2.3.2/api/R/schema.html
b/site/docs/2.3.2/api/R/schema.html
new file mode 100644
index 000..9cbcd1a
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/index.html
--
diff --git a/site/docs/2.3.2/api/java/index.html
b/site/docs/2.3.2/api/java/index.html
new file mode 100644
index 000..b
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaNewHadoopRDD.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaNewHadoopRDD.html
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaSparkContext.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaSparkContext.html
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaRDD.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaRDD.html
b/site/docs/2.3.2/a
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/attach.html
--
diff --git a/site/docs/2.3.2/api/R/attach.html
b/site/docs/2.3.2/api/R/attach.html
new file mode 100644
index 000..3d0058b
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/match.html
--
diff --git a/site/docs/2.3.2/api/R/match.html b/site/docs/2.3.2/api/R/match.html
new file mode 100644
index 000..d405b90
---
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/SimpleFutureAction.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/SimpleFutureAction.html
b/site/docs/2.3
Repository: spark-website
Updated Branches:
refs/heads/asf-site 806a1bd52 -> 04a27dbf1
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/r/PairwiseRRDD.html
--
diff
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/function/ForeachFunction.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/function/Foreac
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaSparkStatusTracker.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaSparkStatusTr
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/write.jdbc.html
--
diff --git a/site/docs/2.3.2/api/R/write.jdbc.html
b/site/docs/2.3.2/api/R/write.jdbc.html
new file mode 100644
index
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/lib/jquery.js
--
diff --git a/site/docs/2.3.2/api/java/lib/jquery.js
b/site/docs/2.3.2/api/java/lib/jquery.js
new file mode 100644
index 0
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/CleanShuffle.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/CleanShuffle.html
b/site/docs/2.3.2/api/java/
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/head.html
--
diff --git a/site/docs/2.3.2/api/R/head.html b/site/docs/2.3.2/api/R/head.html
new file mode 100644
index 000..30bee19
--- /d
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/function/package-summary.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/function/packag
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/SparkStageInfoImpl.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/SparkStageInfoImpl.html
b/site/docs/2.3
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaPairRDD.html
--
diff --git
a/site/docs/2.3.2/api/java/org/apache/spark/api/java/JavaPairRDD.html
b/site/doc
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/dropTempView.html
--
diff --git a/site/docs/2.3.2/api/R/dropTempView.html
b/site/docs/2.3.2/api/R/dropTempView.html
new file mode 100644
inde
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/R/rbind.html
--
diff --git a/site/docs/2.3.2/api/R/rbind.html b/site/docs/2.3.2/api/R/rbind.html
new file mode 100644
index 000..890ab98
---
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/TaskKilledException.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/TaskKilledException.html
b/site/docs/2
http://git-wip-us.apache.org/repos/asf/spark-website/blob/04a27dbf/site/docs/2.3.2/api/java/org/apache/spark/Aggregator.html
--
diff --git a/site/docs/2.3.2/api/java/org/apache/spark/Aggregator.html
b/site/docs/2.3.2/api/java/org/
Repository: spark
Updated Tags: refs/tags/v2.3.2 [created] 02b510728
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Author: jshao
Date: Mon Sep 17 12:13:30 2018
New Revision: 29438
Log:
Apache Spark v2.3.2-rc6 docs
[This commit notification would consist of 1447 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary
Author: jshao
Date: Sun Sep 16 13:30:43 2018
New Revision: 29421
Log:
Apache Spark v2.3.2-rc6
Added:
dev/spark/v2.3.2-rc6-bin/
dev/spark/v2.3.2-rc6-bin/SparkR_2.3.2.tar.gz (with props)
dev/spark/v2.3.2-rc6-bin/SparkR_2.3.2.tar.gz.asc
dev/spark/v2.3.2-rc6-bin/SparkR_2.3.2
Repository: spark
Updated Branches:
refs/heads/branch-2.3 0c1e3d109 -> 7b5da37c0
Preparing Spark release v2.3.2-rc6
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/02b51072
Tree: http://git-wip-us.apache.org/repos/asf/spar
Repository: spark
Updated Tags: refs/tags/v2.3.2-rc6 [created] 02b510728
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 2.3.3-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7b5da37c
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7b5da37c
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/7b5
Repository: spark
Updated Branches:
refs/heads/master aa70a0a1a -> 515708d5f
[SPARK-25183][SQL] Spark HiveServer2 to use Spark ShutdownHookManager
## What changes were proposed in this pull request?
Switch `org.apache.hive.service.server.HiveServer2` to register its shutdown
callback with Sp
Author: jshao
Date: Tue Aug 14 06:54:52 2018
New Revision: 28707
Log:
Apache Spark v2.3.2-rc5 docs
[This commit notification would consist of 1446 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary
Author: jshao
Date: Tue Aug 14 04:02:50 2018
New Revision: 28702
Log:
Apache Spark v2.3.2-rc5
Added:
dev/spark/v2.3.2-rc5-bin/
dev/spark/v2.3.2-rc5-bin/SparkR_2.3.2.tar.gz (with props)
dev/spark/v2.3.2-rc5-bin/SparkR_2.3.2.tar.gz.asc
dev/spark/v2.3.2-rc5-bin/SparkR_2.3.2
Repository: spark
Updated Tags: refs/tags/v2.3.2-rc5 [created] 4dc82259d
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 2.3.3-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/29a04036
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/29a04036
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/29a
Repository: spark
Updated Branches:
refs/heads/branch-2.3 787790b3c -> 29a040361
Preparing Spark release v2.3.2-rc5
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4dc82259
Tree: http://git-wip-us.apache.org/repos/asf/spar
Author: jshao
Date: Fri Aug 10 05:50:52 2018
New Revision: 28649
Log:
Apache Spark v2.3.2-rc4 docs
[This commit notification would consist of 1446 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary
Author: jshao
Date: Fri Aug 10 04:58:55 2018
New Revision: 28647
Log:
Apache Spark v2.3.2-rc4
Added:
dev/spark/v2.3.2-rc4-bin/
dev/spark/v2.3.2-rc4-bin/SparkR_2.3.2.tar.gz (with props)
dev/spark/v2.3.2-rc4-bin/SparkR_2.3.2.tar.gz.asc
dev/spark/v2.3.2-rc4-bin/SparkR_2.3.2
Repository: spark
Updated Branches:
refs/heads/branch-2.3 b426ec583 -> e66f3f9b1
Preparing Spark release v2.3.2-rc4
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6930f488
Tree: http://git-wip-us.apache.org/repos/asf/spar
Repository: spark
Updated Tags: refs/tags/v2.3.2-rc4 [created] 6930f4885
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 2.3.3-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e66f3f9b
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e66f3f9b
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e66
Repository: spark
Updated Branches:
refs/heads/branch-2.2 a5624c7ae -> 53ac8504b
[SPARK-24948][SHS][BACKPORT-2.2] Delegate check access permissions to the file
system
## What changes were proposed in this pull request?
In `SparkHadoopUtil. checkAccessPermission`, we consider only basic
per
Repository: spark
Updated Branches:
refs/heads/branch-2.3 136588e95 -> 9fb70f458
[SPARK-24948][SHS][BACKPORT-2.3] Delegate check access permissions to the file
system
## What changes were proposed in this pull request?
In `SparkHadoopUtil. checkAccessPermission`, we consider only basic
per
Repository: spark
Updated Branches:
refs/heads/master 3efdf3532 -> 15fff7903
[SPARK-24297][CORE] Fetch-to-disk by default for > 2gb
Fetch-to-mem is guaranteed to fail if the message is bigger than 2 GB,
so we might as well use fetch-to-disk in that case. The message includes
some metadata in
Repository: spark
Updated Branches:
refs/heads/master cfc3e1aaa -> d2436a852
[SPARK-24594][YARN] Introducing metrics for YARN
## What changes were proposed in this pull request?
In this PR metrics are introduced for YARN. As up to now there was no metrics
in the YARN module a new metric sys
Repository: spark
Updated Branches:
refs/heads/master 7e847646d -> 7db81ac8a
[SPARK-24195][CORE] Ignore the files with "local" scheme in SparkContext.addFile
## What changes were proposed in this pull request?
In Spark "local" scheme means resources are already on the driver/executor
nodes,
Repository: spark
Updated Branches:
refs/heads/master 67e108daa -> 7e847646d
[SPARK-24307][CORE] Support reading remote cached partitions > 2gb
(1) Netty's ByteBuf cannot support data > 2gb. So to transfer data from a
ChunkedByteBuffer over the network, we use a custom version of
FileRegion w
Author: jshao
Date: Sun Jul 15 07:30:18 2018
New Revision: 28123
Log:
Apache Spark v2.3.2-rc3 docs
[This commit notification would consist of 1446 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary
Author: jshao
Date: Sun Jul 15 03:04:30 2018
New Revision: 28118
Log:
Apache Spark v2.3.2-rc3
Added:
dev/spark/v2.3.2-rc3-bin/
dev/spark/v2.3.2-rc3-bin/SparkR_2.3.2.tar.gz (with props)
dev/spark/v2.3.2-rc3-bin/SparkR_2.3.2.tar.gz.asc
dev/spark/v2.3.2-rc3-bin/SparkR_2.3.2
Repository: spark
Updated Branches:
refs/heads/branch-2.3 9cf375f5b -> f9a2b0a87
Preparing Spark release v2.3.2-rc3
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b3726dad
Tree: http://git-wip-us.apache.org/repos/asf/spar
Preparing development version 2.3.3-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f9a2b0a8
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f9a2b0a8
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f9a
Repository: spark
Updated Tags: refs/tags/v2.3.2-rc3 [created] b3726dadc
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v2.3.2-rc2 [created] 307499e1a
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 2.3.3-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/86457a16
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/86457a16
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/864
Repository: spark
Updated Branches:
refs/heads/branch-2.3 19542f5de -> 86457a16d
Preparing Spark release v2.3.2-rc2
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/307499e1
Tree: http://git-wip-us.apache.org/repos/asf/spar
Repository: spark
Updated Branches:
refs/heads/master a28900956 -> 6fe32869c
[SPARK-24678][SPARK-STREAMING] Give priority in use of 'PROCESS_LOCAL' for
spark-streaming
## What changes were proposed in this pull request?
Currently, `BlockRDD.getPreferredLocations` only get hosts info of bloc
Repository: spark
Updated Branches:
refs/heads/master 79c668942 -> e2c7e09f7
[SPARK-24646][CORE] Minor change to spark.yarn.dist.forceDownloadSchemes to
support wildcard '*'
## What changes were proposed in this pull request?
In the case of getting tokens via customized `ServiceCredentialPro
Author: jshao
Date: Sun Jul 8 07:45:04 2018
New Revision: 27983
Log:
Apache Spark v2.3.2-rc1 docs
[This commit notification would consist of 1446 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary
Author: jshao
Date: Sun Jul 8 04:41:12 2018
New Revision: 27981
Log:
Apache Spark 2.3.2
Added:
dev/spark/v2.3.2-rc1-bin/
dev/spark/v2.3.2-rc1-bin/SparkR_2.3.2.tar.gz (with props)
dev/spark/v2.3.2-rc1-bin/SparkR_2.3.2.tar.gz.asc
dev/spark/v2.3.2-rc1-bin/SparkR_2.3.2
Repository: spark
Updated Branches:
refs/heads/branch-2.3 64c72b4de -> 72eb97ce9
Preparing Spark release v2.3.2-rc1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4df06b45
Tree: http://git-wip-us.apache.org/repos/asf/spar
Repository: spark
Updated Tags: refs/tags/v2.3.2-rc1 [created] 4df06b451
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 2.3.3-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/72eb97ce
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/72eb97ce
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/72e
Author: jshao
Date: Mon Jul 2 12:18:41 2018
New Revision: 27854
Log:
Update KEYS
Modified:
dev/spark/KEYS
Modified: dev/spark/KEYS
==
--- dev/spark/KEYS (original)
+++ dev/spark/KEYS Mon Jul 2 12:18:41 2018
Repository: spark
Updated Branches:
refs/heads/master 4c059ebc6 -> c7967c604
[SPARK-24418][BUILD] Upgrade Scala to 2.11.12 and 2.12.6
## What changes were proposed in this pull request?
Scala is upgraded to `2.11.12` and `2.12.6`.
We used `loadFIles()` in `ILoop` as a hook to initialize the
Repository: spark
Updated Branches:
refs/heads/master 21e1fc7d4 -> 2c9c8629b
[MINOR][YARN] Add YARN-specific credential providers in debug logging message
This PR adds a debugging log for YARN-specific credential providers which is
loaded by service loader mechanism.
It took me a while to de
1 - 100 of 154 matches
Mail list logo