Repository: spark
Updated Branches:
refs/heads/branch-1.4 877deb046 - a5f602efc
[SPARK-8309] [CORE] Support for more than 12M items in OpenHashMap
The problem occurs because the position mask `0xEFF` is incorrect. It has
zero 25th bit, so when capacity grows beyond 2^24, `OpenHashMap`
Repository: spark
Updated Branches:
refs/heads/branch-1.3 5f1a8e74b - cf232f0ee
[SPARK-8309] [CORE] Support for more than 12M items in OpenHashMap
The problem occurs because the position mask `0xEFF` is incorrect. It has
zero 25th bit, so when capacity grows beyond 2^24, `OpenHashMap`
Repository: spark
Updated Branches:
refs/heads/branch-1.4 fff8d7ee6 - f287f7ea1
[SPARK-8367] [STREAMING] Add a limit for 'spark.streaming.blockInterval` since
a data loss bug.
Bug had reported in the jira
[SPARK-8367](https://issues.apache.org/jira/browse/SPARK-8367)
The relution is
Repository: spark
Updated Branches:
refs/heads/master bc76a0f75 - ccf010f27
[SPARK-8367] [STREAMING] Add a limit for 'spark.streaming.blockInterval` since
a data loss bug.
Bug had reported in the jira
[SPARK-8367](https://issues.apache.org/jira/browse/SPARK-8367)
The relution is limitting
Repository: spark
Updated Branches:
refs/heads/master ccf010f27 - 658814c89
[SPARK-8129] [CORE] [Sec] Pass auth secrets to executors via env variables
Env variables are not visible to non-Spark users, based on suggestion from
vanzin.
Author: Kan Zhang kzh...@apache.org
Closes #6774 from
Repository: spark
Updated Branches:
refs/heads/branch-1.4 5c05b5c0d - b313920ab
[SPARK-8289] Specify stack size for consistency with Java tests - resolves test
failures
This change is a simple one and specifies a stack size of 4096k instead of the
vendor default for Java tests (the defaults
Repository: spark
Updated Branches:
refs/heads/master e84545fa7 - 6b68366df
[SPARK-8289] Specify stack size for consistency with Java tests - resolves test
failures
This change is a simple one and specifies a stack size of 4096k instead of the
vendor default for Java tests (the defaults
Repository: spark
Updated Branches:
refs/heads/master 4eb48ed1d - 4c5889e8f
[SPARK-8316] Upgrade to Maven 3.3.3
Versions of Maven older than 3.3.0 apparently have [a bug in how they handle
transitive
dependencies](https://github.com/apache/spark/pull/6492#issuecomment-111001101).
I
Repository: spark
Updated Branches:
refs/heads/master c771589c9 - 3e312a5ed
[DOCS] Fixing broken IDE setup link in the Building Spark documentation.
The location of the IDE setup information has changed, so this just updates the
link on the Building Spark page.
Author: Mike Dusenberry
Repository: spark
Updated Branches:
refs/heads/branch-1.4 448528398 - 0a65224ae
[DOCS] Fixing broken IDE setup link in the Building Spark documentation.
The location of the IDE setup information has changed, so this just updates the
link on the Building Spark page.
Author: Mike Dusenberry
Repository: spark
Updated Branches:
refs/heads/branch-1.3 7a3feb552 - d09a053ec
[DOCS] Fixing broken IDE setup link in the Building Spark documentation.
The location of the IDE setup information has changed, so this just updates the
link on the Building Spark page.
Author: Mike Dusenberry
Repository: spark
Updated Branches:
refs/heads/master bf4658070 - 8db40f671
[SPARK-7863] [CORE] Create SimpleDateFormat for every SimpleDateParam instance
because it's not thread-safe
SimpleDateFormat is not thread-safe. This PR creates new `SimpleDateFormat` for
each `SimpleDateParam`
Repository: spark
Updated Branches:
refs/heads/master 23452be94 - bf4658070
[SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security
providers
Add alias names for supported cipher suites to the sample SSL configuration.
The IBM JSSE provider reports its cipher suite
Repository: spark
Updated Branches:
refs/heads/branch-1.4 509a7cafc - 459c3d22e
[SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security
providers
Add alias names for supported cipher suites to the sample SSL configuration.
The IBM JSSE provider reports its cipher
Repository: spark
Updated Branches:
refs/heads/master 3c0156899 - e7c7e51f2
[DOC] Minor modification to Streaming docs with regards to parallel data
receiving
pwendell tdas
Author: Nishkam Ravi nr...@cloudera.com
Author: nishkamravi2 nishkamr...@gmail.com
Author: nravi
Repository: spark
Updated Branches:
refs/heads/master 8c8de3ed8 - 9d8aadb72
[SPARK-7945] [CORE] Do trim to values in properties file
https://issues.apache.org/jira/browse/SPARK-7945
Now applications submited by org.apache.spark.launcher.Main read properties
file without doing trim to values
Repository: spark
Updated Branches:
refs/heads/branch-1.4 d6e9eade6 - e7ba3ea86
[DOCS] [MINOR] Update for the Hadoop versions table with hadoop-2.6
Updated the doc for the hadoop-2.6 profile, which is new to Spark 1.4
Author: Taka Shinagawa taka.epsi...@gmail.com
Closes #6450 from
Repository: spark
Updated Branches:
refs/heads/branch-1.4 2c45009da - d6e9eade6
[SPARK-7890] [DOCS] Document that Spark 2.11 now supports Kafka
Remove caveat about Kafka / JDBC not being supported for Scala 2.11
Author: Sean Owen so...@cloudera.com
Closes #6470 from srowen/SPARK-7890
Repository: spark
Updated Branches:
refs/heads/master 0978aec9c - 8c8de3ed8
[SPARK-7890] [DOCS] Document that Spark 2.11 now supports Kafka
Remove caveat about Kafka / JDBC not being supported for Scala 2.11
Author: Sean Owen so...@cloudera.com
Closes #6470 from srowen/SPARK-7890
Repository: spark
Updated Branches:
refs/heads/master 9d8aadb72 - 2b35c99c7
[SPARK-7717] [WEBUI] Only showing total memory and cores for alive workers
Author: zhichao.li zhichao...@intel.com
Closes #6317 from zhichao-li/workers and squashes the following commits:
d68bf11 [zhichao.li] change
Repository: spark
Updated Branches:
refs/heads/master 2b35c99c7 - 3ab71eb9d
[DOCS] [MINOR] Update for the Hadoop versions table with hadoop-2.6
Updated the doc for the hadoop-2.6 profile, which is new to Spark 1.4
Author: Taka Shinagawa taka.epsi...@gmail.com
Closes #6450 from mrt/docfix2
Repository: spark
Updated Branches:
refs/heads/branch-1.4 bcfb37bf6 - 228aabe24
[SPARK-3444] [CORE] Restore INFO level after log4j test.
Otherwise other tests don't log anything useful...
Author: Marcelo Vanzin van...@cloudera.com
Closes #7140 from vanzin/SPARK-3444 and squashes the
Repository: spark
Updated Branches:
refs/heads/master 3083e1764 - 1ce642890
[SPARK-3444] [CORE] Restore INFO level after log4j test.
Otherwise other tests don't log anything useful...
Author: Marcelo Vanzin van...@cloudera.com
Closes #7140 from vanzin/SPARK-3444 and squashes the following
Repository: spark
Updated Branches:
refs/heads/branch-1.4 f5c9296a6 - eb0dd45de
[SPARK-8787] [SQL] Changed parameter order of @deprecated in package object sql
Parameter order of deprecated annotation in package object sql is wrong
deprecated(1.3.0, use DataFrame) .
This has to be changed to
Repository: spark
Updated Branches:
refs/heads/master 41588365a - c572e2561
[SPARK-8787] [SQL] Changed parameter order of @deprecated in package object sql
Parameter order of deprecated annotation in package object sql is wrong
deprecated(1.3.0, use DataFrame) .
This has to be changed to
Repository: spark
Updated Branches:
refs/heads/branch-1.4 eb0dd45de - 4720a8d83
[SPARK-8746] [SQL] update download link for Hive 0.13.1
updated the [Hive 0.13.1](https://archive.apache.org/dist/hive/hive-0.13.1)
download link in `sql/README.md`
Author: Christian Kadner ckad...@us.ibm.com
Repository: spark
Updated Branches:
refs/heads/master c572e2561 - 1bbdf9ead
[SPARK-8746] [SQL] update download link for Hive 0.13.1
updated the [Hive 0.13.1](https://archive.apache.org/dist/hive/hive-0.13.1)
download link in `sql/README.md`
Author: Christian Kadner ckad...@us.ibm.com
Repository: spark
Updated Branches:
refs/heads/branch-1.4 ffc793a6c - eab1d16a7
[SPARK-7756] [CORE] More robust SSL options processing.
Subset the enabled algorithms in an SSLOptions to the elements that are
supported by the protocol provider.
Update the list of ciphers in the sample config
Repository: spark
Updated Branches:
refs/heads/master 545245741 - 2ed0c0ac4
[SPARK-7756] [CORE] More robust SSL options processing.
Subset the enabled algorithms in an SSLOptions to the elements that are
supported by the protocol provider.
Update the list of ciphers in the sample config to
Repository: spark
Updated Branches:
refs/heads/master 65c696ecc - 4f4ba8fda
[SPARK-7811] Fix typo on slf4j configuration on metrics.properties.temâ¦
Fix minor typo on metrics.properties.template where slf4j is incorrectly
spelled as sl4j.
Author: Judy Nash judyn...@microsoft.com
Closes
Repository: spark
Updated Branches:
refs/heads/master 4f4ba8fda - 23bea97d9
Close HBaseAdmin at the end of HBaseTest
Author: tedyu yuzhih...@gmail.com
Closes #6381 from ted-yu/master and squashes the following commits:
e2f0ea1 [tedyu] Close HBaseAdmin at the end of HBaseTest
Project:
Repository: spark
Updated Branches:
refs/heads/master 23bea97d9 - fd31fd497
Add test which shows Kryo buffer size configured in mb is properly supported
This PR adds test which shows that Kryo buffer size configured in mb is
supported properly
Author: tedyu yuzhih...@gmail.com
Closes #6390
Repository: spark
Updated Branches:
refs/heads/master c9adcad81 - 43aa819c0
[SPARK-7042] [BUILD] use the standard akka artifacts with hadoop-2.x
Both akka 2.3.x and hadoop-2.x use protobuf 2.5 so only hadoop-1 build needs
custom 2.3.4-spark akka version that shades protobuf-2.5
This
...@cloudera.com
Closes #6231 from srowen/SPARK-6416 and squashes the following commits:
9fef39f [Sean Owen] Add comment to other languages; reword to highlight the
difference from non-distributed collections and to not suggest it is a bug that
is to be fixed
da40d84 [Sean Owen] Document current
...@cloudera.com
Closes #6231 from srowen/SPARK-6416 and squashes the following commits:
9fef39f [Sean Owen] Add comment to other languages; reword to highlight the
difference from non-distributed collections and to not suggest it is a bug that
is to be fixed
da40d84 [Sean Owen] Document current
Repository: spark
Updated Branches:
refs/heads/master 5287eec5a - 5a3c04bb9
[SPARK-7800] isDefined should not marked too early in putNewKey
JIRA: https://issues.apache.org/jira/browse/SPARK-7800
`isDefined` is marked as true twice in `Location.putNewKey`. The first one is
unnecessary and
Repository: spark
Updated Branches:
refs/heads/master f6c486aa4 - 15680aeed
[SPARK-7775] YARN AM negative sleep exception
```
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Exception in
Repository: spark
Updated Branches:
refs/heads/master e5a63a0e3 - 63099122d
[SPARK-7854] [TEST] refine Kryo test suite
this modification is according to JoshRosen 's comments, for details, please
refer to [#5934](https://github.com/apache/spark/pull/5934/files#r30949751).
Author: Zhang,
Repository: spark
Updated Branches:
refs/heads/branch-1.4 42070f096 - dfd905df5
[DOCS] [MLLIB] Fixing misformatted links in v1.4 MLlib Naive Bayes
documentation by removing space and newline characters.
A couple of links in the MLlib Naive Bayes documentation for v1.4 were broken
due to the
Repository: spark
Updated Branches:
refs/heads/master 8dbe0 - e5a63a0e3
[DOCS] [MLLIB] Fixing misformatted links in v1.4 MLlib Naive Bayes
documentation by removing space and newline characters.
A couple of links in the MLlib Naive Bayes documentation for v1.4 were broken
due to the
Repository: spark
Updated Branches:
refs/heads/master dd0614fd6 - c34e9ff0e
[MINOR] fix the comments in IndexShuffleBlockResolver
it might be a typo introduced at the first moment or some leftover after some
renaming..
the name of the method accessing the index file is called
Repository: spark
Updated Branches:
refs/heads/branch-1.5 40b89c38a - 42a0b4890
[MINOR] fix the comments in IndexShuffleBlockResolver
it might be a typo introduced at the first moment or some leftover after some
renaming..
the name of the method accessing the index file is called
Repository: spark
Updated Branches:
refs/heads/branch-1.5 5553f02be - 522b0b646
[SPARK-8949] Print warnings when using preferred locations feature
Add warnings according to SPARK-8949 in `SparkContext`
- warnings in scaladoc
- log warnings when preferred locations feature is used through
Repository: spark
Updated Branches:
refs/heads/master ba2a07e2b - 3d16a5450
[SPARK-8949] Print warnings when using preferred locations feature
Add warnings according to SPARK-8949 in `SparkContext`
- warnings in scaladoc
- log warnings when preferred locations feature is used through
Repository: spark
Updated Branches:
refs/heads/master 5b62bef8c - f3391ff2b
[SPARK-8889] [CORE] Fix for OOM for graph creation
Fix for OOM for graph creation
Author: Joshi rekhajo...@gmail.com
Author: Rekha Joshi rekhajo...@gmail.com
Closes #7602 from rekhajoshm/SPARK-8889.
Project:
Repository: spark
Updated Branches:
refs/heads/branch-1.5 561390dbc - e56bcc638
[DOCS] [SQL] [PYSPARK] Fix typo in ntile function
Fix typo in ntile function.
Author: Moussa Taifi mouta...@gmail.com
Closes #8261 from moutai/patch-2.
(cherry picked from commit
Repository: spark
Updated Branches:
refs/heads/master f141efeaf - 865a3df3d
[DOCS] [SQL] [PYSPARK] Fix typo in ntile function
Fix typo in ntile function.
Author: Moussa Taifi mouta...@gmail.com
Closes #8261 from moutai/patch-2.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Repository: spark
Updated Branches:
refs/heads/branch-1.5 e56bcc638 - 5553f02be
[SPARK-9977] [DOCS] Update documentation for StringIndexer
By using `StringIndexer`, we can obtain indexed label on new column. So a
following estimator should use this new column through pipeline if it wants to
Repository: spark
Updated Branches:
refs/heads/master 865a3df3d - ba2a07e2b
[SPARK-9977] [DOCS] Update documentation for StringIndexer
By using `StringIndexer`, we can obtain indexed label on new column. So a
following estimator should use this new column through pipeline if it wants to
use
too? this method isn't useful in Java 7 and beyond.
Author: Sean Owen so...@cloudera.com
Closes #8272 from srowen/SPARK-10070.
(cherry picked from commit f141efeafb42b14b5fcfd9aa8c5275162042349f)
Signed-off-by: Sean Owen so...@cloudera.com
Project: http://git-wip-us.apache.org/repos/asf/spark
? this method isn't useful in Java 7 and beyond.
Author: Sean Owen so...@cloudera.com
Closes #8272 from srowen/SPARK-10070.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f141efea
Tree: http://git-wip-us.apache.org/repos/asf
Repository: spark
Updated Branches:
refs/heads/master 9d1c02526 - 244016a95
[SPARK-9149] [ML] [EXAMPLES] Add an example of spark.ml KMeans
[SPARK-9149] Add an example of spark.ml KMeans - ASF JIRA
https://issues.apache.org/jira/browse/SPARK-9149
jkbradley Should we support other data
Repository: spark
Updated Branches:
refs/heads/master 16b928c54 - 9d1c02526
[SPARK-9521] [BUILD] Require Maven 3.3.3+ in the build
Enforce Maven 3.3.3+ in the build. (Also update the scala compiler plugin while
we're at it.)
Author: Sean Owen so...@cloudera.com
Closes #7852 from srowen
Repository: spark
Updated Branches:
refs/heads/branch-1.3 047a61365 - cc5f711c0
[SPARK-9254] [BUILD] [HOTFIX] sbt-launch-lib.bash should support HTTP/HTTPS
redirection
Target file(s) can be hosted on CDN nodes. HTTP/HTTPS redirection must be
supported to download these files.
Author: Cheng
in the process.
I'll explain several of the changes inline in comments.
Author: Sean Owen so...@cloudera.com
Closes #7862 from srowen/SPARK-9534 and squashes the following commits:
ea51618 [Sean Owen] Enable most javac lint warnings; fix a lot of build
warnings. In a few cases, touch up surrounding
in the process.
I'll explain several of the changes inline in comments.
Author: Sean Owen so...@cloudera.com
Closes #7862 from srowen/SPARK-9534 and squashes the following commits:
ea51618 [Sean Owen] Enable most javac lint warnings; fix a lot of build
warnings. In a few cases, touch up surrounding code
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ebe42b98c - 1f7dbcd6f
[SPARK-9521] [DOCS] Addendum. Require Maven 3.3.3+ in the build
Follow on for #7852: Building Spark doc needs to refer to new Maven requirement
too
Author: Sean Owen so...@cloudera.com
Closes #7905 from srowen
Repository: spark
Updated Branches:
refs/heads/master 76d74090d - b211cbc73
[SPARK-8064] [BUILD] Follow-up. Undo change from SPARK-9507 that was
accidentally reverted
This PR removes the dependency reduced POM hack brought back by #7191
Author: tedyu yuzhih...@gmail.com
Closes #7919 from
Repository: spark
Updated Branches:
refs/heads/branch-1.5 5ae675360 - bd9b75213
[SPARK-8064] [BUILD] Follow-up. Undo change from SPARK-9507 that was
accidentally reverted
This PR removes the dependency reduced POM hack brought back by #7191
Author: tedyu yuzhih...@gmail.com
Closes #7919
Repository: spark
Updated Branches:
refs/heads/master 04a49edfd - 27ae851ce
[SPARK-9446] Clear Active SparkContext in stop() method
In thread 'stopped SparkContext remaining active' on mailing list, Andres
observed the following in driver log:
```
15/07/29 15:17:09 WARN
Repository: spark
Updated Branches:
refs/heads/branch-1.4 3d6a9214e - 5ad9f950c
[SPARK-9446] Clear Active SparkContext in stop() method
In thread 'stopped SparkContext remaining active' on mailing list, Andres
observed the following in driver log:
```
15/07/29 15:17:09 WARN
: Sean Owen so...@cloudera.com
Closes #7826 from srowen/SPARK-9507 and squashes the following commits:
e0b0fd2 [Sean Owen] Update to shade plugin 2.4.1, which removes the need for
the dependency-reduced-POM workaround and the 'release' profile. Fix management
of shade plugin version so children
: Sean Owen so...@cloudera.com
Closes #7826 from srowen/SPARK-9507 and squashes the following commits:
e0b0fd2 [Sean Owen] Update to shade plugin 2.4.1, which removes the need for
the dependency-reduced-POM workaround and the 'release' profile. Fix management
of shade plugin version so children
Repository: spark
Updated Branches:
refs/heads/master a8340fa7d - c0686668a
[SPARK-9202] capping maximum number of executordriver information kept in
Worker
https://issues.apache.org/jira/browse/SPARK-9202
Author: CodingCat zhunans...@gmail.com
Closes #7714 from CodingCat/SPARK-9202 and
: Sean Owen so...@cloudera.com
Closes #7826 from srowen/SPARK-9507 and squashes the following commits:
e0b0fd2 [Sean Owen] Update to shade plugin 2.4.1, which removes the need for
the dependency-reduced-POM workaround and the 'release' profile. Fix management
of shade plugin version so children
Repository: spark
Updated Branches:
refs/heads/master 15724fac5 - ac8c549e2
[EC2] Cosmetic fix for usage of spark-ec2 --ebs-vol-num option
The last line of the usage seems ugly.
```
$ spark-ec2 --help
snip
--ebs-vol-num=EBS_VOL_NUM
Number of EBS volumes to attach to
Repository: spark
Updated Branches:
refs/heads/master 26b06f1c4 - e27a8c4cb
[SPARK-9607] [SPARK-9608] fix zinc-port handling in build/mvn
- pass `$ZINC_PORT` to zinc status/shutdown commands
- fix path check that sets `$ZINC_INSTALL_FLAG`, which was incorrectly
causing zinc to be shutdown
Repository: spark
Updated Branches:
refs/heads/branch-1.5 93c166a91 - 350006497
[SPARK-9607] [SPARK-9608] fix zinc-port handling in build/mvn
- pass `$ZINC_PORT` to zinc status/shutdown commands
- fix path check that sets `$ZINC_INSTALL_FLAG`, which was incorrectly
causing zinc to be
Repository: spark
Updated Branches:
refs/heads/branch-1.3 cd5d1be6e - 384793dff
[SPARK-9607] [SPARK-9608] fix zinc-port handling in build/mvn
- pass `$ZINC_PORT` to zinc status/shutdown commands
- fix path check that sets `$ZINC_INSTALL_FLAG`, which was incorrectly
causing zinc to be
Repository: spark
Updated Branches:
refs/heads/branch-1.4 dea04bf84 - 369510c5a
[SPARK-9607] [SPARK-9608] fix zinc-port handling in build/mvn
- pass `$ZINC_PORT` to zinc status/shutdown commands
- fix path check that sets `$ZINC_INSTALL_FLAG`, which was incorrectly
causing zinc to be
...@cloudera.com
Closes #7865 from srowen/SPARK-7563-1.3 and squashes the following commits:
f4479bc [Sean Owen] Backport of [SPARK-7563] OutputCommitCoordinator.stop()
should only run on the driver for 1.3
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip
Repository: spark
Updated Branches:
refs/heads/master c0cc0eaec - 7bbf02f0b
[SPARK-9267] [CORE] Retire stringify(Partial)?Value from Accumulators
cc srowen
Author: François Garillot franc...@garillot.net
Closes #7678 from huitseeker/master and squashes the following commits:
5e99f57
/pull/7792
Author: Sean Owen so...@cloudera.com
Closes #7956 from srowen/SPARK-9633 and squashes the following commits:
caa40bd [Sean Owen] Remove 2 defunct SBT download URLs and replace with the 1
known download URL. Also, use https.
(cherry picked from commit
/pull/7792
Author: Sean Owen so...@cloudera.com
Closes #7956 from srowen/SPARK-9633 and squashes the following commits:
caa40bd [Sean Owen] Remove 2 defunct SBT download URLs and replace with the 1
known download URL. Also, use https.
(cherry picked from commit
/pull/7792
Author: Sean Owen so...@cloudera.com
Closes #7956 from srowen/SPARK-9633 and squashes the following commits:
caa40bd [Sean Owen] Remove 2 defunct SBT download URLs and replace with the 1
known download URL. Also, use https.
(cherry picked from commit
/7792
Author: Sean Owen so...@cloudera.com
Closes #7956 from srowen/SPARK-9633 and squashes the following commits:
caa40bd [Sean Owen] Remove 2 defunct SBT download URLs and replace with the 1
known download URL. Also, use https.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit
Owen so...@cloudera.com
Closes #7991 from srowen/SPARK-9641 and squashes the following commits:
3bb946e [Sean Owen] Add link to docs for setup and config of external shuffle
service
2302e01 [Sean Owen] Document spark.shuffle.service.{enabled,port}
(cherry picked from commit
Repository: spark
Updated Branches:
refs/heads/master 68ccc6e18 - 86fa4ba6d
[SPARK-9737] [YARN] Add the suggested configuration when required executor
memory is above the max threshold of this cluster on YARN mode
Author: Yadong Qi qiyadong2...@gmail.com
Closes #8028 from
Repository: spark
Updated Branches:
refs/heads/master 34d610be8 - 57c2d0880
[SPARK-9923] [CORE] ShuffleMapStage.numAvailableOutputs should be an Int
instead of Long
Modified type of ShuffleMapStage.numAvailableOutputs from Long to Int
Author: Neelesh Srinivas Salian nsal...@cloudera.com
Repository: spark
Updated Branches:
refs/heads/master 7c1e56825 - a85fb6c07
[SPARK-9980] [BUILD] Fix SBT publishLocal error due to invalid characters in doc
Tiny modification to a few comments ```sbt publishLocal``` work again.
Author: Herman van Hovell hvanhov...@questtec.nl
Closes #8209
Repository: spark
Updated Branches:
refs/heads/branch-1.5 d97af68af - 1a6f0af9f
[SPARK-9980] [BUILD] Fix SBT publishLocal error due to invalid characters in doc
Tiny modification to a few comments ```sbt publishLocal``` work again.
Author: Herman van Hovell hvanhov...@questtec.nl
Closes
Repository: spark
Updated Branches:
refs/heads/master 4a01bfc2a - b79bf1df6
[SPARK-9337] [MLLIB] Add an ut for Word2Vec to verify the empty vocabulary check
jira: https://issues.apache.org/jira/browse/SPARK-9337
Word2Vec should throw exception when vocabulary is empty
Author: Yuhao Yang
Repository: spark
Updated Branches:
refs/heads/master 6a7e537f3 - 6cd28cc21
[SPARK-9236] [CORE] Make defaultPartitioner not reuse a parent RDD's
partitioner if it has 0 partitions
See also comments on https://issues.apache.org/jira/browse/SPARK-9236
Author: François Garillot
Repository: spark
Updated Branches:
refs/heads/branch-1.3 b20a9abc3 - f941482b0
[SPARK-9236] [CORE] Make defaultPartitioner not reuse a parent RDD's
partitioner if it has 0 partitions
See also comments on https://issues.apache.org/jira/browse/SPARK-9236
Author: François Garillot
Repository: spark
Updated Branches:
refs/heads/branch-1.4 07f778978 - a0b047bf2
[SPARK-9236] [CORE] Make defaultPartitioner not reuse a parent RDD's
partitioner if it has 0 partitions
See also comments on https://issues.apache.org/jira/browse/SPARK-9236
Author: François Garillot
Repository: spark
Updated Branches:
refs/heads/master 846cf4628 - 428cde5d1
[SPARK-9250] Make change-scala-version more helpful w.r.t. valid Scala versions
Author: François Garillot franc...@garillot.net
Closes #7595 from huitseeker/issue/SPARK-9250 and squashes the following
commits:
Repository: spark
Updated Branches:
refs/heads/master 6d0d8b406 - b983d493b
[SPARK-8695] [CORE] [MLLIB] TreeAggregation shouldn't be triggered when it
doesn't save wall-clock time.
Author: Perinkulam I. Ganesh g...@us.ibm.com
Closes #7397 from piganesh/SPARK-8695 and squashes the following
Repository: spark
Updated Branches:
refs/heads/master 4ea6480a3 - b536d5dc6
[SPARK-9015] [BUILD] Clean project import in scala ide
Cleanup maven for a clean import in scala-ide / eclipse.
* remove groovy plugin which is really not needed at all
* add-source from build-helper-maven-plugin is
from srowen/SPARK-9304 and squashes the following commits:
9ab2681 [Sean Owen] Add deprecation message to wrappers
3c8c202 [Sean Owen] Add back change-version-to-X.sh scripts, as wrappers for
new script, for backwards compatibility
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Repository: spark
Updated Branches:
refs/heads/master 20c1434a8 - c1feebd8f
[SPARK-9010] [DOCUMENTATION] Improve the Spark Configuration document about
`spark.kryoserializer.buffer`
The meaning of spark.kryoserializer.buffer should be Initial size of Kryo's
serialization buffer. Note that
Repository: spark
Updated Branches:
refs/heads/branch-1.4 50607eca5 - dce68ad1a
[SPARK-9010] [DOCUMENTATION] Improve the Spark Configuration document about
`spark.kryoserializer.buffer`
The meaning of spark.kryoserializer.buffer should be Initial size of Kryo's
serialization buffer. Note
Owen so...@cloudera.com
Closes #7376 from srowen/SPARK-4362 and squashes the following commits:
23d5a76 [Sean Owen] Fix model.labels - model.theta
95d91fb [Sean Owen] Check that predicted probabilities sum to 1
b32d1c8 [Sean Owen] Add predictProbabilities to Naive Bayes, return class
probabilities
Repository: spark
Updated Branches:
refs/heads/master 0a795336d - 011551620
[SPARK-8893] Add runtime checks against non-positive number of partitions
https://issues.apache.org/jira/browse/SPARK-8893
What does `sc.parallelize(1 to 3).repartition(p).collect` return? I would
expect `Array(1,
Repository: spark
Updated Branches:
refs/heads/master b9a922e26 - 674eb2a4c
[SPARK-8974] Catch exceptions in allocation schedule task.
I meet a problem. When I submit some tasks, the thread
spark-dynamic-executor-allocation should seed the message about
requestTotalExecutors, and the new
Repository: spark
Updated Branches:
refs/heads/branch-1.4 5b5693d2f - bb1401507
[SPARK-8974] Catch exceptions in allocation schedule task.
I meet a problem. When I submit some tasks, the thread
spark-dynamic-executor-allocation should seed the message about
requestTotalExecutors, and the
Repository: spark
Updated Branches:
refs/heads/branch-1.4 59838280f - 6834d96a6
[SPARK-9094] [PARENT] Increased io.dropwizard.metrics from 3.1.0 to 3.1.2
We are running Spark 1.4.0 in production and ran into problems because after a
network hiccup (which happens often in our current
Repository: spark
Updated Branches:
refs/heads/master 9b644c413 - 344d1567e
[SPARK-9094] [PARENT] Increased io.dropwizard.metrics from 3.1.0 to 3.1.2
We are running Spark 1.4.0 in production and ran into problems because after a
network hiccup (which happens often in our current environment)
Repository: spark
Updated Branches:
refs/heads/master 8b8be1f5d - 42d8a012f
[SPARK-8593] [CORE] Sort app attempts by start time.
This makes sure attempts are listed in the order they were executed, and that
the
app's state matches the state of the most current attempt.
Author: Joshi
Repository: spark
Updated Branches:
refs/heads/branch-1.4 f34f3d71f - 59838280f
[SPARK-8593] [CORE] Sort app attempts by start time.
This makes sure attempts are listed in the order they were executed, and that
the
app's state matches the state of the most current attempt.
Author: Joshi
Author: srowen
Date: Mon Jul 20 07:21:33 2015
New Revision: 1691882
URL: http://svn.apache.org/r1691882
Log:
Move nightly build info to wiki; leave link to it and move lower down on
downloads page
Modified:
spark/downloads.md
spark/site/downloads.html
Modified: spark/downloads.md
URL
401 - 500 of 4820 matches
Mail list logo
