[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104159896 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104160406 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33220/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104160395 [Test build #33220 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33220/consoleFull) for PR 6311 at commit [`ade3841`](https://github.com/apache/spark/commit/ade3841fb489de47fb10bd7182235b0978ec8777). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104160405 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7394][SQL] Add Pandas style cast (astyp...
GitHub user kaka1992 opened a pull request: https://github.com/apache/spark/pull/6313 [SPARK-7394][SQL] Add Pandas style cast (astype) You can merge this pull request into a Git repository by running: $ git pull https://github.com/kaka1992/spark astype Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/6313.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #6313 commit 4f328b737c5b67424b75db043e98f35c32f50d72 Author: kaka1992 Date: 2015-05-21T05:37:06Z [SPARK-7394] Add Pandas style cast (astype) commit ad8feb2389a756102226aacd482405930ea1d29d Author: kaka1992 Date: 2015-05-21T07:17:24Z [SPARK-7394] Add Pandas style cast (astype) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7745] Change asserts to requires for us...
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6271#issuecomment-104163836 All right, merging this! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7394][SQL] Add Pandas style cast (astyp...
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6313#discussion_r30777920 --- Diff: python/pyspark/sql/column.py --- @@ -294,6 +294,17 @@ def cast(self, dataType): return Column(jc) @ignore_unicode_prefix +def astype(self, dataType): --- End diff -- you can just do ```python astype = cast ``` and I think everything will work. cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7394][SQL] Add Pandas style cast (astyp...
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6313#discussion_r30777940 --- Diff: python/pyspark/sql/column.py --- @@ -294,6 +294,17 @@ def cast(self, dataType): return Column(jc) @ignore_unicode_prefix +def astype(self, dataType): --- End diff -- (see the groupby function at the end of DataFrame) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7394][SQL] Add Pandas style cast (astyp...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6313#issuecomment-104164018 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104165155 [Test build #33222 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33222/consoleFull) for PR 6311 at commit [`8ad5af4`](https://github.com/apache/spark/commit/8ad5af405e79403ab5eb09f2addb19744d00ab07). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104165167 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33222/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104165164 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104165206 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33224/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7745] Change asserts to requires for us...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6271 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104165197 [Test build #33224 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33224/consoleFull) for PR 6312 at commit [`09b7e8b`](https://github.com/apache/spark/commit/09b7e8b6b943f18b8d6ef881c2f74bef7064788e). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-104165240 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104165205 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-104165267 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-104166209 [Test build #33227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33227/consoleFull) for PR 5267 at commit [`957d3e2`](https://github.com/apache/spark/commit/957d3e2ebac92e901bd6d64bebbc4a32a3b7e41f). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7758][SQL]delete the executionHive to a...
GitHub user WangTaoTheTonic opened a pull request: https://github.com/apache/spark/pull/6314 [SPARK-7758][SQL]delete the executionHive to avoid failure when connect to a postgre sql https://issues.apache.org/jira/browse/SPARK-7758 I think that `executionHive` is a relief for `metadataHive` when `create temporary function` and it is not propriate to creating a local metastore to do such thing as it is kinda a hack thing and leads to error like what this JIRA said when we connected postgre sql as metastore. So I delete it but am not sure if it will impact other by removing the clause `SessionState.setCurrentSessionState(executionHive.state)`. @marmbrus Could you help check this, as you reconstruct codes here(https://github.com/apache/spark/commit/cd1d4110cfffb413ab585cf1cc8f1264243cb393#diff-ff50aea397a607b79df9bec6f2a841db)? Thanks very much. You can merge this pull request into a Git repository by running: $ git pull https://github.com/WangTaoTheTonic/spark SPARK-7758 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/6314.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #6314 commit 21bf202ecc03b131ec7a4438cc988b16d380a35b Author: WangTaoTheTonic Date: 2015-05-21T07:00:00Z delete the executionHive --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7646][SQL] Create table from dataframe ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6155#issuecomment-104167090 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7758][SQL]delete the executionHive to a...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6314#issuecomment-104167097 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7758][SQL]delete the executionHive to a...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6314#issuecomment-104167089 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104167320 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7758][SQL]delete the executionHive to a...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6314#issuecomment-104167387 [Test build #33228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33228/consoleFull) for PR 6314 at commit [`21bf202`](https://github.com/apache/spark/commit/21bf202ecc03b131ec7a4438cc988b16d380a35b). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104167761 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104167786 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6514][SPARK-5960][SPARK-6656][SPARK-767...
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/6147#discussion_r30779195
--- Diff:
extras/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisUtils.scala
---
@@ -79,19 +181,116 @@ object KinesisUtils {
* per Kinesis' limit of 24 hours
*
(InitialPositionInStream.TRIM_HORIZON) or
* the tip of the stream
(InitialPositionInStream.LATEST).
- * @param storageLevel Storage level to use for storing the received
objects
+ * @param storageLevel Storage level to use for storing the received
objects.
+ * StorageLevel.MEMORY_AND_DISK_2 is recommended.
+ */
+ def createStream(
+ jssc: JavaStreamingContext,
+ kinesisAppName: String,
+ streamName: String,
+ endpointUrl: String,
+ regionName: String,
+ initialPositionInStream: InitialPositionInStream,
+ checkpointInterval: Duration,
+ storageLevel: StorageLevel
+): JavaReceiverInputDStream[Array[Byte]] = {
+createStream(jssc.ssc, kinesisAppName, streamName, endpointUrl,
regionName,
+ initialPositionInStream, checkpointInterval, storageLevel)
+ }
+
+ /**
+ * Create an input stream that pulls messages from a Kinesis stream.
+ * This uses the Kinesis Client Library (KCL) to pull messages from
Kinesis.
*
- * @return JavaReceiverInputDStream[Array[Byte]]
+ * Note:
+ * The given AWS credentials will get saved in DStream checkpoints if
checkpointing
+ * is enabled. Make sure that your checkpoint directory is secure.
+ *
+ * @param jssc Java StreamingContext object
+ * @param kinesisAppName Kinesis application name used by the Kinesis
Client Library
+ *(KCL) to update DynamoDB
+ * @param streamName Kinesis stream name
+ * @param endpointUrl Url of Kinesis service (e.g.,
https://kinesis.us-east-1.amazonaws.com)
+ * @param regionName Name of region used by the Kinesis Client Library
(KCL) to update
+ * DynamoDB (lease coordination and checkpointing)
and CloudWatch (metrics)
+ * @param awsAccessKeyId AWS AccessKeyId (if null, will use
DefaultAWSCredentialsProviderChain)
+ * @param awsSecretKey AWS SecretKey (if null, will use
DefaultAWSCredentialsProviderChain)
+ * @param checkpointInterval Checkpoint interval for Kinesis
checkpointing.
+ *See the Kinesis Spark Streaming
documentation for more
+ *details on the different types of
checkpoints.
+ * @param initialPositionInStream In the absence of Kinesis checkpoint
info, this is the
+ * worker's initial starting position in
the stream.
+ * The values are either the beginning
of the stream
+ * per Kinesis' limit of 24 hours
+ *
(InitialPositionInStream.TRIM_HORIZON) or
+ * the tip of the stream
(InitialPositionInStream.LATEST).
+ * @param storageLevel Storage level to use for storing the received
objects.
+ * StorageLevel.MEMORY_AND_DISK_2 is recommended.
*/
- @Experimental
def createStream(
- jssc: JavaStreamingContext,
- streamName: String,
- endpointUrl: String,
+ jssc: JavaStreamingContext,
+ kinesisAppName: String,
+ streamName: String,
+ endpointUrl: String,
+ regionName: String,
+ initialPositionInStream: InitialPositionInStream,
+ checkpointInterval: Duration,
+ storageLevel: StorageLevel,
+ awsAccessKeyId: String,
+ awsSecretKey: String
+): JavaReceiverInputDStream[Array[Byte]] = {
+createStream(jssc.ssc, kinesisAppName, streamName, endpointUrl,
regionName,
+initialPositionInStream, checkpointInterval, storageLevel,
awsAccessKeyId, awsSecretKey)
+ }
+
+ /**
+ * Create an input stream that pulls messages from a Kinesis stream.
+ * This uses the Kinesis Client Library (KCL) to pull messages from
Kinesis.
+ *
+ * Note:
+ * - The AWS credentials will be discovered using the
DefaultAWSCredentialsProviderChain
+ * on the workers. See AWS documentation to understand how
DefaultAWSCredentialsProviderChain
+ * gets AWS credentials.
+ * - The region of the `endpointUrl` will be used for DynamoDB and
CloudWatch.
+ * - The Kinesis application name used by the Kinesis Client Library
(KCL) will be the app name in
+ * [[org.apache.spark.SparkConf]].
+ *
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104168452 [Test build #33229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33229/consoleFull) for PR 6312 at commit [`b03a25f`](https://github.com/apache/spark/commit/b03a25f85610291088d9bbe5cd803c379ef4c4f9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7565] [SQL] fix MapType in JsonRDD
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6299#issuecomment-104168433 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33223/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7565] [SQL] fix MapType in JsonRDD
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6299#issuecomment-104168420 [Test build #33223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33223/consoleFull) for PR 6299 at commit [`0dbf559`](https://github.com/apache/spark/commit/0dbf559d9d34e0bfa8e035e609bee454687dc5c3). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7565] [SQL] fix MapType in JsonRDD
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6299#issuecomment-104168431 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6514][SPARK-5960][SPARK-6656] Ability t...
Github user cfregly closed the pull request at: https://github.com/apache/spark/pull/5882 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104168931 [Test build #33225 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33225/consoleFull) for PR 6312 at commit [`b03a25f`](https://github.com/apache/spark/commit/b03a25f85610291088d9bbe5cd803c379ef4c4f9). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104168941 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33225/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104168939 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104169890 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104170545 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104170583 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7604] [MLlib] Python API for PCA and PC...
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/6315 [SPARK-7604] [MLlib] Python API for PCA and PCAModel Python API for PCA and PCAModel You can merge this pull request into a Git repository by running: $ git pull https://github.com/yanboliang/spark spark-7604 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/6315.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #6315 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7776] [STREAMING] Added shutdown hook t...
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6307#issuecomment-104171083 @zsxwing I completely agree. That's why I am not sure about adding this and wanted to get more feedback. The reason for attempting this was this thread - https://www.mail-archive.com/user@spark.apache.org/msg28788.html Your thoughts? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7320] [SQL] [Minor] Move the testData i...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6312#issuecomment-104171419 [Test build #33230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33230/consoleFull) for PR 6312 at commit [`b03a25f`](https://github.com/apache/spark/commit/b03a25f85610291088d9bbe5cd803c379ef4c4f9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7604] [MLlib] Python API for PCA and PC...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6315#issuecomment-104171834 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7604] [MLlib] Python API for PCA and PC...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6315#issuecomment-104171863 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104171842 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104171864 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104171962 [Test build #33232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33232/consoleFull) for PR 4380 at commit [`401fab8`](https://github.com/apache/spark/commit/401fab85528ff0b5263ef730683a3887297164d8). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104172163 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7604] [MLlib] Python API for PCA and PC...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6315#issuecomment-104172169 [Test build #33231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33231/consoleFull) for PR 6315 at commit [`4d9d121`](https://github.com/apache/spark/commit/4d9d121d0caa4bf0dce8c285ec17a23c1764d13b). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104172166 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33232/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104172529 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104172508 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6322][SQL] CTAS should consider the cas...
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/5014 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6466][SQL] Remove unnecessary attribute...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/5134#issuecomment-104172678 @chenghao-intel do you think we still need this? If no, I should close it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104173142 [Test build #33233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33233/consoleFull) for PR 4380 at commit [`b5bcfd6`](https://github.com/apache/spark/commit/b5bcfd6cd009fccfa6e4eae9ae5705e52f172ad7). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7787] [STREAMING] Fix serialization iss...
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6316#issuecomment-104173260 @cfregly Take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7787] [STREAMING] Fix serialization iss...
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/6316 [SPARK-7787] [STREAMING] Fix serialization issue of SerializableAWSCredentials Lack of default constructor causes deserialization to fail. This occurs only when the AWS credentials are explicitly specified through KinesisUtils. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tdas/spark SPARK-7787 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/6316.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #6316 commit 248ca5cdd68db979d928d4ab54679c64186e31b1 Author: Tathagata Das Date: 2015-05-21T08:06:00Z Fixed serializability --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7119][SQL] ScriptTransform should also ...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/5688#issuecomment-10417 @chenghao-intel @marmbrus Please take a look of this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104173377 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33233/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104173376 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7787] [STREAMING] Fix serialization iss...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6316#issuecomment-104173537 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7787] [STREAMING] Fix serialization iss...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6316#issuecomment-104173558 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6307][Core] Speed up RDD.cartesian by c...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/5572#issuecomment-104173697 @srowen Any more comments? Or who should take a look of this too? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7787] [STREAMING] Fix serialization iss...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6316#issuecomment-104173983 [Test build #33234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33234/consoleFull) for PR 6316 at commit [`248ca5c`](https://github.com/apache/spark/commit/248ca5cdd68db979d928d4ab54679c64186e31b1). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7270][SQL] Consider dynamic partition w...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/5864#issuecomment-104174113 ping @yhuai @marmbrus. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7199][SQL] Add date and timestamp suppo...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/5984#issuecomment-104174338 @JoshRosen Any more comments or thoughts? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104174449 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6307][Core] Speed up RDD.cartesian by c...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5572#issuecomment-104174467 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104174468 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6307][Core] Speed up RDD.cartesian by c...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5572#issuecomment-104174441 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7254][MLlib] Run PowerIterationClusteri...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/6054#issuecomment-104174532 Ping @mengxr @jkbradley. Please take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4380#issuecomment-104174679 [Test build #33236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33236/consoleFull) for PR 4380 at commit [`390645c`](https://github.com/apache/spark/commit/390645cc246e4270c73cddbe4359a90741b21b78). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6307][Core] Speed up RDD.cartesian by c...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5572#issuecomment-104174675 [Test build #33235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33235/consoleFull) for PR 5572 at commit [`f542445`](https://github.com/apache/spark/commit/f5424450803da42f46bd8c97e5aab4ada0ec69ec). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...
Github user evacchi commented on the pull request: https://github.com/apache/spark/pull/6122#issuecomment-104174843 @rxin may I ask if you can trigger a test build? code is the same as PR #5556 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6122#issuecomment-104176443 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6122#issuecomment-104177977 [Test build #33237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33237/consoleFull) for PR 6122 at commit [`ac03efe`](https://github.com/apache/spark/commit/ac03efef8e2eff6c9171e52cc157cb4f68cddaae). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6122#issuecomment-104177592 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6122#issuecomment-104177634 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6122#issuecomment-104182362 [Test build #33237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33237/consoleFull) for PR 6122 at commit [`ac03efe`](https://github.com/apache/spark/commit/ac03efef8e2eff6c9171e52cc157cb4f68cddaae). * This patch **fails MiMa tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `trait QueryPlanner[PhysicalPlan <: TreeNode[PhysicalPlan]] ` * `protected[sql] class QueryExecution(val sqlContext: SQLContext, val logical: LogicalPlan) ` * `protected[sql] class SparkPlanner(val sqlContext: SQLContext) extends SparkStrategies ` * `protected[sql] class HiveQueryExecution(hiveContext: HiveContext, logicalPlan: LogicalPlan)` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6122#issuecomment-104182368 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33237/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6122#issuecomment-104182367 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7717][WebUI] Only showing total memory ...
GitHub user zhichao-li opened a pull request: https://github.com/apache/spark/pull/6317 [SPARK-7717][WebUI] Only showing total memory and cores for alive workers You can merge this pull request into a Git repository by running: $ git pull https://github.com/zhichao-li/spark workers Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/6317.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #6317 commit 1e8eb06492ed8333fa0d4d2c1729a44097c1fc4d Author: zhichao.li Date: 2015-05-21T08:28:59Z only showing alive workers --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7758][SQL]delete the executionHive to a...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6314#issuecomment-104182488 [Test build #33228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33228/consoleFull) for PR 6314 at commit [`21bf202`](https://github.com/apache/spark/commit/21bf202ecc03b131ec7a4438cc988b16d380a35b). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104182603 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7758][SQL]delete the executionHive to a...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6314#issuecomment-104182504 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33228/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7758][SQL]delete the executionHive to a...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6314#issuecomment-104182500 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104182587 [Test build #33226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33226/consoleFull) for PR 6311 at commit [`0261db1`](https://github.com/apache/spark/commit/0261db1f1dd869a033766aef231bbe1e6492c32b). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class KernelDensity extends Serializable ` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7783] [SQL] [PySpark] add DataFrame.rol...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6311#issuecomment-104182604 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33226/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7717][WebUI] Only showing total memory ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6317#issuecomment-104182800 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7717][WebUI] Only showing total memory ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6317#issuecomment-104182815 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7717][WebUI] Only showing total memory ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6317#issuecomment-104182888 [Test build #33238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33238/consoleFull) for PR 6317 at commit [`1e8eb06`](https://github.com/apache/spark/commit/1e8eb06492ed8333fa0d4d2c1729a44097c1fc4d). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-104187490 [Test build #33227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33227/consoleFull) for PR 5267 at commit [`957d3e2`](https://github.com/apache/spark/commit/957d3e2ebac92e901bd6d64bebbc4a32a3b7e41f). * This patch **fails PySpark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class HierarchicalClusteringModel(val tree: ClusterTree)` * `class HierarchicalClusteringModel(JavaModelWrapper, JavaSaveable, JavaLoader):` * `class HierarchicalClustering(object):` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-104187507 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33227/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-104187504 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6307][Core] Speed up RDD.cartesian by c...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5572#issuecomment-104188203 [Test build #33235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33235/consoleFull) for PR 5572 at commit [`f542445`](https://github.com/apache/spark/commit/f5424450803da42f46bd8c97e5aab4ada0ec69ec). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class KernelDensity extends Serializable ` * `class GroupedData protected[sql](` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6307][Core] Speed up RDD.cartesian by c...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5572#issuecomment-104188219 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33235/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6307][Core] Speed up RDD.cartesian by c...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5572#issuecomment-104188217 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6307][Core] Speed up RDD.cartesian by c...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/5572#issuecomment-104188713 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-104189519 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-104189496 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
