[GitHub] spark issue #16178: [SPARK-18751][Core]Fix deadlock when SparkContext.stop i...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16178 **[Test build #69821 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69821/consoleFull)** for PR 16178 at commit

[GitHub] spark issue #16000: [SPARK-18537][Web UI]Add a REST api to spark streaming

2016-12-07 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16000 > what is the benefit of force they as one API beside "it sounds correct"? Because it pretty much ensures that when (not if) we add streaming to the history server, it will cause breakage in

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-07 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16139#discussion_r91422901 --- Diff: docs/ml-advanced.md --- @@ -59,17 +59,25 @@ Given $n$ weighted observations $(w_i, a_i, b_i)$: The number of features for each

[GitHub] spark issue #16000: [SPARK-18537][Web UI]Add a REST api to spark streaming

2016-12-07 Thread ChorPangChan
Github user ChorPangChan commented on the issue: https://github.com/apache/spark/pull/16000 I could not agree with "The API should be one" yet what is the benefit of force they as one API beside "it sounds correct"? as i mention before, i can not think of any usage of

[GitHub] spark issue #16122: [SPARK-18681][SQL] Fix filtering to compatible with part...

2016-12-07 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/16122 I think that's exactly what I tried and got the `NoSuchMethodException`. On Dec 7, 2016, at 3:35 PM, Eric Liang wrote: I did some digging into

[GitHub] spark issue #16201: [SPARK-3359][DOCS] Fix greater-than symbols in Javadoc t...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16201 **[Test build #3476 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3476/consoleFull)** for PR 16201 at commit

[GitHub] spark issue #16201: [SPARK-3359][DOCS] Fix greater-than symbols in Javadoc t...

2016-12-07 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16201 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16084: [SPARK-18654][SQL] Remove unreachable patterns in...

2016-12-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16084 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16204: [SPARK-18775][SQL] Limit the max number of records writt...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16204 **[Test build #69837 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69837/consoleFull)** for PR 16204 at commit

[GitHub] spark issue #16084: [SPARK-18654][SQL] Remove unreachable patterns in makeRo...

2016-12-07 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16084 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16186: [SPARK-18758][SS] StreamingQueryListener events from a S...

2016-12-07 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16186 LGTM pending tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16201: [SPARK-3359][DOCS] Fix greater-than symbols in Javadoc t...

2016-12-07 Thread michalsenkyr
Github user michalsenkyr commented on the issue: https://github.com/apache/spark/pull/16201 This time I inspected both the generated Javadoc and Scaladoc. It should be fine now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16203: [SPARK-18774][Core][SQL]Ignore non-existing files when i...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16203 **[Test build #69836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69836/consoleFull)** for PR 16203 at commit

[GitHub] spark pull request #16204: [SPARK-18775][SQL] Limit the max number of record...

2016-12-07 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/16204 [SPARK-18775][SQL] Limit the max number of records written per file - WIP ## What changes were proposed in this pull request? Currently, Spark writes a single file out per task, sometimes leading

[GitHub] spark pull request #16203: [SPARK-18774][Core][SQL]Ignore non-existing files...

2016-12-07 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16203 [SPARK-18774][Core][SQL]Ignore non-existing files when ignoreCorruptFiles is enabled ## What changes were proposed in this pull request? When `ignoreCorruptFiles` is enabled, it's better

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16187 **[Test build #69834 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69834/consoleFull)** for PR 16187 at commit

[GitHub] spark issue #16186: [SPARK-18758][SS] StreamingQueryListener events from a S...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16186 **[Test build #69835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69835/consoleFull)** for PR 16186 at commit

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69833 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69833/consoleFull)** for PR 16114 at commit

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91420339 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -63,18 +83,29 @@ class

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91419929 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -63,18 +83,29 @@ class

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91419859 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -35,12 +43,24 @@ class

[GitHub] spark pull request #16114: [SPARK-18620][Streaming][Kinesis] Flatten input r...

2016-12-07 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16114#discussion_r91419246 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala --- @@ -68,7 +68,16 @@ private[kinesis] class

[GitHub] spark issue #16202: [SPARK-18662][hotfix] Add new resource-manager directori...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16202 **[Test build #69832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69832/consoleFull)** for PR 16202 at commit

[GitHub] spark issue #16202: [SPARK-18662][hotfix] Add new resource-manager directori...

2016-12-07 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16202 @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16202: [SPARK-18662][hotfix] Add new resource-manager di...

2016-12-07 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/16202 [SPARK-18662][hotfix] Add new resource-manager directories to SparkLauncher. These directories are added to the classpath of applications when testing or using SPARK_PREPEND_CLASSES, otherwise

[GitHub] spark issue #16202: [SPARK-18662][hotfix] Add new resource-manager directori...

2016-12-07 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16202 I ran the yarn tests locally (without doing "sbt package" first) and they're happy. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69822/ Test FAILed. ---

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69822/consoleFull)** for PR 16138 at commit

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16187 **[Test build #3474 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3474/consoleFull)** for PR 16187 at commit

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15923 **[Test build #3475 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3475/consoleFull)** for PR 15923 at commit

[GitHub] spark issue #16201: [SPARK-3359][DOCS] Fix greater-than symbols in Javadoc t...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16201 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16201: [SPARK-3359][DOCS] Fix grater-than symbols in Jav...

2016-12-07 Thread michalsenkyr
GitHub user michalsenkyr opened a pull request: https://github.com/apache/spark/pull/16201 [SPARK-3359][DOCS] Fix grater-than symbols in Javadoc to allow building with Java 8 ## What changes were proposed in this pull request? The API documentation build was failing when

[GitHub] spark issue #16186: [SPARK-18758][SS] StreamingQueryListener events from a S...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16186 **[Test build #69831 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69831/consoleFull)** for PR 16186 at commit

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14638 **[Test build #69830 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69830/consoleFull)** for PR 14638 at commit

[GitHub] spark issue #16200: [SPARK-18773][core] Make commons-crypto config translati...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16200 **[Test build #69829 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69829/consoleFull)** for PR 16200 at commit

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15923 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69825/ Test FAILed. ---

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15923 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15923 **[Test build #69825 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69825/consoleFull)** for PR 15923 at commit

[GitHub] spark pull request #16200: [SPARK-18773][core] Make commons-crypto config tr...

2016-12-07 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/16200 [SPARK-18773][core] Make commons-crypto config translation consistent. This change moves the logic that translates Spark configuration to commons-crypto configuration to the network-common

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14638 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-07 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91414541 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -63,18 +83,29 @@ class

[GitHub] spark issue #16199: [SPARK-18772][SQL] NaN/Infinite float parsing in JSON is...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16199 **[Test build #69828 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69828/consoleFull)** for PR 16199 at commit

[GitHub] spark issue #16199: [SPARK-18772][SQL] NaN/Infinite float parsing in JSON is...

2016-12-07 Thread NathanHowell
Github user NathanHowell commented on the issue: https://github.com/apache/spark/pull/16199 Hello @HyukjinKwon, can you take a look at this one? I am unsure if we should be accepting lowercased values like `nan` (versus strictly testing for `NaN`) but I think this PR matches the

[GitHub] spark pull request #16199: [SPARK-18772][SQL] NaN/Infinite float parsing in ...

2016-12-07 Thread NathanHowell
GitHub user NathanHowell opened a pull request: https://github.com/apache/spark/pull/16199 [SPARK-18772][SQL] NaN/Infinite float parsing in JSON is inconsistent ## What changes were proposed in this pull request? This relaxes the parsing of `Float` and `Double` columns to

[GitHub] spark issue #16165: [SPARK-8617] [WEBUI] HistoryServer: Include in-progress ...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16165 **[Test build #69827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69827/consoleFull)** for PR 16165 at commit

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

2016-12-07 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16179 Not sure who exactly to ping here, but let's try @cloud-fan and @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16179 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16182: [SPARK-18754][SS] Rename recentProgresses to rece...

2016-12-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16182 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69817/ Test PASSed. ---

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16179 **[Test build #69817 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69817/consoleFull)** for PR 16179 at commit

[GitHub] spark issue #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" to over...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16189 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" to over...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16189 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69815/ Test PASSed. ---

[GitHub] spark issue #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" to over...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16189 **[Test build #69815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69815/consoleFull)** for PR 16189 at commit

[GitHub] spark issue #16122: [SPARK-18681][SQL] Fix filtering to compatible with part...

2016-12-07 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/16122 I did some digging into HiveClientImpl and Hive.java, and I think it would be pretty safe to call `Hive.get()` within the scope of a `client.withHiveState { }`. That call sets the thread-local hive

[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91412582 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -63,18 +83,29 @@ class

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-07 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16182 Merging this to master and 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69826/consoleFull)** for PR 16138 at commit

[GitHub] spark issue #15237: [SPARK-17663] [CORE] SchedulableBuilder should handle in...

2016-12-07 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/15237 Many thanks @squito for review. I will address them asap ;) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15923 **[Test build #69825 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69825/consoleFull)** for PR 15923 at commit

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-12-07 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/15923 @JoshRosen Added a test for `detectCorrupt` is false. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" to over...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16189 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69814/ Test FAILed. ---

[GitHub] spark issue #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" to over...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16189 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" to over...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16189 **[Test build #69814 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69814/consoleFull)** for PR 16189 at commit

[GitHub] spark pull request #16157: [SPARK-18723][DOC] Expanded programming guide inf...

2016-12-07 Thread michalsenkyr
Github user michalsenkyr commented on a diff in the pull request: https://github.com/apache/spark/pull/16157#discussion_r91405625 --- Diff: docs/programming-guide.md --- @@ -347,7 +347,7 @@ Some notes on reading files with Spark: Apart from text files, Spark's Scala API

[GitHub] spark issue #13579: [SPARK-15844] [core] HistoryServer doesn't come up if sp...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13579 **[Test build #69824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69824/consoleFull)** for PR 13579 at commit

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16182 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69811/ Test PASSed. ---

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16182 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16182 **[Test build #69811 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69811/consoleFull)** for PR 16182 at commit

[GitHub] spark issue #16161: [SPARK-18717][SQL] Make code generation for Scala Map wo...

2016-12-07 Thread aray
Github user aray commented on the issue: https://github.com/apache/spark/pull/16161 I would be happy to create a seperate PR for adding support for `mutable.Map` (and `List`) if that is wanted. But there is no _generic_ solution as there is no type that is assignable to both

[GitHub] spark issue #16150: [SPARK-18349][SparkR]:Update R API documentation on ml m...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16150 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69820/ Test PASSed. ---

[GitHub] spark issue #16150: [SPARK-18349][SparkR]:Update R API documentation on ml m...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16150 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16150: [SPARK-18349][SparkR]:Update R API documentation on ml m...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16150 **[Test build #69820 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69820/consoleFull)** for PR 16150 at commit

[GitHub] spark issue #13579: [SPARK-15844] [core] HistoryServer doesn't come up if sp...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13579 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13579: [SPARK-15844] [core] HistoryServer doesn't come up if sp...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13579 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69823/ Test FAILed. ---

[GitHub] spark issue #13579: [SPARK-15844] [core] HistoryServer doesn't come up if sp...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13579 **[Test build #69823 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69823/consoleFull)** for PR 13579 at commit

[GitHub] spark pull request #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with ...

2016-12-07 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/16138#discussion_r91403382 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1047,6 +1047,57 @@ case class

[GitHub] spark issue #13579: [SPARK-15844] [core] HistoryServer doesn't come up if sp...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13579 **[Test build #69823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69823/consoleFull)** for PR 13579 at commit

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69822/consoleFull)** for PR 16138 at commit

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16187 **[Test build #3474 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3474/consoleFull)** for PR 16187 at commit

[GitHub] spark issue #16178: [SPARK-18751][Core]Fix deadlock when SparkContext.stop i...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16178 **[Test build #69821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69821/consoleFull)** for PR 16178 at commit

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14638 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14638 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69816/ Test FAILed. ---

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14638 **[Test build #69816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69816/consoleFull)** for PR 14638 at commit

[GitHub] spark issue #16198: adding yarn module in pom

2016-12-07 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16198 @narendrasfo can you close the pull request as well? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16157: [SPARK-18723][DOC] Expanded programming guide informatio...

2016-12-07 Thread michalsenkyr
Github user michalsenkyr commented on the issue: https://github.com/apache/spark/pull/16157 I added a few more sentences describing the cases in which the user might want to use the argument. However, I am afraid this might be a little too descriptive. --- If your project is set up

[GitHub] spark issue #13579: [SPARK-15844] [core] HistoryServer doesn't come up if sp...

2016-12-07 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/13579 yeah, I've just got so many other distractions. Let me do it again while tests run in different windows --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-07 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16187 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16150: [SPARK-18349][SparkR]:Update R API documentation on ml m...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16150 **[Test build #69820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69820/consoleFull)** for PR 16150 at commit

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69819/ Test PASSed. ---

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16119 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16119 **[Test build #69819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69819/consoleFull)** for PR 16119 at commit

[GitHub] spark pull request #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceSt...

2016-12-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16109 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16122: [SPARK-18681][SQL] Fix filtering to compatible with part...

2016-12-07 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/16122 I'm not sure configuration-level rollback will guarantee an absence of interactions with other tests. For one thing, I think we need to create and clean up an independent metastore directory for

[GitHub] spark pull request #16193: [SPARK-18766] [SQL] Push Down Filter Through Batc...

2016-12-07 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/16193#discussion_r91394979 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/python/ExtractPythonUDFs.scala --- @@ -166,3 +174,40 @@ object ExtractPythonUDFs extends

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69818/ Test PASSed. ---

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16119 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16119 **[Test build #69818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69818/consoleFull)** for PR 16119 at commit

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16187 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69812/ Test FAILed. ---

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16187 **[Test build #69812 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69812/consoleFull)** for PR 16187 at commit

<    1   2   3   4   5   6   >