[jira] [Comment Edited] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731403#comment-15731403 ] DjvuLee edited comment on SPARK-18778 at 12/8/16 7:46 AM: -- When

[jira] [Commented] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731455#comment-15731455 ] DjvuLee commented on SPARK-18778: - [~srowen] [~andrewor14] can you have a look at? > Fix

[jira] [Updated] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3359: --- Fix Version/s: (was: 2.1.1) 2.1.0 > `sbt/sbt unidoc` doesn't work with Java 8 >

[jira] [Updated] (SPARK-18615) Switch to multi-line doc to avoid a genjavadoc bug for backticks

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18615: Fix Version/s: (was: 2.1.1) 2.1.0 > Switch to multi-line doc to avoid a genj

[jira] [Updated] (SPARK-18685) Fix all tests in ExecutorClassLoaderSuite to pass on Windows

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18685: Fix Version/s: (was: 2.1.1) 2.1.0 > Fix all tests in ExecutorClassLoaderSuit

[jira] [Updated] (SPARK-18645) spark-daemon.sh arguments error lead to throws Unrecognized option

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18645: Fix Version/s: (was: 2.1.1) 2.1.0 > spark-daemon.sh arguments error lead to

[jira] [Updated] (SPARK-18762) Web UI should be http:4040 instead of https:4040

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18762: Fix Version/s: (was: 2.1.1) 2.1.0 > Web UI should be http:4040 instead of ht

[jira] [Updated] (SPARK-18546) UnsafeShuffleWriter corrupts encrypted shuffle files when merging

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18546: Fix Version/s: (was: 2.1.1) 2.1.0 > UnsafeShuffleWriter corrupts encrypted s

[jira] [Comment Edited] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731431#comment-15731431 ] DjvuLee edited comment on SPARK-18778 at 12/8/16 7:38 AM: -- I giv

[jira] [Comment Edited] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731431#comment-15731431 ] DjvuLee edited comment on SPARK-18778 at 12/8/16 7:38 AM: -- I giv

[jira] [Comment Edited] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731431#comment-15731431 ] DjvuLee edited comment on SPARK-18778 at 12/8/16 7:35 AM: -- I giv

[jira] [Commented] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731431#comment-15731431 ] DjvuLee commented on SPARK-18778: - I give a fix in the https://github.com/apache/spark/pu

[jira] [Assigned] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18778: Assignee: Apache Spark > Fix the Scala classpath in the spark-shell >

[jira] [Commented] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731432#comment-15731432 ] Apache Spark commented on SPARK-18778: -- User 'djvulee' has created a pull request fo

[jira] [Assigned] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18778: Assignee: (was: Apache Spark) > Fix the Scala classpath in the spark-shell > -

[jira] [Commented] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731424#comment-15731424 ] Nick Pentreath commented on SPARK-18633: Went ahead and remarked fix version to {

[jira] [Updated] (SPARK-18081) Locality Sensitive Hashing (LSH) User Guide

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18081: --- Fix Version/s: (was: 2.2.0) > Locality Sensitive Hashing (LSH) User Guide > -

[jira] [Updated] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18633: --- Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0

[jira] [Commented] (SPARK-18081) Locality Sensitive Hashing (LSH) User Guide

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731419#comment-15731419 ] Nick Pentreath commented on SPARK-18081: Went ahead and re-marked fix version to

[jira] [Commented] (SPARK-15819) Add KMeanSummary in KMeans of PySpark

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731421#comment-15731421 ] Nick Pentreath commented on SPARK-15819: Went ahead and re-marked fix version to

[jira] [Commented] (SPARK-18274) Memory leak in PySpark StringIndexer

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731418#comment-15731418 ] Nick Pentreath commented on SPARK-18274: Went ahead and re-marked fix version to

[jira] [Updated] (SPARK-15819) Add KMeanSummary in KMeans of PySpark

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-15819: --- Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0

[jira] [Updated] (SPARK-18081) Locality Sensitive Hashing (LSH) User Guide

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18081: --- Fix Version/s: (was: 2.1.1) 2.1.0 > Locality Sensitive Hashing (LSH) U

[jira] [Updated] (SPARK-18274) Memory leak in PySpark StringIndexer

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18274: --- Fix Version/s: (was: 2.1.1) 2.1.0 > Memory leak in PySpark StringIndex

[jira] [Commented] (SPARK-18318) ML, Graph 2.1 QA: API: New Scala APIs, docs

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731415#comment-15731415 ] Nick Pentreath commented on SPARK-18318: Went ahead and re-marked fix version to

[jira] [Commented] (SPARK-18319) ML, Graph 2.1 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731413#comment-15731413 ] Nick Pentreath commented on SPARK-18319: Went ahead and re-marked fix version to

[jira] [Updated] (SPARK-18319) ML, Graph 2.1 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18319: --- Fix Version/s: (was: 2.2.0) 2.1.0 > ML, Graph 2.1 QA: API: Experimenta

[jira] [Updated] (SPARK-18319) ML, Graph 2.1 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18319: --- Fix Version/s: (was: 2.1.1) > ML, Graph 2.1 QA: API: Experimental, DeveloperApi, final, s

[jira] [Updated] (SPARK-18318) ML, Graph 2.1 QA: API: New Scala APIs, docs

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18318: --- Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0

[jira] [Updated] (SPARK-18592) Move DT/RF/GBT Param setter methods to subclasses

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18592: --- Fix Version/s: (was: 2.2.0) > Move DT/RF/GBT Param setter methods to subclasses > ---

[jira] [Commented] (SPARK-18320) ML 2.1 QA: API: Python API coverage

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731411#comment-15731411 ] Nick Pentreath commented on SPARK-18320: Went ahead and re-marked fix version to

[jira] [Updated] (SPARK-18324) ML, Graph 2.1 QA: Programming guide update and migration guide

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18324: --- Fix Version/s: (was: 2.2.0) > ML, Graph 2.1 QA: Programming guide update and migration gu

[jira] [Updated] (SPARK-18408) API Improvements for LSH

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18408: --- Fix Version/s: (was: 2.2.0) > API Improvements for LSH > > >

[jira] [Updated] (SPARK-18320) ML 2.1 QA: API: Python API coverage

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18320: --- Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0

[jira] [Commented] (SPARK-18408) API Improvements for LSH

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731407#comment-15731407 ] Nick Pentreath commented on SPARK-18408: Went ahead and re-marked fix version to

[jira] [Updated] (SPARK-18324) ML, Graph 2.1 QA: Programming guide update and migration guide

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18324: --- Fix Version/s: (was: 2.1.1) 2.1.0 > ML, Graph 2.1 QA: Programming guid

[jira] [Commented] (SPARK-18366) Add handleInvalid to Pyspark for QuantileDiscretizer and Bucketizer

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731408#comment-15731408 ] Nick Pentreath commented on SPARK-18366: Went ahead and re-marked fix version to

[jira] [Commented] (SPARK-18324) ML, Graph 2.1 QA: Programming guide update and migration guide

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731410#comment-15731410 ] Nick Pentreath commented on SPARK-18324: Went ahead and re-marked fix version to

[jira] [Commented] (SPARK-18612) Leaked broadcasted variable Mllib

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731402#comment-15731402 ] Nick Pentreath commented on SPARK-18612: Went ahead and re-marked fix version to

[jira] [Commented] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731403#comment-15731403 ] DjvuLee commented on SPARK-18778: - When I just run the ./bin/spark-shell under our enviro

[jira] [Updated] (SPARK-18592) Move DT/RF/GBT Param setter methods to subclasses

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18592: --- Fix Version/s: (was: 2.1.1) 2.1.0 > Move DT/RF/GBT Param setter method

[jira] [Comment Edited] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731403#comment-15731403 ] DjvuLee edited comment on SPARK-18778 at 12/8/16 7:25 AM: -- When

[jira] [Commented] (SPARK-18592) Move DT/RF/GBT Param setter methods to subclasses

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731406#comment-15731406 ] Nick Pentreath commented on SPARK-18592: Went ahead and re-marked fix version to

[jira] [Updated] (SPARK-18612) Leaked broadcasted variable Mllib

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18612: --- Fix Version/s: (was: 2.1.1) 2.1.0 > Leaked broadcasted variable Mllib

[jira] [Updated] (SPARK-18408) API Improvements for LSH

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18408: --- Fix Version/s: (was: 2.1.1) 2.1.0 > API Improvements for LSH > ---

[jira] [Updated] (SPARK-18366) Add handleInvalid to Pyspark for QuantileDiscretizer and Bucketizer

2016-12-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18366: --- Fix Version/s: (was: 2.1.1) 2.1.0 > Add handleInvalid to Pyspark for Q

[jira] [Updated] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DjvuLee updated SPARK-18778: Affects Version/s: 1.6.1 2.0.2 > Fix the Scala classpath in the spark-shell > --

[jira] [Updated] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DjvuLee updated SPARK-18778: Description: Failed to initialize compiler: object scala.runtime in compiler mirror not found. ** Note tha

[jira] [Created] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread DjvuLee (JIRA)
DjvuLee created SPARK-18778: --- Summary: Fix the Scala classpath in the spark-shell Key: SPARK-18778 URL: https://issues.apache.org/jira/browse/SPARK-18778 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-18777) Return UDF objects when registering from Python

2016-12-07 Thread holdenk (JIRA)
holdenk created SPARK-18777: --- Summary: Return UDF objects when registering from Python Key: SPARK-18777 URL: https://issues.apache.org/jira/browse/SPARK-18777 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731347#comment-15731347 ] Apache Spark commented on SPARK-10849: -- User 'sureshthalamati' has created a pull re

[jira] [Comment Edited] (SPARK-6417) Add Linear Programming algorithm

2016-12-07 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731333#comment-15731333 ] Ehsan Mohyedin Kermani edited comment on SPARK-6417 at 12/8/16 6:54 AM:

[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm

2016-12-07 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731333#comment-15731333 ] Ehsan Mohyedin Kermani commented on SPARK-6417: --- Here's my implementation in

[jira] [Commented] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731326#comment-15731326 ] Apache Spark commented on SPARK-10849: -- User 'sureshthalamati' has created a pull re

[jira] [Updated] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18774: Fix Version/s: (was: 2.1.1) 2.2.0 > Ignore non-existing files when ignoreCor

[jira] [Resolved] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18774. - Resolution: Fixed Fix Version/s: 2.1.1 > Ignore non-existing files when ignoreCorruptFiles

[jira] [Updated] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18745: Target Version/s: (was: 2.1.0) > java.lang.IndexOutOfBoundsException running query 68 Spark SQL o

[jira] [Commented] (SPARK-18748) UDF multiple evaluations causes very poor performance

2016-12-07 Thread Ohad Raviv (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731203#comment-15731203 ] Ohad Raviv commented on SPARK-18748: accidently. I already closed the other ticket as

[jira] [Commented] (SPARK-18750) spark should be able to control the number of executor and should not throw stack overslow

2016-12-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731079#comment-15731079 ] Sean Owen commented on SPARK-18750: --- Yeah, I guess I should have realized that by natur

[jira] [Resolved] (SPARK-18326) SparkR 2.1 QA: New R APIs and API docs

2016-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18326. - Resolution: Fixed Fix Version/s: 2.1.0 > SparkR 2.1 QA: New R APIs and API docs >

[jira] [Assigned] (SPARK-18326) SparkR 2.1 QA: New R APIs and API docs

2016-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-18326: --- Assignee: Yanbo Liang > SparkR 2.1 QA: New R APIs and API docs > ---

[jira] [Commented] (SPARK-18776) Offset for FileStreamSource is not json formatted

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731003#comment-15731003 ] Apache Spark commented on SPARK-18776: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-18776) Offset for FileStreamSource is not json formatted

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18776: Assignee: Apache Spark (was: Tathagata Das) > Offset for FileStreamSource is not json for

[jira] [Assigned] (SPARK-18776) Offset for FileStreamSource is not json formatted

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18776: Assignee: Tathagata Das (was: Apache Spark) > Offset for FileStreamSource is not json for

[jira] [Resolved] (SPARK-18705) Docs for one-pass solver for linear regression with L1 and elastic-net penalties

2016-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18705. - Resolution: Fixed Fix Version/s: 2.1.0 > Docs for one-pass solver for linear regression wi

[jira] [Created] (SPARK-18776) Offset for FileStreamSource is not json formatted

2016-12-07 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-18776: - Summary: Offset for FileStreamSource is not json formatted Key: SPARK-18776 URL: https://issues.apache.org/jira/browse/SPARK-18776 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-18758) StreamingQueryListener events from a StreamingQuery should be sent only to the listeners in the same session as the query

2016-12-07 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-18758. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 16186 [https://g

[jira] [Resolved] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18633. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue resolved

[jira] [Updated] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18633: -- Assignee: Miao Wang > Add multiclass logistic regression summary python example and doc

[jira] [Updated] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18633: -- Shepherd: Joseph K. Bradley Assignee: (was: Miao Wang) > Add multiclass logisti

[jira] [Updated] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18633: -- Priority: Minor (was: Major) > Add multiclass logistic regression summary python examp

[jira] [Updated] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18633: -- Assignee: Miao Wang > Add multiclass logistic regression summary python example and doc

[jira] [Commented] (SPARK-18750) spark should be able to control the number of executor and should not throw stack overslow

2016-12-07 Thread Neerja Khattar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730717#comment-15730717 ] Neerja Khattar commented on SPARK-18750: [~srowen] I added the the full stack tra

[jira] [Resolved] (SPARK-18654) JacksonParser.makeRootConverter has effectively unreachable code

2016-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18654. - Resolution: Fixed Assignee: Nathan Howell Fix Version/s: 2.2.0 > JacksonParser.ma

[jira] [Commented] (SPARK-18775) Limit the max number of records written per file

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730476#comment-15730476 ] Apache Spark commented on SPARK-18775: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-18775) Limit the max number of records written per file

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18775: Assignee: Reynold Xin (was: Apache Spark) > Limit the max number of records written per f

[jira] [Assigned] (SPARK-18775) Limit the max number of records written per file

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18775: Assignee: Apache Spark (was: Reynold Xin) > Limit the max number of records written per f

[jira] [Assigned] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18774: Assignee: Apache Spark (was: Shixiong Zhu) > Ignore non-existing files when ignoreCorrupt

[jira] [Commented] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730465#comment-15730465 ] Apache Spark commented on SPARK-18774: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18774: Assignee: Shixiong Zhu (was: Apache Spark) > Ignore non-existing files when ignoreCorrupt

[jira] [Created] (SPARK-18775) Limit the max number of records written per file

2016-12-07 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-18775: --- Summary: Limit the max number of records written per file Key: SPARK-18775 URL: https://issues.apache.org/jira/browse/SPARK-18775 Project: Spark Issue Type: Ne

[jira] [Created] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-18774: Summary: Ignore non-existing files when ignoreCorruptFiles is enabled Key: SPARK-18774 URL: https://issues.apache.org/jira/browse/SPARK-18774 Project: Spark

[jira] [Commented] (SPARK-18662) Move cluster managers into their own sub-directory

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730428#comment-15730428 ] Apache Spark commented on SPARK-18662: -- User 'vanzin' has created a pull request for

[jira] [Resolved] (SPARK-18322) ML, Graph 2.1 QA: Update user guide for new features & APIs

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18322. --- Resolution: Done Fix Version/s: 2.1.0 Thanks [~yanboliang]! > ML, Graph 2.1 Q

[jira] [Updated] (SPARK-18705) Docs for one-pass solver for linear regression with L1 and elastic-net penalties

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18705: -- Target Version/s: 2.1.0 > Docs for one-pass solver for linear regression with L1 and el

[jira] [Updated] (SPARK-18705) Docs for one-pass solver for linear regression with L1 and elastic-net penalties

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18705: -- Issue Type: Documentation (was: Improvement) > Docs for one-pass solver for linear reg

[jira] [Commented] (SPARK-18322) ML, Graph 2.1 QA: Update user guide for new features & APIs

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730403#comment-15730403 ] Joseph K. Bradley commented on SPARK-18322: --- I'd like the docs for 2.1 features

[jira] [Updated] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18633: -- Issue Type: Documentation (was: Improvement) > Add multiclass logistic regression summ

[jira] [Updated] (SPARK-18633) Add multiclass logistic regression summary python example and document

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18633: -- Target Version/s: 2.1.0 > Add multiclass logistic regression summary python example and

[jira] [Updated] (SPARK-18080) Locality Sensitive Hashing (LSH) Python API

2016-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18080: -- Target Version/s: 2.2.0 > Locality Sensitive Hashing (LSH) Python API > ---

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730387#comment-15730387 ] Apache Spark commented on SPARK-3359: - User 'michalsenkyr' has created a pull request

[jira] [Resolved] (SPARK-18754) Rename recentProgresses to recentProgress

2016-12-07 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-18754. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 16182 [https://g

[jira] [Assigned] (SPARK-18773) Make translation of Spark configs to commons-crypto configs consistent

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18773: Assignee: Apache Spark > Make translation of Spark configs to commons-crypto configs consi

[jira] [Assigned] (SPARK-18773) Make translation of Spark configs to commons-crypto configs consistent

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18773: Assignee: (was: Apache Spark) > Make translation of Spark configs to commons-crypto co

[jira] [Commented] (SPARK-18773) Make translation of Spark configs to commons-crypto configs consistent

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730348#comment-15730348 ] Apache Spark commented on SPARK-18773: -- User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

2016-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730338#comment-15730338 ] Michal Šenkýř commented on SPARK-3359: -- The build passed. I can put it into a PR if y

[jira] [Assigned] (SPARK-18772) Parsing JSON with some NaN and Infinity values throws NumberFormatException

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18772: Assignee: (was: Apache Spark) > Parsing JSON with some NaN and Infinity values throws

[jira] [Assigned] (SPARK-18772) Parsing JSON with some NaN and Infinity values throws NumberFormatException

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18772: Assignee: Apache Spark > Parsing JSON with some NaN and Infinity values throws NumberForma

[jira] [Commented] (SPARK-18772) Parsing JSON with some NaN and Infinity values throws NumberFormatException

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730323#comment-15730323 ] Apache Spark commented on SPARK-18772: -- User 'NathanHowell' has created a pull reque

[jira] [Comment Edited] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

2016-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730311#comment-15730311 ] Michal Šenkýř edited comment on SPARK-3359 at 12/7/16 11:40 PM:

  1   2   >