[jira] [Resolved] (SPARK-14829) Deprecate GLM APIs using SGD

[ https://issues.apache.org/jira/browse/SPARK-14829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14829. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12596

[jira] [Resolved] (SPARK-7264) SparkR API for parallel functions

[ https://issues.apache.org/jira/browse/SPARK-7264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7264. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12426

[jira] [Updated] (SPARK-14962) spark.sql.orc.filterPushdown=true breaks DataFrame where functionality

[ https://issues.apache.org/jira/browse/SPARK-14962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-14962: - Affects Version/s: 2.0.0 > spark.sql.orc.filterPushdown=true breaks DataFrame where

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225263#comment-15225263 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/29/16 5:28 AM: --- Oh, sorry I

[jira] [Comment Edited] (SPARK-14962) spark.sql.orc.filterPushdown=true breaks DataFrame where functionality

[ https://issues.apache.org/jira/browse/SPARK-14962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263560#comment-15263560 ] Hyukjin Kwon edited comment on SPARK-14962 at 4/29/16 5:29 AM: --- -FWIW, I

[jira] [Comment Edited] (SPARK-14962) spark.sql.orc.filterPushdown=true breaks DataFrame where functionality

[ https://issues.apache.org/jira/browse/SPARK-14962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263560#comment-15263560 ] Hyukjin Kwon edited comment on SPARK-14962 at 4/29/16 5:27 AM: --- ~~FWIW, I

[jira] [Commented] (SPARK-14962) spark.sql.orc.filterPushdown=true breaks DataFrame where functionality

[ https://issues.apache.org/jira/browse/SPARK-14962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263560#comment-15263560 ] Hyukjin Kwon commented on SPARK-14962: -- FWIW, I could not reproduce this in master branch. Let me

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263549#comment-15263549 ] Shivaram Venkataraman commented on SPARK-14995: --- We could just use one of the existing

[jira] [Resolved] (SPARK-14991) Remove HiveNativeCommand

[ https://issues.apache.org/jira/browse/SPARK-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14991. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 2.0.0 > Remove

[jira] [Commented] (SPARK-14906) Move VectorUDT and MatrixUDT in PySpark to new ML package

[ https://issues.apache.org/jira/browse/SPARK-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263537#comment-15263537 ] Liang-Chi Hsieh commented on SPARK-14906: - Are you working on this? If not, I will work on this

[jira] [Assigned] (SPARK-14997) Files in subdirectories are incorrectly considered in sqlContext.read.json()

[ https://issues.apache.org/jira/browse/SPARK-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14997: Assignee: (was: Apache Spark) > Files in subdirectories are incorrectly considered in

[jira] [Assigned] (SPARK-14997) Files in subdirectories are incorrectly considered in sqlContext.read.json()

[ https://issues.apache.org/jira/browse/SPARK-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14997: Assignee: Apache Spark > Files in subdirectories are incorrectly considered in

[jira] [Commented] (SPARK-14997) Files in subdirectories are incorrectly considered in sqlContext.read.json()

[ https://issues.apache.org/jira/browse/SPARK-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263520#comment-15263520 ] Apache Spark commented on SPARK-14997: -- User 'sbcd90' has created a pull request for this issue:

[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems

[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263516#comment-15263516 ] William Grim commented on SPARK-4820: - Hi, this is still an issue to this day. I just started using

[jira] [Commented] (SPARK-10525) Add Python example for VectorSlicer to user guide

[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263489#comment-15263489 ] Amit Shinde commented on SPARK-10525: - Hi : I was looking at this JIRA and found a similar JIRA

[jira] [Updated] (SPARK-14997) Files in subdirectories are incorrectly considered in sqlContext.read.json()

[ https://issues.apache.org/jira/browse/SPARK-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14997: - Component/s: SQL > Files in subdirectories are incorrectly considered in sqlContext.read.json() >

[jira] [Updated] (SPARK-14613) Add @Since into the matrix and vector classes in spark-mllib-local

[ https://issues.apache.org/jira/browse/SPARK-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14613: - Fix Version/s: (was: 2.0.0) > Add @Since into the matrix and vector classes in spark-mllib-local >

[jira] [Assigned] (SPARK-14613) Add @Since into the matrix and vector classes in spark-mllib-local

[ https://issues.apache.org/jira/browse/SPARK-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14613: Assignee: Pravin Gadakh (was: Apache Spark) > Add @Since into the matrix and vector

[jira] [Assigned] (SPARK-14613) Add @Since into the matrix and vector classes in spark-mllib-local

[ https://issues.apache.org/jira/browse/SPARK-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14613: Assignee: Apache Spark (was: Pravin Gadakh) > Add @Since into the matrix and vector

[jira] [Reopened] (SPARK-14613) Add @Since into the matrix and vector classes in spark-mllib-local

[ https://issues.apache.org/jira/browse/SPARK-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-14613: -- > Add @Since into the matrix and vector classes in spark-mllib-local >

[jira] [Assigned] (SPARK-14998) SparkSQL throw java.lang.ArrayIndexOutOfBoundsException when use Transformation

[ https://issues.apache.org/jira/browse/SPARK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14998: Assignee: Apache Spark > SparkSQL throw java.lang.ArrayIndexOutOfBoundsException when use

[jira] [Assigned] (SPARK-14998) SparkSQL throw java.lang.ArrayIndexOutOfBoundsException when use Transformation

[ https://issues.apache.org/jira/browse/SPARK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14998: Assignee: (was: Apache Spark) > SparkSQL throw

[jira] [Commented] (SPARK-14998) SparkSQL throw java.lang.ArrayIndexOutOfBoundsException when use Transformation

[ https://issues.apache.org/jira/browse/SPARK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263408#comment-15263408 ] Apache Spark commented on SPARK-14998: -- User 'liyuance' has created a pull request for this issue:

[jira] [Created] (SPARK-14998) SparkSQL throw java.lang.ArrayIndexOutOfBoundsException when use Transformation

Yuance Li created SPARK-14998: - Summary: SparkSQL throw java.lang.ArrayIndexOutOfBoundsException when use Transformation Key: SPARK-14998 URL: https://issues.apache.org/jira/browse/SPARK-14998 Project:

[jira] [Created] (SPARK-14997) Files in subdirectories are incorrectly considered in sqlContext.read.json()

Tathagata Das created SPARK-14997: - Summary: Files in subdirectories are incorrectly considered in sqlContext.read.json() Key: SPARK-14997 URL: https://issues.apache.org/jira/browse/SPARK-14997

[jira] [Assigned] (SPARK-14996) Add TPCDS Benchmark Queries for SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-14996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14996: Assignee: (was: Apache Spark) > Add TPCDS Benchmark Queries for SparkSQL >

[jira] [Commented] (SPARK-14996) Add TPCDS Benchmark Queries for SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-14996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263402#comment-15263402 ] Apache Spark commented on SPARK-14996: -- User 'sameeragarwal' has created a pull request for this

[jira] [Assigned] (SPARK-14996) Add TPCDS Benchmark Queries for SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-14996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14996: Assignee: Apache Spark > Add TPCDS Benchmark Queries for SparkSQL >

[jira] [Created] (SPARK-14996) Add TPCDS Benchmark Queries for SparkSQL

Sameer Agarwal created SPARK-14996: -- Summary: Add TPCDS Benchmark Queries for SparkSQL Key: SPARK-14996 URL: https://issues.apache.org/jira/browse/SPARK-14996 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14977) Fine grained mode in Mesos is not fair

[ https://issues.apache.org/jira/browse/SPARK-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263393#comment-15263393 ] Michael Gummelt commented on SPARK-14977: - I assume your first two jobs are long running? Mesos

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263389#comment-15263389 ] Felix Cheung commented on SPARK-14995: -- Possibly ;) but if I recall, there isn't a standard way to

[jira] [Commented] (SPARK-14559) Netty RPC didn't check channel is active before sending message

[ https://issues.apache.org/jira/browse/SPARK-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263388#comment-15263388 ] wei wu commented on SPARK-14559: Do you think we should check the client isActive status before send the

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263352#comment-15263352 ] Sun Rui commented on SPARK-14995: - cc [~felixcheung], [~Narine], [~shivaram]. [~felixcheung] are you

[jira] [Created] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

Sun Rui created SPARK-14995: --- Summary: Add "since" tag in Roxygen documentation for SparkR API methods Key: SPARK-14995 URL: https://issues.apache.org/jira/browse/SPARK-14995 Project: Spark Issue

[jira] [Resolved] (SPARK-14802) Disable Passing to Hive the queries that can't be parsed

[ https://issues.apache.org/jira/browse/SPARK-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14802. - Resolution: Duplicate Assignee: Reynold Xin Fix Version/s: 2.0.0 > Disable

[jira] [Assigned] (SPARK-14994) Remove execution hive from HiveSessionState

[ https://issues.apache.org/jira/browse/SPARK-14994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14994: Assignee: Reynold Xin (was: Apache Spark) > Remove execution hive from HiveSessionState

[jira] [Commented] (SPARK-14994) Remove execution hive from HiveSessionState

[ https://issues.apache.org/jira/browse/SPARK-14994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263281#comment-15263281 ] Apache Spark commented on SPARK-14994: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14994) Remove execution hive from HiveSessionState

[ https://issues.apache.org/jira/browse/SPARK-14994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14994: Assignee: Apache Spark (was: Reynold Xin) > Remove execution hive from HiveSessionState

[jira] [Created] (SPARK-14994) Remove execution hive from HiveSessionState

Reynold Xin created SPARK-14994: --- Summary: Remove execution hive from HiveSessionState Key: SPARK-14994 URL: https://issues.apache.org/jira/browse/SPARK-14994 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-14836) Zip local jars before uploading to distributed cache

[ https://issues.apache.org/jira/browse/SPARK-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-14836. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.0.0 > Zip local

[jira] [Updated] (SPARK-14993) Inconsistent behavior of partitioning discovery

[ https://issues.apache.org/jira/browse/SPARK-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14993: - Target Version/s: 2.0.0 > Inconsistent behavior of partitioning discovery >

[jira] [Created] (SPARK-14993) Inconsistent behavior of partitioning discovery

Yin Huai created SPARK-14993: Summary: Inconsistent behavior of partitioning discovery Key: SPARK-14993 URL: https://issues.apache.org/jira/browse/SPARK-14993 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14992) Flaky test: BucketedReadSuite.only shuffle one side when join bucketed table and non-bucketed table

Davies Liu created SPARK-14992: -- Summary: Flaky test: BucketedReadSuite.only shuffle one side when join bucketed table and non-bucketed table Key: SPARK-14992 URL: https://issues.apache.org/jira/browse/SPARK-14992

[jira] [Assigned] (SPARK-14991) Remove HiveNativeCommand

[ https://issues.apache.org/jira/browse/SPARK-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14991: Assignee: Apache Spark > Remove HiveNativeCommand > > >

[jira] [Commented] (SPARK-14991) Remove HiveNativeCommand

[ https://issues.apache.org/jira/browse/SPARK-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263249#comment-15263249 ] Apache Spark commented on SPARK-14991: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14991) Remove HiveNativeCommand

[ https://issues.apache.org/jira/browse/SPARK-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14991: Assignee: (was: Apache Spark) > Remove HiveNativeCommand > >

[jira] [Commented] (SPARK-14434) User guide doc and examples for GaussianMixture in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263244#comment-15263244 ] Miao Wang commented on SPARK-14434: --- ETA: 04/30/2016 > User guide doc and examples for GaussianMixture

[jira] [Resolved] (SPARK-14862) Tree and ensemble classification: do not require label metadata

[ https://issues.apache.org/jira/browse/SPARK-14862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14862. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12663

[jira] [Resolved] (SPARK-14613) Add @Since into the matrix and vector classes in spark-mllib-local

[ https://issues.apache.org/jira/browse/SPARK-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-14613. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12416

[jira] [Created] (SPARK-14991) Remove HiveNativeCommand

Reynold Xin created SPARK-14991: --- Summary: Remove HiveNativeCommand Key: SPARK-14991 URL: https://issues.apache.org/jira/browse/SPARK-14991 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263150#comment-15263150 ] Joseph K. Bradley commented on SPARK-14817: --- Thanks all! I realized there were 2 ambiguous QA

[jira] [Updated] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14817: -- Description: Before the release, we need to update the MLlib, GraphX, and SparkR

[jira] [Updated] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14815: -- Description: Check the user guide vs. a list of new APIs (classes, methods, data

[jira] [Updated] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14815: -- Summary: ML, Graph, R 2.0 QA: Update user guide for new features & APIs (was: ML,

[jira] [Updated] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new APIs

[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14815: -- Description: Check the user guide vs. a list of new APIs (classes, methods, data

[jira] [Updated] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14817: -- Summary: ML, Graph, R 2.0 QA: Programming guide update and migration guide (was: ML

[jira] [Updated] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14817: -- Component/s: SparkR GraphX > ML, Graph, R 2.0 QA: Programming guide

[jira] [Updated] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14816: -- Description: Update the sub-projects' websites to include new features in this

[jira] [Updated] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14816: -- Summary: Update MLlib, GraphX, SparkR websites for 2.0 (was: Update MLlib website for

[jira] [Updated] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14816: -- Component/s: SparkR GraphX > Update MLlib, GraphX, SparkR websites

[jira] [Updated] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new APIs

[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14815: -- Description: Check the user guide vs. a list of new APIs (classes, methods, data

[jira] [Updated] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new APIs

[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14815: -- Description: Check the user guide vs. a list of new APIs (classes, methods, data

[jira] [Updated] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new APIs

[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14815: -- Component/s: SparkR GraphX > ML, Graph, R 2.0 QA: Update user guide

[jira] [Updated] (SPARK-14813) ML 2.0 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14813: -- Description: For new public APIs added to MLlib, we need to check the generated HTML

[jira] [Updated] (SPARK-14813) ML 2.0 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14813: -- Component/s: (was: MLlib) > ML 2.0 QA: API: Python API coverage >

[jira] [Updated] (SPARK-14815) ML, Graph, R 2.0 QA: Update user guide for new APIs

[ https://issues.apache.org/jira/browse/SPARK-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14815: -- Summary: ML, Graph, R 2.0 QA: Update user guide for new APIs (was: ML 2.0 QA: Update

[jira] [Commented] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263131#comment-15263131 ] Joseph K. Bradley commented on SPARK-14812: --- OK, but I really hope we can avoid behavior

[jira] [Updated] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14812: -- Summary: ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit (was:

[jira] [Commented] (SPARK-14936) FlumePollingStreamSuite is slow

[ https://issues.apache.org/jira/browse/SPARK-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263129#comment-15263129 ] Xin Ren commented on SPARK-14936: - I'm trying to fix this one now :) > FlumePollingStreamSuite is slow >

[jira] [Updated] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14812: -- Description: We should make a pass through the items marked as Experimental or

[jira] [Updated] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14812: -- Component/s: GraphX > ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed

[jira] [Assigned] (SPARK-14990) nvl, coalesce, array functions with parameter of type "array"

[ https://issues.apache.org/jira/browse/SPARK-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14990: Assignee: Apache Spark > nvl, coalesce, array functions with parameter of type "array" >

[jira] [Assigned] (SPARK-14990) nvl, coalesce, array functions with parameter of type "array"

[ https://issues.apache.org/jira/browse/SPARK-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14990: Assignee: (was: Apache Spark) > nvl, coalesce, array functions with parameter of type

[jira] [Commented] (SPARK-14990) nvl, coalesce, array functions with parameter of type "array"

[ https://issues.apache.org/jira/browse/SPARK-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263127#comment-15263127 ] Apache Spark commented on SPARK-14990: -- User 'dosoft' has created a pull request for this issue:

[jira] [Created] (SPARK-14990) nvl, coalesce, array functions with parameter of type "array"

Oleg Danilov created SPARK-14990: Summary: nvl, coalesce, array functions with parameter of type "array" Key: SPARK-14990 URL: https://issues.apache.org/jira/browse/SPARK-14990 Project: Spark

[jira] [Updated] (SPARK-14811) ML, Graph 2.0 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14811: -- Description: Audit new public Scala APIs added to MLlib & GraphX. Take note of: *

[jira] [Updated] (SPARK-14811) ML, Graph 2.0 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14811: -- Component/s: GraphX > ML, Graph 2.0 QA: API: New Scala APIs, docs >

[jira] [Updated] (SPARK-14810) ML, Graph 2.0 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14810: -- Summary: ML, Graph 2.0 QA: API: Binary incompatible changes (was: ML-Graph-R 2.0 QA:

[jira] [Updated] (SPARK-14811) ML, Graph 2.0 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14811: -- Summary: ML, Graph 2.0 QA: API: New Scala APIs, docs (was: ML 2.0 QA: API: New Scala

[jira] [Updated] (SPARK-14810) ML-Graph-R 2.0 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14810: -- Summary: ML-Graph-R 2.0 QA: API: Binary incompatible changes (was: ML 2.0 QA: API:

[jira] [Updated] (SPARK-14810) ML, Graph 2.0 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14810: -- Component/s: GraphX > ML, Graph 2.0 QA: API: Binary incompatible changes >

[jira] [Updated] (SPARK-14809) Examples: Check for new APIs requiring example code in 2.0

[ https://issues.apache.org/jira/browse/SPARK-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14809: -- Description: Audit list of new features added to MLlib, GraphX & SparkR, and see which

[jira] [Updated] (SPARK-14809) Examples: Check for new APIs requiring example code in 2.0

[ https://issues.apache.org/jira/browse/SPARK-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14809: -- Component/s: SparkR GraphX > Examples: Check for new APIs requiring

[jira] [Updated] (SPARK-14808) Spark MLlib, GraphX, SparkR 2.0 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14808: -- Description: This JIRA lists tasks for the next Spark release's QA period for MLlib,

[jira] [Updated] (SPARK-14808) Spark MLlib, GraphX, SparkR 2.0 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14808: -- Component/s: SparkR GraphX > Spark MLlib, GraphX, SparkR 2.0 QA

[jira] [Updated] (SPARK-14808) Spark MLlib, GraphX, SparkR 2.0 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14808: -- Summary: Spark MLlib, GraphX, SparkR 2.0 QA umbrella (was: Spark MLlib 2.0 QA

[jira] [Created] (SPARK-14989) Upgrade to Jackson 2.7.3

Josh Rosen created SPARK-14989: -- Summary: Upgrade to Jackson 2.7.3 Key: SPARK-14989 URL: https://issues.apache.org/jira/browse/SPARK-14989 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14978) PySpark TrainValidationSplitModel should support validationMetrics

[ https://issues.apache.org/jira/browse/SPARK-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14978: Assignee: (was: Apache Spark) > PySpark TrainValidationSplitModel should support

[jira] [Commented] (SPARK-14978) PySpark TrainValidationSplitModel should support validationMetrics

[ https://issues.apache.org/jira/browse/SPARK-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263069#comment-15263069 ] Apache Spark commented on SPARK-14978: -- User 'taku-k' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14978) PySpark TrainValidationSplitModel should support validationMetrics

[ https://issues.apache.org/jira/browse/SPARK-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14978: Assignee: Apache Spark > PySpark TrainValidationSplitModel should support

[jira] [Assigned] (SPARK-14989) Upgrade to Jackson 2.7.3

[ https://issues.apache.org/jira/browse/SPARK-14989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14989: Assignee: Josh Rosen (was: Apache Spark) > Upgrade to Jackson 2.7.3 >

[jira] [Assigned] (SPARK-14989) Upgrade to Jackson 2.7.3

[ https://issues.apache.org/jira/browse/SPARK-14989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14989: Assignee: Apache Spark (was: Josh Rosen) > Upgrade to Jackson 2.7.3 >

[jira] [Commented] (SPARK-14989) Upgrade to Jackson 2.7.3

[ https://issues.apache.org/jira/browse/SPARK-14989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263062#comment-15263062 ] Apache Spark commented on SPARK-14989: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-7898) pyspark merges stderr into stdout

[ https://issues.apache.org/jira/browse/SPARK-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263059#comment-15263059 ] Sean Owen commented on SPARK-7898: -- Ok, we are talking about the driver. You want to write something to

[jira] [Commented] (SPARK-9288) Improve test speed

[ https://issues.apache.org/jira/browse/SPARK-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263046#comment-15263046 ] Josh Rosen commented on SPARK-9288: --- To help make it easy to identify slow tests, there's now a report

[jira] [Commented] (SPARK-7898) pyspark merges stderr into stdout

[ https://issues.apache.org/jira/browse/SPARK-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263048#comment-15263048 ] Sam Steingold commented on SPARK-7898: -- [~srowen]: First, `RDD.pipe()` is neither here nor there.

[jira] [Resolved] (SPARK-12810) PySpark CrossValidatorModel should support avgMetrics

[ https://issues.apache.org/jira/browse/SPARK-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12810. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12464

[jira] [Assigned] (SPARK-14988) Implement catalog and conf API in Python SparkSession

[ https://issues.apache.org/jira/browse/SPARK-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14988: Assignee: Andrew Or (was: Apache Spark) > Implement catalog and conf API in Python

[jira] [Commented] (SPARK-14988) Implement catalog and conf API in Python SparkSession

[ https://issues.apache.org/jira/browse/SPARK-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263004#comment-15263004 ] Apache Spark commented on SPARK-14988: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14988) Implement catalog and conf API in Python SparkSession

[ https://issues.apache.org/jira/browse/SPARK-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14988: Assignee: Apache Spark (was: Andrew Or) > Implement catalog and conf API in Python

  1   2   3   >