[jira] [Commented] (SPARK-14529) Consolidate mllib and mllib-local into one mllib folder

2016-05-24 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299511#comment-15299511 ] Xiangrui Meng commented on SPARK-14529: --- We should decide whether we want to make this change in

[jira] [Comment Edited] (SPARK-15521) Add high level APIs based on dapply and gapply for easier usage

2016-05-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299483#comment-15299483 ] Sun Rui edited comment on SPARK-15521 at 5/25/16 5:30 AM: -- cc [~felixcheung],

[jira] [Commented] (SPARK-15449) Wrong Data Format - Documentation Issue

2016-05-24 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299484#comment-15299484 ] Miao Wang commented on SPARK-15449: --- Got it. I will submit PR soon after fixing the R unit tests

[jira] [Commented] (SPARK-15521) Add high level APIs based on dapply and gapply for easier usage

2016-05-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299483#comment-15299483 ] Sun Rui commented on SPARK-15521: - cc [~felixcheung] > Add high level APIs based on dapply and gapply

[jira] [Created] (SPARK-15521) Add high level APIs based on dapply and gapply for easier usage

2016-05-24 Thread Sun Rui (JIRA)
Sun Rui created SPARK-15521: --- Summary: Add high level APIs based on dapply and gapply for easier usage Key: SPARK-15521 URL: https://issues.apache.org/jira/browse/SPARK-15521 Project: Spark Issue

[jira] [Resolved] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2016-05-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12071. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-15412) Improve linear & isotonic regression methods PyDocs

2016-05-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15412. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Closed] (SPARK-10053) SparkR isn't exporting lapply

2016-05-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-10053. --- Resolution: Won't Fix > SparkR isn't exporting lapply > - > >

[jira] [Commented] (SPARK-10053) SparkR isn't exporting lapply

2016-05-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299475#comment-15299475 ] Sun Rui commented on SPARK-10053: - as SparkDataFrame has supported dapply() similar to lapplyPartition,

[jira] [Closed] (SPARK-15196) Add a wrapper for dapply(repartition(col,...), ... )

2016-05-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-15196. --- Resolution: Not A Problem > Add a wrapper for dapply(repartition(col,...), ... ) >

[jira] [Commented] (SPARK-15196) Add a wrapper for dapply(repartition(col,...), ... )

2016-05-24 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299473#comment-15299473 ] Sun Rui commented on SPARK-15196: - As discussed in https://github.com/apache/spark/pull/12966, this has

[jira] [Resolved] (SPARK-15508) Fix flaky test: o.a.s.streaming.kafka.JavaKafkaStreamSuite.testKafkaStream

2016-05-24 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15508. -- Resolution: Fixed Fix Version/s: 2.0.0 > Fix flaky test:

[jira] [Resolved] (SPARK-15498) fix slow tests

2016-05-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-15498. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13273

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299432#comment-15299432 ] Felix Cheung commented on SPARK-15439: -- Possibly with R version or package versions. Can you check

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

2016-05-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299426#comment-15299426 ] Takeshi Yamamuro commented on SPARK-14083: -- To check the feasibility to support other types

[jira] [Resolved] (SPARK-15365) Metastore relation should fallback to HDFS size if statistics are not available from table meta data.

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15365. - Resolution: Fixed Assignee: Parth Brahmbhatt Fix Version/s: 2.0.0 > Metastore

[jira] [Resolved] (SPARK-15518) Rename various scheduler backend for consistency

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15518. - Resolution: Fixed Fix Version/s: 2.0.0 > Rename various scheduler backend for consistency

[jira] [Updated] (SPARK-14955) JDBCRelation should report an IllegalArgumentException if stride equals 0

2016-05-24 Thread Yang Juan hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Juan hu updated SPARK-14955: - Affects Version/s: 2.0.0 > JDBCRelation should report an IllegalArgumentException if stride

[jira] [Updated] (SPARK-14321) Reduce date format cost in date functions

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14321: Target Version/s: 2.0.0 > Reduce date format cost in date functions >

[jira] [Updated] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15345: Affects Version/s: (was: 2.0.0) Target Version/s: 2.0.0 > SparkSession's conf doesn't

[jira] [Updated] (SPARK-14400) ScriptTransformation does not fail the job for bad user command

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14400: Assignee: Tejas Patil > ScriptTransformation does not fail the job for bad user command >

[jira] [Updated] (SPARK-14400) ScriptTransformation does not fail the job for bad user command

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14400: Target Version/s: 2.0.0 > ScriptTransformation does not fail the job for bad user command >

[jira] [Updated] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15520: Issue Type: Sub-task (was: Bug) Parent: SPARK-13485 > SparkSession builder in python

[jira] [Updated] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15520: Target Version/s: 2.0.0 > SparkSession builder in python should also allow overriding confs of

[jira] [Resolved] (SPARK-15512) repartition(0) should raise IllegalArgumentException.

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15512. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > repartition(0)

[jira] [Updated] (SPARK-13484) Filter outer joined result using a non-nullable column from the right table

2016-05-24 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13484: - Target Version/s: 2.0.0 > Filter outer joined result using a non-nullable column from the right table >

[jira] [Assigned] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15520: Assignee: Apache Spark > SparkSession builder in python should also allow overriding

[jira] [Assigned] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15520: Assignee: (was: Apache Spark) > SparkSession builder in python should also allow

[jira] [Commented] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299286#comment-15299286 ] Apache Spark commented on SPARK-15520: -- User 'ericl' has created a pull request for this issue:

[jira] [Commented] (SPARK-10592) deprecate weights and use coefficients instead in ML models

2016-05-24 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299283#comment-15299283 ] Kai Jiang commented on SPARK-10592: --- This is answered on corresponding Github PR. > deprecate weights

[jira] [Created] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-24 Thread Eric Liang (JIRA)
Eric Liang created SPARK-15520: -- Summary: SparkSession builder in python should also allow overriding confs of existing sessions Key: SPARK-15520 URL: https://issues.apache.org/jira/browse/SPARK-15520

[jira] [Updated] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-24 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-15520: --- Component/s: SQL > SparkSession builder in python should also allow overriding confs of existing >

[jira] [Updated] (SPARK-15518) Rename various scheduler backend for consistency

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15518: Description: Various scheduler backends are not named consistently, making it difficult to

[jira] [Updated] (SPARK-15518) Rename various scheduler backend for consistency

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15518: Summary: Rename various scheduler backend for consistency (was: Make various scheduler backend

[jira] [Assigned] (SPARK-15518) Make various scheduler backend class names consistent

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15518: Assignee: Apache Spark (was: Reynold Xin) > Make various scheduler backend class names

[jira] [Assigned] (SPARK-15518) Make various scheduler backend class names consistent

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15518: Assignee: Reynold Xin (was: Apache Spark) > Make various scheduler backend class names

[jira] [Commented] (SPARK-15518) Make various scheduler backend class names consistent

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299273#comment-15299273 ] Apache Spark commented on SPARK-15518: -- User 'rxin' has created a pull request for this issue:

[jira] [Updated] (SPARK-15518) Make various scheduler backend class names consistent

2016-05-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15518: Summary: Make various scheduler backend class names consistent (was: Rename

[jira] [Comment Edited] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems

2016-05-24 Thread Niko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299232#comment-15299232 ] Niko edited comment on SPARK-4820 at 5/25/16 1:00 AM: -- Yep, still an issue. I'm using

[jira] [Comment Edited] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems

2016-05-24 Thread Niko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299232#comment-15299232 ] Niko edited comment on SPARK-4820 at 5/25/16 12:45 AM: --- Yep, still an issue. I'm

[jira] [Comment Edited] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems

2016-05-24 Thread Niko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299232#comment-15299232 ] Niko edited comment on SPARK-4820 at 5/25/16 12:40 AM: --- Yep, still an issue. I'm

[jira] [Commented] (SPARK-15519) Shuffle Service fails to start if first yarn.nodemanager.local-dirs is bad

2016-05-24 Thread Matthew Sharp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299234#comment-15299234 ] Matthew Sharp commented on SPARK-15519: --- I misclicked and resolved as Fixed instead of as

[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems

2016-05-24 Thread Niko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299232#comment-15299232 ] Niko commented on SPARK-4820: - Yep, still an issue. I'm using Ubuntu 15.10 and building from scratch. > Spark

[jira] [Assigned] (SPARK-15491) JSON serialization fails for JDBC DataFrames

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15491: Assignee: (was: Apache Spark) > JSON serialization fails for JDBC DataFrames >

[jira] [Assigned] (SPARK-15491) JSON serialization fails for JDBC DataFrames

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15491: Assignee: Apache Spark > JSON serialization fails for JDBC DataFrames >

[jira] [Commented] (SPARK-15491) JSON serialization fails for JDBC DataFrames

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299228#comment-15299228 ] Apache Spark commented on SPARK-15491: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Resolved] (SPARK-15519) Shuffle Service fails to start if first yarn.nodemanager.local-dirs is bad

2016-05-24 Thread Matthew Sharp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Sharp resolved SPARK-15519. --- Resolution: Fixed Agreed, closing as dupe. > Shuffle Service fails to start if first

[jira] [Commented] (SPARK-15519) Shuffle Service fails to start if first yarn.nodemanager.local-dirs is bad

2016-05-24 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299204#comment-15299204 ] Marcelo Vanzin commented on SPARK-15519: Looks like this is the same, or at least related, to

[jira] [Updated] (SPARK-15519) Shuffle Service fails to start if first yarn.nodemanager.local-dirs is bad

2016-05-24 Thread Matthew Sharp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Sharp updated SPARK-15519: -- Description: {{yarn.nodemanager.local-dirs}} is set to

[jira] [Created] (SPARK-15519) Shuffle Service fails to start if first yarn.nodemanager.local-dirs is bad

2016-05-24 Thread Matthew Sharp (JIRA)
Matthew Sharp created SPARK-15519: - Summary: Shuffle Service fails to start if first yarn.nodemanager.local-dirs is bad Key: SPARK-15519 URL: https://issues.apache.org/jira/browse/SPARK-15519

[jira] [Commented] (SPARK-10592) deprecate weights and use coefficients instead in ML models

2016-05-24 Thread Bharath Venkatesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299190#comment-15299190 ] Bharath Venkatesh commented on SPARK-10592: --- Hi Kai I am trying to build a learning model in

[jira] [Commented] (SPARK-15014) Spark Shell could use Ammonite Shell

2016-05-24 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299168#comment-15299168 ] Jakob Odersky commented on SPARK-15014: --- You might still have some issues with classloaders, I

[jira] [Commented] (SPARK-15463) Support for creating a dataframe from CSV in RDD[String]

2016-05-24 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299167#comment-15299167 ] Xin Wu commented on SPARK-15463: I am looking into this. > Support for creating a dataframe from CSV in

[jira] [Created] (SPARK-15518) Rename SparkDeploySchedulerBackend to StandaloneSchedulerBackend

2016-05-24 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15518: --- Summary: Rename SparkDeploySchedulerBackend to StandaloneSchedulerBackend Key: SPARK-15518 URL: https://issues.apache.org/jira/browse/SPARK-15518 Project: Spark

[jira] [Comment Edited] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299143#comment-15299143 ] Miao Wang edited comment on SPARK-15439 at 5/24/16 11:31 PM: - [~felixcheung]

[jira] [Commented] (SPARK-15449) Wrong Data Format - Documentation Issue

2016-05-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299145#comment-15299145 ] Sean Owen commented on SPARK-15449: --- I don't have the code in front of me, but I think only the 2.0

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299143#comment-15299143 ] Miao Wang commented on SPARK-15439: --- [~felixcheung] For the test case below: test_that("Check masked

[jira] [Resolved] (SPARK-15014) Spark Shell could use Ammonite Shell

2016-05-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15014. --- Resolution: Won't Fix > Spark Shell could use Ammonite Shell >

[jira] [Resolved] (SPARK-15475) Add tests for writing and reading back empty data for Parquet, Json and Text data sources

2016-05-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15475. --- Resolution: Duplicate > Add tests for writing and reading back empty data for Parquet, Json and Text

[jira] [Commented] (SPARK-15014) Spark Shell could use Ammonite Shell

2016-05-24 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299118#comment-15299118 ] Jakob Odersky commented on SPARK-15014: --- spark-shell is a very thin wrapper around the standard

[jira] [Assigned] (SPARK-15517) Add support for complete output mode

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15517: Assignee: Tathagata Das (was: Apache Spark) > Add support for complete output mode >

[jira] [Commented] (SPARK-15517) Add support for complete output mode

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299113#comment-15299113 ] Apache Spark commented on SPARK-15517: -- User 'tdas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15517) Add support for complete output mode

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15517: Assignee: Apache Spark (was: Tathagata Das) > Add support for complete output mode >

[jira] [Created] (SPARK-15517) Add support for complete output mode

2016-05-24 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-15517: - Summary: Add support for complete output mode Key: SPARK-15517 URL: https://issues.apache.org/jira/browse/SPARK-15517 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-05-24 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-15516: -- Summary: Schema merging in driver fails for parquet when merging LongType and IntegerType Key: SPARK-15516 URL: https://issues.apache.org/jira/browse/SPARK-15516

[jira] [Commented] (SPARK-15510) SparkR NaiveBayes should not require label to have NominalAttribute

2016-05-24 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299095#comment-15299095 ] Miao Wang commented on SPARK-15510: --- I will study the code and try to solve it. Thanks! > SparkR

[jira] [Assigned] (SPARK-15515) Error Handling in Running SQL Directly On Files

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15515: Assignee: (was: Apache Spark) > Error Handling in Running SQL Directly On Files >

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299078#comment-15299078 ] Apache Spark commented on SPARK-15439: -- User 'wangmiao1981' has created a pull request for this

[jira] [Assigned] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15439: Assignee: (was: Apache Spark) > Failed to run unit test in SparkR >

[jira] [Assigned] (SPARK-15515) Error Handling in Running SQL Directly On Files

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15515: Assignee: Apache Spark > Error Handling in Running SQL Directly On Files >

[jira] [Assigned] (SPARK-15514) Unable to detect incompatibility libraries for Spark 2.0 in Data Source Resolution

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15514: Assignee: Apache Spark > Unable to detect incompatibility libraries for Spark 2.0 in Data

[jira] [Assigned] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15439: Assignee: Apache Spark > Failed to run unit test in SparkR >

[jira] [Commented] (SPARK-15514) Unable to detect incompatibility libraries for Spark 2.0 in Data Source Resolution

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299079#comment-15299079 ] Apache Spark commented on SPARK-15514: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15514) Unable to detect incompatibility libraries for Spark 2.0 in Data Source Resolution

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15514: Assignee: (was: Apache Spark) > Unable to detect incompatibility libraries for Spark

[jira] [Commented] (SPARK-15515) Error Handling in Running SQL Directly On Files

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299077#comment-15299077 ] Apache Spark commented on SPARK-15515: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-15491) JSON serialization fails for JDBC DataFrames

2016-05-24 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299063#comment-15299063 ] Huaxin Gao commented on SPARK-15491: I will submit a PR soon. Thanks. > JSON serialization fails for

[jira] [Updated] (SPARK-15515) Error Handling in Running SQL Directly On Files

2016-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15515: Description: For ORC source format, we are reporting the strange error message when we did not enable

[jira] [Created] (SPARK-15515) Error Handling in Running SQL Directly On Files

2016-05-24 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15515: --- Summary: Error Handling in Running SQL Directly On Files Key: SPARK-15515 URL: https://issues.apache.org/jira/browse/SPARK-15515 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15512) repartition(0) should raise IllegalArgumentException.

2016-05-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15512: -- Component/s: Spark Core > repartition(0) should raise IllegalArgumentException. >

[jira] [Updated] (SPARK-15514) Unable to detect incompatibility libraries for Spark 2.0 in Data Source Resolution

2016-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15514: Affects Version/s: 2.0.0 > Unable to detect incompatibility libraries for Spark 2.0 in Data Source >

[jira] [Updated] (SPARK-15514) Unable to detect incompatibility libraries for Spark 2.0 in Data Source Resolution

2016-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15514: Component/s: SQL > Unable to detect incompatibility libraries for Spark 2.0 in Data Source > Resolution >

[jira] [Updated] (SPARK-15514) Unable to detect incompatibility libraries for Spark 2.0 in Data Source Resolution

2016-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15514: Summary: Unable to detect incompatibility libraries for Spark 2.0 in Data Source Resolution (was: nable

[jira] [Created] (SPARK-15513) Bzip2Factory in Hadoop 2.7.1 is not thread safe

2016-05-24 Thread Yin Huai (JIRA)
Yin Huai created SPARK-15513: Summary: Bzip2Factory in Hadoop 2.7.1 is not thread safe Key: SPARK-15513 URL: https://issues.apache.org/jira/browse/SPARK-15513 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15514) nable to detect incompatibility libraries for Spark 2.0

2016-05-24 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15514: --- Summary: nable to detect incompatibility libraries for Spark 2.0 Key: SPARK-15514 URL: https://issues.apache.org/jira/browse/SPARK-15514 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299011#comment-15299011 ] Miao Wang commented on SPARK-15439: --- It seems that this one is caused by

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299004#comment-15299004 ] Miao Wang commented on SPARK-15439: --- [~shivaram]I fixed that failure. But I see a new failure in

[jira] [Assigned] (SPARK-15512) repartition(0) should raise IllegalArgumentException.

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15512: Assignee: Apache Spark > repartition(0) should raise IllegalArgumentException. >

[jira] [Assigned] (SPARK-15512) repartition(0) should raise IllegalArgumentException.

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15512: Assignee: (was: Apache Spark) > repartition(0) should raise IllegalArgumentException.

[jira] [Commented] (SPARK-15512) repartition(0) should raise IllegalArgumentException.

2016-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299000#comment-15299000 ] Apache Spark commented on SPARK-15512: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-15512) repartition(0) should raise IllegalArgumentException.

2016-05-24 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-15512: - Summary: repartition(0) should raise IllegalArgumentException. Key: SPARK-15512 URL: https://issues.apache.org/jira/browse/SPARK-15512 Project: Spark

[jira] [Resolved] (SPARK-15458) Disable schema inference for streaming datasets on file streams

2016-05-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-15458. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13238

[jira] [Resolved] (SPARK-15511) Dropping data source table succeeds but throws exception

2016-05-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15511. --- Resolution: Not A Problem Assignee: Andrew Or If you run into this issue again, just delete

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

2016-05-24 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298883#comment-15298883 ] Michael Armbrust commented on SPARK-15489: -- It should run in the same JVM when running in local

[jira] [Updated] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

2016-05-24 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15489: - Target Version/s: 2.0.0 > Dataset kryo encoder fails on

[jira] [Commented] (SPARK-15511) Dropping data source table succeeds but throws exception

2016-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298879#comment-15298879 ] Xiao Li commented on SPARK-15511: - If nobody takes it, I can work on it. : ) > Dropping data source

[jira] [Resolved] (SPARK-14989) Upgrade to Jackson 2.7.3

2016-05-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14989. --- Resolution: Duplicate Assignee: (was: Josh Rosen) This ended up being subsumed by another

[jira] [Resolved] (SPARK-15470) Unify the Configuration Interface in SQLContext

2016-05-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15470. --- Resolution: Won't Fix > Unify the Configuration Interface in SQLContext >

[jira] [Commented] (SPARK-15457) Eliminate MLlib 2.0 build warnings from deprecations

2016-05-24 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298866#comment-15298866 ] Joseph K. Bradley commented on SPARK-15457: --- Thanks, I'll add them to my branch > Eliminate

[jira] [Updated] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-05-24 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14813: -- Description: For new public APIs added to MLlib, we need to check the generated HTML

[jira] [Commented] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-05-24 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298865#comment-15298865 ] Joseph K. Bradley commented on SPARK-14813: --- Thanks a lot! > ML 2.0 QA: API: Python API

  1   2   >