[jira] [Commented] (SPARK-16456) Reuse the uncorrelated scalar subqueries with the same logical plan in a query

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368926#comment-15368926 ] Apache Spark commented on SPARK-16456: -- User 'lianhuiwang' has created a pull request for this

[jira] [Assigned] (SPARK-16456) Reuse the uncorrelated scalar subqueries with the same logical plan in a query

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16456: Assignee: Apache Spark > Reuse the uncorrelated scalar subqueries with the same logical

[jira] [Assigned] (SPARK-16456) Reuse the uncorrelated scalar subqueries with the same logical plan in a query

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16456: Assignee: (was: Apache Spark) > Reuse the uncorrelated scalar subqueries with the

[jira] [Assigned] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-16446: --- Assignee: Yanbo Liang > Gaussian Mixture Model wrapper in SparkR >

[jira] [Commented] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368916#comment-15368916 ] Yanbo Liang commented on SPARK-16446: - Sure. > Gaussian Mixture Model wrapper in SparkR >

[jira] [Updated] (SPARK-16456) Reuse the uncorrelated scalar subqueries with the same logical plan in a query

2016-07-08 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-16456: - Summary: Reuse the uncorrelated scalar subqueries with the same logical plan in a query (was:

[jira] [Updated] (SPARK-16456) Reuse the uncorrelated scalar subqueries with the same logical plan in a query

2016-07-08 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-16456: - Description: In TPCDS Q14, the same physical plan of uncorrelated scalar subqueries from a CTE

[jira] [Resolved] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11857. - Resolution: Fixed Assignee: Michael Gummelt (was: Reynold Xin) Fix Version/s:

[jira] [Resolved] (SPARK-16432) Empty blocks fail to serialize due to assert in ChunkedByteBuffer

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16432. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.0.0 > Empty blocks fail

[jira] [Resolved] (SPARK-16376) [Spark web UI]:HTTP ERROR 500 when using rest api "/applications/[app-id]/jobs" if array "stageIds" is empty

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16376. - Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 > [Spark web UI]:HTTP

[jira] [Resolved] (SPARK-13569) Kafka DStreams from wildcard topic filters

2016-07-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-13569. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14026

[jira] [Updated] (SPARK-16455) Add a new hook in CoarseGrainedSchedulerBackend in order to stop scheduling new tasks when cluster is restarting

2016-07-08 Thread YangyangLiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangyangLiu updated SPARK-16455: Description: In our case, we are implementing a new mechanism which will let driver survive when

[jira] [Assigned] (SPARK-16455) Add a new hook in makeOffers in CoarseGrainedSchedulerBackend

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16455: Assignee: Apache Spark > Add a new hook in makeOffers in CoarseGrainedSchedulerBackend >

[jira] [Assigned] (SPARK-16455) Add a new hook in makeOffers in CoarseGrainedSchedulerBackend

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16455: Assignee: (was: Apache Spark) > Add a new hook in makeOffers in

[jira] [Commented] (SPARK-16455) Add a new hook in makeOffers in CoarseGrainedSchedulerBackend

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368744#comment-15368744 ] Apache Spark commented on SPARK-16455: -- User 'lovexi' has created a pull request for this issue:

[jira] [Updated] (SPARK-16455) Add a new hook in makeOffers in CoarseGrainedSchedulerBackend

2016-07-08 Thread YangyangLiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangyangLiu updated SPARK-16455: Description: In our case, we are implementing restartable resource manager mechanism which will

[jira] [Updated] (SPARK-16455) Add a new hook in makeOffers in CoarseGrainedSchedulerBackend

2016-07-08 Thread YangyangLiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangyangLiu updated SPARK-16455: Labels: (was: newbie) > Add a new hook in makeOffers in CoarseGrainedSchedulerBackend >

[jira] [Updated] (SPARK-16424) Add support for Structured Streaming to the ML Pipeline API

2016-07-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-16424: Description: For Spark 2.1 we should consider adding support for machine learning on top of the

[jira] [Created] (SPARK-16454) Consider adding a per-batch transform for structured streaming

2016-07-08 Thread holdenk (JIRA)
holdenk created SPARK-16454: --- Summary: Consider adding a per-batch transform for structured streaming Key: SPARK-16454 URL: https://issues.apache.org/jira/browse/SPARK-16454 Project: Spark Issue

[jira] [Resolved] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16387. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > Reserved SQL

[jira] [Assigned] (SPARK-16404) LeastSquaresAggregator in Linear Regression serializes unnecessary data

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16404: Assignee: Apache Spark > LeastSquaresAggregator in Linear Regression serializes

[jira] [Assigned] (SPARK-16404) LeastSquaresAggregator in Linear Regression serializes unnecessary data

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16404: Assignee: (was: Apache Spark) > LeastSquaresAggregator in Linear Regression

[jira] [Commented] (SPARK-16404) LeastSquaresAggregator in Linear Regression serializes unnecessary data

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368652#comment-15368652 ] Apache Spark commented on SPARK-16404: -- User 'sethah' has created a pull request for this issue:

[jira] [Resolved] (SPARK-16453) release script does not publish spark-hive-thriftserver_2.10

2016-07-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16453. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Commented] (SPARK-16365) Ideas for moving "mllib-local" forward

2016-07-08 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368602#comment-15368602 ] Manoj Kumar commented on SPARK-16365: - Could you be a bit more clearer about the first point? Is it

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-07-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368594#comment-15368594 ] Shivaram Venkataraman commented on SPARK-15767: --- Sorry I missed this thread. I agree with

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368552#comment-15368552 ] Dongjoon Hyun commented on SPARK-16452: --- I see. Thanks. > basic INFORMATION_SCHEMA support >

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368550#comment-15368550 ] Reynold Xin commented on SPARK-16452: - org.apache.spark.sql.execution.systemcatalog ? Something like

[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368548#comment-15368548 ] Xin Ren commented on SPARK-16437: - It's SQL's problem I think, I'll remove the SparkR tag > SparkR

[jira] [Updated] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16437: Component/s: (was: SparkR) > SparkR read.df() from parquet got error: SLF4J: Failed to load class >

[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368546#comment-15368546 ] Shivaram Venkataraman commented on SPARK-16437: --- FWIW this also happens with Scala (i.e.

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368547#comment-15368547 ] Xiangrui Meng commented on SPARK-15767: --- This was discussed in SPARK-14831. We should call it

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368544#comment-15368544 ] Dongjoon Hyun commented on SPARK-16452: --- What package name do you prefer? > basic

[jira] [Issue Comment Deleted] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16452: -- Comment: was deleted (was: Is this the same or overlapped issue with

[jira] [Resolved] (SPARK-16281) Implement parse_url SQL function

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16281. - Resolution: Fixed Assignee: Jian Wu Fix Version/s: 2.0.1 > Implement parse_url

[jira] [Resolved] (SPARK-16429) Include `StringType` columns in `describe()`

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16429. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > Include

[jira] [Commented] (SPARK-16453) release script does not publish spark-hive-thriftserver_2.10

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368523#comment-15368523 ] Apache Spark commented on SPARK-16453: -- User 'yhuai' has created a pull request for this issue:

[jira] [Created] (SPARK-16453) release script does not publish spark-hive-thriftserver_2.10

2016-07-08 Thread Yin Huai (JIRA)
Yin Huai created SPARK-16453: Summary: release script does not publish spark-hive-thriftserver_2.10 Key: SPARK-16453 URL: https://issues.apache.org/jira/browse/SPARK-16453 Project: Spark Issue

[jira] [Updated] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16437: Description: build SparkR with command {code} build/mvn -DskipTests -Psparkr package {code} start SparkR

[jira] [Closed] (SPARK-16201) Expose information schema

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16201. --- Resolution: Duplicate > Expose information schema > - > >

[jira] [Updated] (SPARK-15630) 2.0 python coverage ml root module

2016-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15630: -- Target Version/s: 2.0.0 Priority: Blocker (was: Major) > 2.0 python coverage ml root

[jira] [Updated] (SPARK-15623) 2.0 python coverage ml.feature

2016-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15623: -- Target Version/s: 2.0.0 Priority: Blocker (was: Major) > 2.0 python coverage ml.feature >

[jira] [Updated] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14813: -- Target Version/s: 2.0.0 Priority: Blocker (was: Major) > ML 2.0 QA: API: Python API

[jira] [Updated] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16437: -- Fix Version/s: (was: 2.0.0) > SparkR read.df() from parquet got error: SLF4J: Failed to load class

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368504#comment-15368504 ] Dongjoon Hyun commented on SPARK-16452: --- Is this the same or overlapped issue with

[jira] [Updated] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16437: Description: build SparkR with command {code} build/mvn -DskipTests -Psparkr package {code} start SparkR

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368497#comment-15368497 ] Reynold Xin commented on SPARK-16452: - Thanks - feel free to break this down into multiple pieces.

[jira] [Commented] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368494#comment-15368494 ] Dongjoon Hyun commented on SPARK-16452: --- Sure! > basic INFORMATION_SCHEMA support >

[jira] [Comment Edited] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368486#comment-15368486 ] Reynold Xin edited comment on SPARK-16452 at 7/8/16 9:12 PM: - cc [~dongjoon]

[jira] [Created] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-16452: --- Summary: basic INFORMATION_SCHEMA support Key: SPARK-16452 URL: https://issues.apache.org/jira/browse/SPARK-16452 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-16452) basic INFORMATION_SCHEMA support

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16452: Attachment: INFORMATION_SCHEMAsupport.pdf design spec > basic INFORMATION_SCHEMA support >

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368482#comment-15368482 ] Apache Spark commented on SPARK-16387: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16387: Assignee: (was: Apache Spark) > Reserved SQL words are not escaped by JDBC writer >

[jira] [Commented] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368479#comment-15368479 ] Xin Ren commented on SPARK-16445: - Hi Xiangrui, may I have a try on this one? Is there a strict deadline

[jira] [Closed] (SPARK-10292) make metadata query-able by adding meta table

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-10292. --- Resolution: Later > make metadata query-able by adding meta table >

[jira] [Created] (SPARK-16451) Spark-shell / pyspark should finish gracefully when "SaslException: GSS initiate failed" is hit

2016-07-08 Thread Yesha Vora (JIRA)
Yesha Vora created SPARK-16451: -- Summary: Spark-shell / pyspark should finish gracefully when "SaslException: GSS initiate failed" is hit Key: SPARK-16451 URL: https://issues.apache.org/jira/browse/SPARK-16451

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368458#comment-15368458 ] Dongjoon Hyun commented on SPARK-16387: --- You're right. I'll make a PR for this. > Reserved SQL

[jira] [Issue Comment Deleted] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16387: -- Comment: was deleted (was: Oh, it means Pull Request. Since you know `JdbcDialect` class, I

[jira] [Issue Comment Deleted] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16387: -- Comment: was deleted (was: Hi, `escaping` sounds possible, but it is not an easy issue to

[jira] [Issue Comment Deleted] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16387: -- Comment: was deleted (was: Then, could you make a PR for this?) > Reserved SQL words are not

[jira] [Updated] (SPARK-13346) Using DataFrames iteratively leads to slow query planning

2016-07-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13346: -- Summary: Using DataFrames iteratively leads to slow query planning (was: Using

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

2016-07-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368320#comment-15368320 ] holdenk commented on SPARK-15581: - Yah - the more I look at it the more rough it seems - [~tdas] has it

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

2016-07-08 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368318#comment-15368318 ] Nick Pentreath commented on SPARK-15581: I think it would be a pretty interesting to explore a

[jira] [Commented] (SPARK-16365) Ideas for moving "mllib-local" forward

2016-07-08 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368310#comment-15368310 ] Nick Pentreath commented on SPARK-16365: Good question - and part of the reason for getting

[jira] [Resolved] (SPARK-16420) UnsafeShuffleWriter leaks compression streams with off-heap memory.

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16420. - Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 2.0.0 > UnsafeShuffleWriter

[jira] [Issue Comment Deleted] (SPARK-16450) Build failes for Mesos 0.28.x

2016-07-08 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16450: - Comment: was deleted (was: Spark 1.6.1 was working with Mesos 0.28.0) > Build failes for Mesos

[jira] [Commented] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368249#comment-15368249 ] Dongjoon Hyun commented on SPARK-16449: --- SPARK-16173 resolved that kind of issue. > unionAll

[jira] [Issue Comment Deleted] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16449: -- Comment: was deleted (was: Oh, I see.) > unionAll raises "Task not serializable" >

[jira] [Commented] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368245#comment-15368245 ] Dongjoon Hyun commented on SPARK-16449: --- It seems you are using the result of `describe` at the

[jira] [Commented] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368232#comment-15368232 ] Dongjoon Hyun commented on SPARK-16449: --- Oh, I see. > unionAll raises "Task not serializable" >

[jira] [Commented] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368231#comment-15368231 ] Dongjoon Hyun commented on SPARK-16449: --- Unfortunately, I cannot test the notebook due to the given

[jira] [Commented] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Jeff Levy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368226#comment-15368226 ] Jeff Levy commented on SPARK-16449: --- The problem doesn't appear to be with `describe` here. If I leave

[jira] [Commented] (SPARK-3728) RandomForest: Learn models too large to store in memory

2016-07-08 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368216#comment-15368216 ] Manoj Kumar commented on SPARK-3728: Hi [~xusen]. Are you still working on this? > RandomForest:

[jira] [Comment Edited] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368204#comment-15368204 ] Dongjoon Hyun edited comment on SPARK-16449 at 7/8/16 7:03 PM: --- In that

[jira] [Commented] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368204#comment-15368204 ] Dongjoon Hyun commented on SPARK-16449: --- In that issue, the root cause was `describe` itself. >

[jira] [Commented] (SPARK-16450) Build failes for Mesos 0.28.x

2016-07-08 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368199#comment-15368199 ] Niels Becker commented on SPARK-16450: -- Spark 1.6.1 was working with Mesos 0.28.0 > Build failes

[jira] [Commented] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368201#comment-15368201 ] Dongjoon Hyun commented on SPARK-16449: --- Could you try this in master? It seems to be similar with

[jira] [Resolved] (SPARK-13638) Support for saving with a quote mode

2016-07-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13638. - Resolution: Fixed Assignee: Jurriaan Pruis Fix Version/s: 2.0.1 > Support for

[jira] [Commented] (SPARK-16447) LDA wrapper in SparkR

2016-07-08 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368149#comment-15368149 ] Xusen Yin commented on SPARK-16447: --- [~mengxr] I'd like to work on this. > LDA wrapper in SparkR >

[jira] [Commented] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368143#comment-15368143 ] Sean Owen commented on SPARK-16449: --- Interesting. Looks like something is serializing a Scala Iterator

[jira] [Commented] (SPARK-16450) Build failes for Mesos 0.28.x

2016-07-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368138#comment-15368138 ] Sean Owen commented on SPARK-16450: --- I don't think this version of Mesos is supported; it sounds like

[jira] [Created] (SPARK-16450) Build failes for Mesos 0.28.x

2016-07-08 Thread Niels Becker (JIRA)
Niels Becker created SPARK-16450: Summary: Build failes for Mesos 0.28.x Key: SPARK-16450 URL: https://issues.apache.org/jira/browse/SPARK-16450 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Jeff Levy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Levy updated SPARK-16449: -- Description: Goal: Take the output from `describe` on a large DataFrame, then use a loop to calculate

[jira] [Updated] (SPARK-16409) regexp_extract with optional groups causes NPE

2016-07-08 Thread Max Moroz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Moroz updated SPARK-16409: -- Description: df = sqlContext.createDataFrame([['c']], ['s']) df.select(F.regexp_extract('s',

[jira] [Comment Edited] (SPARK-16439) Incorrect information in SQL Query details

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368056#comment-15368056 ] Dongjoon Hyun edited comment on SPARK-16439 at 7/8/16 5:50 PM: --- For me, it

[jira] [Commented] (SPARK-16409) regexp_extract with optional groups causes NPE

2016-07-08 Thread Max Moroz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368059#comment-15368059 ] Max Moroz commented on SPARK-16409: --- [~srowen] So sorry I was sure I copied the entire code. I'm gonna

[jira] [Commented] (SPARK-16439) Incorrect information in SQL Query details

2016-07-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368056#comment-15368056 ] Dongjoon Hyun commented on SPARK-16439: --- For me, it works.

[jira] [Updated] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Jeff Levy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Levy updated SPARK-16449: -- Description: Goal: Take the output from `describe` on a large DataFrame, then use a loop to calculate

[jira] [Commented] (SPARK-16444) Isotonic Regression wrapper in SparkR

2016-07-08 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368044#comment-15368044 ] Miao Wang commented on SPARK-16444: --- [~mengxr] Sure! I am done enough documents and examples last a

[jira] [Created] (SPARK-16449) unionAll raises "Task not serializable"

2016-07-08 Thread Jeff Levy (JIRA)
Jeff Levy created SPARK-16449: - Summary: unionAll raises "Task not serializable" Key: SPARK-16449 URL: https://issues.apache.org/jira/browse/SPARK-16449 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-07-08 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367997#comment-15367997 ] Kai Jiang commented on SPARK-15767: --- [~mengxr] Would you mind to give some comments on how to design

[jira] [Commented] (SPARK-15779) SQL context fails when Hive uses Tez as its default execution engine

2016-07-08 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367977#comment-15367977 ] Jonathan Kelly commented on SPARK-15779: Is there a well-defined list of properties we should

[jira] [Commented] (SPARK-15804) Manually added metadata not saving with parquet

2016-07-08 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367974#comment-15367974 ] Wenchen Fan commented on SPARK-15804: - this will be fixed by

[jira] [Commented] (SPARK-16448) RemoveAliasOnlyProject should not remove alias with metadata

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367972#comment-15367972 ] Apache Spark commented on SPARK-16448: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16448) RemoveAliasOnlyProject should not remove alias with metadata

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16448: Assignee: Apache Spark (was: Wenchen Fan) > RemoveAliasOnlyProject should not remove

[jira] [Assigned] (SPARK-16448) RemoveAliasOnlyProject should not remove alias with metadata

2016-07-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16448: Assignee: Wenchen Fan (was: Apache Spark) > RemoveAliasOnlyProject should not remove

[jira] [Created] (SPARK-16448) RemoveAliasOnlyProject should not remove alias with metadata

2016-07-08 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-16448: --- Summary: RemoveAliasOnlyProject should not remove alias with metadata Key: SPARK-16448 URL: https://issues.apache.org/jira/browse/SPARK-16448 Project: Spark

[jira] [Commented] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367937#comment-15367937 ] Xiangrui Meng commented on SPARK-16446: --- [~yanboliang] Do you have time to work on this? >

[jira] [Created] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16446: - Summary: Gaussian Mixture Model wrapper in SparkR Key: SPARK-16446 URL: https://issues.apache.org/jira/browse/SPARK-16446 Project: Spark Issue Type:

[jira] [Created] (SPARK-16447) LDA wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16447: - Summary: LDA wrapper in SparkR Key: SPARK-16447 URL: https://issues.apache.org/jira/browse/SPARK-16447 Project: Spark Issue Type: Sub-task

  1   2   >