[jira] [Commented] (SPARK-15449) Wrong Data Format - Documentation Issue

2016-05-23 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296854#comment-15296854 ] Miao Wang commented on SPARK-15449: --- [~srowen] Scala example also uses

[jira] [Created] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

2016-05-23 Thread Gurvinder (JIRA)
Gurvinder created SPARK-15487: - Summary: Spark Master UI to reverse proxy Application and Workers UI Key: SPARK-15487 URL: https://issues.apache.org/jira/browse/SPARK-15487 Project: Spark Issue

[jira] [Commented] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

2016-05-23 Thread Doug Balog (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296830#comment-15296830 ] Doug Balog commented on SPARK-15477: Sorry, this isn't a problem after all. I checked the the latest

[jira] [Commented] (SPARK-15368) Spark History Server does not pick up extraClasspath

2016-05-23 Thread Dawson Choong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296818#comment-15296818 ] Dawson Choong commented on SPARK-15368: --- Thank you for the suggestions. [~jerryshao] may I ask if

[jira] [Commented] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

2016-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296817#comment-15296817 ] Sean Owen commented on SPARK-15477: --- The constructor there is, but not the class > HiveContext is

[jira] [Commented] (SPARK-15140) ensure input object of encoder is not null

2016-05-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296805#comment-15296805 ] Michael Armbrust commented on SPARK-15140: -- I don't think you should ever get a null row back.

[jira] [Updated] (SPARK-15397) 'locate' UDF got different result with boundary value case compared to Hive engine

2016-05-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15397: -- Summary: 'locate' UDF got different result with boundary value case compared to Hive engine (was:

[jira] [Updated] (SPARK-15397) 'locate' UDF got different result with boundary value case compared to Hive engine

2016-05-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15397: -- Assignee: Adrian Wang > 'locate' UDF got different result with boundary value case compared to Hive >

[jira] [Resolved] (SPARK-15471) ScalaReflection cleanup

2016-05-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15471. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13250

[jira] [Resolved] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

2016-05-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15477. --- Resolution: Not A Bug > HiveContext is private[hive] and not accessible to users. >

[jira] [Commented] (SPARK-9044) Updated RDD name does not reflect under "Storage" tab

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296740#comment-15296740 ] Apache Spark commented on SPARK-9044: - User 'lgieron' has created a pull request for this issue:

[jira] [Commented] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

2016-05-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296763#comment-15296763 ] Andrew Or commented on SPARK-15477: --- What part of the code makes you think it's private[hive]?

[jira] [Commented] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

2016-05-23 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296743#comment-15296743 ] Kazuaki Ishizaki commented on SPARK-15467: -- The following code can reproduce the same issue.

[jira] [Assigned] (SPARK-9044) Updated RDD name does not reflect under "Storage" tab

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9044: --- Assignee: Apache Spark > Updated RDD name does not reflect under "Storage" tab >

[jira] [Assigned] (SPARK-9044) Updated RDD name does not reflect under "Storage" tab

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9044: --- Assignee: (was: Apache Spark) > Updated RDD name does not reflect under "Storage" tab >

[jira] [Resolved] (SPARK-14031) Dataframe to csv IO, system performance enters high CPU state and write operation takes 1 hour to complete

2016-05-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14031. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13229

[jira] [Commented] (SPARK-14331) Exceptions saving to parquetFile after join from dataframes in master

2016-05-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296705#comment-15296705 ] Thomas Graves commented on SPARK-14331: --- that might be https://github.com/apache/spark/pull/13175.

[jira] [Commented] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-05-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296697#comment-15296697 ] Davies Liu commented on SPARK-14946: [~raymond.honderd...@sizmek.com] Thanks for the feedback, I'm

[jira] [Commented] (SPARK-15455) For IsolatedClientLoader, we need to provide a conf to disable sharing Hadoop classes

2016-05-23 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296640#comment-15296640 ] Ryan Blue commented on SPARK-15455: --- Why can't Hive use a newer version of the Hadoop classes, if those

[jira] [Comment Edited] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-05-23 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296630#comment-15296630 ] Narine Kokhlikyan edited comment on SPARK-13525 at 5/23/16 4:48 PM:

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-05-23 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296630#comment-15296630 ] Narine Kokhlikyan commented on SPARK-13525: --- Hi guys, I'm afraid I'm seeing this issue on my

[jira] [Assigned] (SPARK-15485) Spark SQL Configuration

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15485: Assignee: (was: Apache Spark) > Spark SQL Configuration > --- > >

[jira] [Assigned] (SPARK-15485) Spark SQL Configuration

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15485: Assignee: Apache Spark > Spark SQL Configuration > --- > >

[jira] [Updated] (SPARK-15486) dropTempTable does not work with backticks

2016-05-23 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated SPARK-15486: --- Description: We're using spark commit db75ccb (not sure if that's unreleased 2.0.0 or 2.1.0). We

[jira] [Updated] (SPARK-15486) dropTempTable does not work with backticks

2016-05-23 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated SPARK-15486: --- Description: We're using spark commit db75ccb (not sure if that's unreleased 2.0.0 or 2.1.0). We

[jira] [Created] (SPARK-15486) dropTempTable does not work with backticks

2016-05-23 Thread Luca Bruno (JIRA)
Luca Bruno created SPARK-15486: -- Summary: dropTempTable does not work with backticks Key: SPARK-15486 URL: https://issues.apache.org/jira/browse/SPARK-15486 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15486) dropTempTable does not work with backticks

2016-05-23 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated SPARK-15486: --- Description: We're using spark commit db75ccb (not sure if that's unreleased 2.0.0 or 2.1.0). We

[jira] [Updated] (SPARK-14279) Improve the spark build to pick the version information from the pom file and add git commit information

2016-05-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-14279: -- Assignee: (was: Sanket Reddy) > Improve the spark build to pick the version information

[jira] [Updated] (SPARK-15486) dropTempTable does not work with backticks

2016-05-23 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated SPARK-15486: --- Description: We're using spark commit db75ccb (not sure if that's unreleased 2.0.0 or 2.1.0). We

[jira] [Updated] (SPARK-15486) dropTempTable does not work with backticks

2016-05-23 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated SPARK-15486: --- Description: We're using spark commit db75ccb (not sure if that's unreleased 2.0.0 or 2.1.0). We

[jira] [Commented] (SPARK-15485) Spark SQL Configuration

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296578#comment-15296578 ] Apache Spark commented on SPARK-15485: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-14279) Improve the spark build to pick the version information from the pom file and add git commit information

2016-05-23 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296577#comment-15296577 ] Sanket Reddy commented on SPARK-14279: -- @tgraves Please assign this issue to dhruve > Improve the

[jira] [Commented] (SPARK-15294) Add pivot functionality to SparkR

2016-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296573#comment-15296573 ] MikoĊ‚aj Hnatiuk commented on SPARK-15294: - Hi, ok, so I have this function defined: {code} # IN

[jira] [Created] (SPARK-15485) Spark SQL Configuration

2016-05-23 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15485: --- Summary: Spark SQL Configuration Key: SPARK-15485 URL: https://issues.apache.org/jira/browse/SPARK-15485 Project: Spark Issue Type: Documentation

[jira] [Comment Edited] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

2016-05-23 Thread Doug Balog (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296555#comment-15296555 ] Doug Balog edited comment on SPARK-15477 at 5/23/16 4:04 PM: - The

[jira] [Commented] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

2016-05-23 Thread Doug Balog (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296555#comment-15296555 ] Doug Balog commented on SPARK-15477: The HiveCompatibility module was reverted in SPARK-15424 rxin

[jira] [Commented] (SPARK-14331) Exceptions saving to parquetFile after join from dataframes in master

2016-05-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296440#comment-15296440 ] Thomas Graves commented on SPARK-14331: --- Note I was running spark on yarn. > Exceptions saving to

[jira] [Commented] (SPARK-14331) Exceptions saving to parquetFile after join from dataframes in master

2016-05-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296416#comment-15296416 ] Thomas Graves commented on SPARK-14331: --- I was trying to reproduce this to get you the rest but now

[jira] [Resolved] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14946. --- Resolution: Not A Problem Fix Version/s: (was: 2.0.0) Target Version/s: (was:

[jira] [Assigned] (SPARK-11959) Document normal equation solver for ordinary least squares in user guide

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11959: Assignee: Apache Spark (was: Yanbo Liang) > Document normal equation solver for ordinary

[jira] [Assigned] (SPARK-11959) Document normal equation solver for ordinary least squares in user guide

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11959: Assignee: Yanbo Liang (was: Apache Spark) > Document normal equation solver for ordinary

[jira] [Assigned] (SPARK-15484) Document Iteratively reweighted least squares (IRLS) in user guide

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15484: Assignee: Apache Spark > Document Iteratively reweighted least squares (IRLS) in user

[jira] [Commented] (SPARK-11959) Document normal equation solver for ordinary least squares in user guide

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296368#comment-15296368 ] Apache Spark commented on SPARK-11959: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15484) Document Iteratively reweighted least squares (IRLS) in user guide

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15484: Assignee: (was: Apache Spark) > Document Iteratively reweighted least squares (IRLS)

[jira] [Commented] (SPARK-15484) Document Iteratively reweighted least squares (IRLS) in user guide

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296369#comment-15296369 ] Apache Spark commented on SPARK-15484: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Resolved] (SPARK-3828) Spark returns inconsistent results when building with different Hadoop version

2016-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3828. -- Resolution: Won't Fix Defunct now that Hadoop 1 is not supported > Spark returns inconsistent results

[jira] [Reopened] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14946: --- > Spark 2.0 vs 1.6.1 Query Time(out) > -- > > Key:

[jira] [Created] (SPARK-15484) Document Iteratively reweighted least squares (IRLS) in user guide

2016-05-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-15484: --- Summary: Document Iteratively reweighted least squares (IRLS) in user guide Key: SPARK-15484 URL: https://issues.apache.org/jira/browse/SPARK-15484 Project: Spark

[jira] [Closed] (SPARK-15478) LogisticRegressionModel coefficients() returns an empty vector

2016-05-23 Thread lichenglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lichenglin closed SPARK-15478. -- Resolution: Not A Problem > LogisticRegressionModel coefficients() returns an empty vector >

[jira] [Commented] (SPARK-15478) LogisticRegressionModel coefficients() returns an empty vector

2016-05-23 Thread lichenglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296332#comment-15296332 ] lichenglin commented on SPARK-15478: Sorry,I made a mistake with wrong example data >

[jira] [Issue Comment Deleted] (SPARK-15478) LogisticRegressionModel coefficients() returns an empty vector

2016-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15478: -- Comment: was deleted (was: Can you clarify what example you have modified, and what is in the file?

[jira] [Commented] (SPARK-15478) LogisticRegressionModel coefficients() returns an empty vector

2016-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296322#comment-15296322 ] Sean Owen commented on SPARK-15478: --- Can you clarify what example you have modified, and what is in the

[jira] [Commented] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

2016-05-23 Thread Biao Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296318#comment-15296318 ] Biao Ma commented on SPARK-15477: - Thx Owen > HiveContext is private[hive] and not accessible to users.

[jira] [Updated] (SPARK-15478) LogisticRegressionModel coefficients() returns an empty vector

2016-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15478: -- Summary: LogisticRegressionModel coefficients() returns an empty vector (was: LogisticRegressionModel

[jira] [Commented] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

2016-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296302#comment-15296302 ] Sean Owen commented on SPARK-15477: --- It looks like you are indeed not supposed to call in this in 2.0

[jira] [Commented] (SPARK-15040) PySpark impl for ml.feature.Imputer

2016-05-23 Thread Takuya Kuwahara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296208#comment-15296208 ] Takuya Kuwahara commented on SPARK-15040: - I try to work on this. > PySpark impl for

[jira] [Updated] (SPARK-15483) IncrementalExecution should use extra strategies.

2016-05-23 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-15483: -- Description: Extra strategies does not work for streams because {{IncrementalExecution}} uses

[jira] [Assigned] (SPARK-15483) IncrementalExecution should use extra strategies.

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15483: Assignee: Apache Spark > IncrementalExecution should use extra strategies. >

[jira] [Assigned] (SPARK-15483) IncrementalExecution should use extra strategies.

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15483: Assignee: (was: Apache Spark) > IncrementalExecution should use extra strategies. >

[jira] [Commented] (SPARK-15483) IncrementalExecution should use extra strategies.

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296190#comment-15296190 ] Apache Spark commented on SPARK-15483: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-15483) IncrementalExecution should use extra strategies.

2016-05-23 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-15483: - Summary: IncrementalExecution should use extra strategies. Key: SPARK-15483 URL: https://issues.apache.org/jira/browse/SPARK-15483 Project: Spark Issue

[jira] [Updated] (SPARK-15151) Add support for history server on windows

2016-05-23 Thread Netanel Malka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Netanel Malka updated SPARK-15151: -- Description: Add support for history server on windows. The current version, support history

[jira] [Updated] (SPARK-15482) ClassCast exception when join two tables.

2016-05-23 Thread jingtao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingtao updated SPARK-15482: Description: I have two tables A and B in Phoenix. I load table 'A' as dataFrame 'ADF' using spark , and

[jira] [Assigned] (SPARK-15481) Prevent `takeSample` from calling `collect` multiple times

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15481: Assignee: (was: Apache Spark) > Prevent `takeSample` from calling `collect` multiple

[jira] [Assigned] (SPARK-15481) Prevent `takeSample` from calling `collect` multiple times

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15481: Assignee: Apache Spark > Prevent `takeSample` from calling `collect` multiple times >

[jira] [Commented] (SPARK-15481) Prevent `takeSample` from calling `collect` multiple times

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296152#comment-15296152 ] Apache Spark commented on SPARK-15481: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-15482) ClassCast exception when join two tables.

2016-05-23 Thread jingtao (JIRA)
jingtao created SPARK-15482: --- Summary: ClassCast exception when join two tables. Key: SPARK-15482 URL: https://issues.apache.org/jira/browse/SPARK-15482 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15481) Prevent `takeSample` from calling `collect` multiple times

2016-05-23 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15481: -- Summary: Prevent `takeSample` from calling `collect` multiple times (was: Improve takeSample

[jira] [Closed] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-05-23 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors closed SPARK-14946. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0

[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-05-23 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: resolved timeout long duration.png > Spark 2.0 vs 1.6.1 Query Time(out)

[jira] [Commented] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-05-23 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296130#comment-15296130 ] Raymond Honderdors commented on SPARK-14946: the last comment resolved the issue, and

[jira] [Created] (SPARK-15481) Improve takeSample to call `collect` once

2016-05-23 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-15481: - Summary: Improve takeSample to call `collect` once Key: SPARK-15481 URL: https://issues.apache.org/jira/browse/SPARK-15481 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-23 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296105#comment-15296105 ] Yi Zhou commented on SPARK-15396: - Thanks a lot for your respone ! > [Spark] [SQL] [DOC] It can't

[jira] [Commented] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

2016-05-23 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296102#comment-15296102 ] Kazuaki Ishizaki commented on SPARK-15467: -- I will try to submit a patch against Janino. >

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296092#comment-15296092 ] Xiao Li commented on SPARK-15396: - Will try to reproduce it and see if it is caused by the recent code

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-23 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296088#comment-15296088 ] Yi Zhou commented on SPARK-15396: - BTW, I only replaced 1.6 with 2.0 package. > [Spark] [SQL] [DOC] It

[jira] [Comment Edited] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-23 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296086#comment-15296086 ] Yi Zhou edited comment on SPARK-15396 at 5/23/16 8:22 AM: -- hive-site.xml put in

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-23 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296086#comment-15296086 ] Yi Zhou commented on SPARK-15396: - hive-site.xml put in right 'conf' folder in Spark home. my concerning

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296078#comment-15296078 ] Xiao Li commented on SPARK-15396: - Are you sure hive-site.xml is put in the right directory that your

[jira] [Updated] (SPARK-15478) LogisticRegressionModel 's Coefficients always return a empty vector

2016-05-23 Thread lichenglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lichenglin updated SPARK-15478: --- Description: I'm not sure this is a bug. I'm runing the sample code like this {code} public

[jira] [Commented] (SPARK-15476) Support for reading text data source without specifying schema

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296069#comment-15296069 ] Apache Spark commented on SPARK-15476: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-15476) Support for reading text data source without specifying schema

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15476: Assignee: (was: Apache Spark) > Support for reading text data source without

[jira] [Assigned] (SPARK-15476) Support for reading text data source without specifying schema

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15476: Assignee: Apache Spark > Support for reading text data source without specifying schema >

[jira] [Closed] (SPARK-15445) Build fails for java 1.7 after adding java.math.BigInteger support [SPARK-11827][SQL]

2016-05-23 Thread Piotr Milanowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-15445. System builds with java 1.7 with no problems > Build fails for java 1.7 after adding

[jira] [Commented] (SPARK-13773) UDF being applied to filtered data

2016-05-23 Thread Linbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296052#comment-15296052 ] Linbo commented on SPARK-13773: --- See this pr: https://github.com/apache/spark/pull/13087 > UDF being

[jira] [Assigned] (SPARK-15480) Some InputInfo missed with window operation applied

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15480: Assignee: (was: Apache Spark) > Some InputInfo missed with window operation applied >

[jira] [Commented] (SPARK-15480) Some InputInfo missed with window operation applied

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296036#comment-15296036 ] Apache Spark commented on SPARK-15480: -- User 'mwws' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15480) Some InputInfo missed with window operation applied

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15480: Assignee: Apache Spark > Some InputInfo missed with window operation applied >

[jira] [Created] (SPARK-15480) Some InputInfo missed with window operation applied

2016-05-23 Thread Mao, Wei (JIRA)
Mao, Wei created SPARK-15480: Summary: Some InputInfo missed with window operation applied Key: SPARK-15480 URL: https://issues.apache.org/jira/browse/SPARK-15480 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15478) LogisticRegressionModel 's Coefficients always return a empty vector

2016-05-23 Thread lichenglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lichenglin updated SPARK-15478: --- Summary: LogisticRegressionModel 's Coefficients always return a empty vector (was:

[jira] [Comment Edited] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-23 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296010#comment-15296010 ] Yi Zhou edited comment on SPARK-15396 at 5/23/16 7:02 AM: -- sorry i can't access

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-23 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296010#comment-15296010 ] Yi Zhou commented on SPARK-15396: - sorry i can't access the

[jira] [Created] (SPARK-15479) Spark job doesn't shut gracefully in yarn mode.

2016-05-23 Thread Rakesh (JIRA)
Rakesh created SPARK-15479: -- Summary: Spark job doesn't shut gracefully in yarn mode. Key: SPARK-15479 URL: https://issues.apache.org/jira/browse/SPARK-15479 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15478) LogisticRegressionModel 's Coefficients always be a empty vector

2016-05-23 Thread lichenglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lichenglin updated SPARK-15478: --- Description: I don't know if this is a bug. I'm runing the sample code like this {code}

[jira] [Created] (SPARK-15478) LogisticRegressionModel 's Coefficients always be a empty vector

2016-05-23 Thread lichenglin (JIRA)
lichenglin created SPARK-15478: -- Summary: LogisticRegressionModel 's Coefficients always be a empty vector Key: SPARK-15478 URL: https://issues.apache.org/jira/browse/SPARK-15478 Project: Spark

[jira] [Resolved] (SPARK-15425) Disallow cartesian joins by default

2016-05-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15425. - Resolution: Fixed Assignee: Sameer Agarwal Fix Version/s: 2.0.0 > Disallow

[jira] [Updated] (SPARK-15472) Add partitioned `csv`, `json`, `text` format support for FileStreamSink

2016-05-23 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-15472: -- Description: Support for partitioned `parquet` format in FileStreamSink was added in Spark-14716, now

[jira] [Updated] (SPARK-15472) Add partitioned `csv`, `json`, `text` format support for FileStreamSink

2016-05-23 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-15472: -- Summary: Add partitioned `csv`, `json`, `text` format support for FileStreamSink (was: Add support

[jira] [Commented] (SPARK-15472) Add support for partitioned `text` format in FileStreamSink

2016-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15295953#comment-15295953 ] Apache Spark commented on SPARK-15472: -- User 'lw-lin' has created a pull request for this issue:

<    1   2