[jira] [Commented] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424015#comment-15424015 ] Xin Ren commented on SPARK-17038: - Hi [~ozzieba] I guess you too busy to respond or submi

[jira] [Issue Comment Deleted] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-17038: Comment: was deleted (was: Hi [~ozzieba] I guess you too busy to respond or submit a PR, and I'm now just

[jira] [Commented] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424017#comment-15424017 ] Xin Ren commented on SPARK-17038: - Hi [~ozzieba] I guess you too busy to respond or submi

[jira] [Assigned] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17038: Assignee: (was: Apache Spark) > StreamingSource reports metrics for lastCompletedBatch

[jira] [Commented] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424020#comment-15424020 ] Apache Spark commented on SPARK-17038: -- User 'keypointt' has created a pull request

[jira] [Assigned] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17038: Assignee: Apache Spark > StreamingSource reports metrics for lastCompletedBatch instead of

[jira] [Assigned] (SPARK-17101) Provide format identifier for TextFileFormat

[ https://issues.apache.org/jira/browse/SPARK-17101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17101: Assignee: (was: Apache Spark) > Provide format identifier for TextFileFormat > ---

[jira] [Updated] (SPARK-17102) bypass UserDefinedGenerator for json format check

[ https://issues.apache.org/jira/browse/SPARK-17102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17102: Description: {code} [info] - simple explode *** FAILED *** (19 milliseconds) [info] Failed to par

[jira] [Updated] (SPARK-17102) bypass UserDefinedGenerator for json format check

[ https://issues.apache.org/jira/browse/SPARK-17102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17102: Description: [info] - simple explode *** FAILED *** (19 milliseconds) [info] Failed to parse logi

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424053#comment-15424053 ] Mikael Ståldal commented on SPARK-6305: --- We are working on supporting Log4j 1 log4j.

[jira] [Commented] (SPARK-16757) Set up caller context to HDFS

[ https://issues.apache.org/jira/browse/SPARK-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424072#comment-15424072 ] Sean Owen commented on SPARK-16757: --- What's the use case for this? > Set up caller con

[jira] [Commented] (SPARK-17086) QuantileDiscretizer throws InvalidArgumentException (parameter splits given invalid value) on valid data

[ https://issues.apache.org/jira/browse/SPARK-17086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424076#comment-15424076 ] Vincent commented on SPARK-17086: - confirmed issue doesnt exist on Spark-1.6.2. I will wo

[jira] [Created] (SPARK-17103) Can not define class variable in repl

Jeff Zhang created SPARK-17103: -- Summary: Can not define class variable in repl Key: SPARK-17103 URL: https://issues.apache.org/jira/browse/SPARK-17103 Project: Spark Issue Type: Bug C

[jira] [Resolved] (SPARK-14703) Spark uses SLF4J, but actually relies quite heavily on Log4J

[ https://issues.apache.org/jira/browse/SPARK-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14703. --- Resolution: Not A Problem > Spark uses SLF4J, but actually relies quite heavily on Log4J > --

[jira] [Commented] (SPARK-17103) Can not define class variable in repl

[ https://issues.apache.org/jira/browse/SPARK-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424102#comment-15424102 ] Sean Owen commented on SPARK-17103: --- You're using Scala 2.11 with Spark right? I can re

[jira] [Updated] (SPARK-17002) Document that spark.ssl.protocol. is required for SSL

[ https://issues.apache.org/jira/browse/SPARK-17002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17002: -- Priority: Minor (was: Major) Component/s: Documentation > Document that spark.ssl.protocol. is

[jira] [Created] (SPARK-17104) Self-joining of a Hive table converted to datasource parquet table will fail

Liang-Chi Hsieh created SPARK-17104: --- Summary: Self-joining of a Hive table converted to datasource parquet table will fail Key: SPARK-17104 URL: https://issues.apache.org/jira/browse/SPARK-17104 Pr

[jira] [Updated] (SPARK-17104) Self-joining of a Hive table converted to datasource parquet table will fail

[ https://issues.apache.org/jira/browse/SPARK-17104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17104: Description: Converted Hive table will > Self-joining of a Hive table converted to datasour

[jira] [Updated] (SPARK-17104) LogicalRelation.newInstance should follow the semantics of MultiInstanceRelation

[ https://issues.apache.org/jira/browse/SPARK-17104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17104: Summary: LogicalRelation.newInstance should follow the semantics of MultiInstanceRelation

[jira] [Updated] (SPARK-17104) LogicalRelation.newInstance should follow the semantics of MultiInstanceRelation

[ https://issues.apache.org/jira/browse/SPARK-17104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17104: Description: Currently LogicalRelation.newInstance() simply creates another LogicalRelation

[jira] [Updated] (SPARK-17104) LogicalRelation.newInstance should follow the semantics of MultiInstanceRelation

[ https://issues.apache.org/jira/browse/SPARK-17104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17104: Description: Currently LogicalRelation.newInstance() simply creates another LogicalRelation

[jira] [Commented] (SPARK-17095) Latex and Scala doc do not play nicely

[ https://issues.apache.org/jira/browse/SPARK-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424161#comment-15424161 ] Sean Owen commented on SPARK-17095: --- I see, for now, let's work-around. Anyone is welco

[jira] [Assigned] (SPARK-17104) LogicalRelation.newInstance should follow the semantics of MultiInstanceRelation

[ https://issues.apache.org/jira/browse/SPARK-17104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17104: Assignee: (was: Apache Spark) > LogicalRelation.newInstance should follow the semantic

[jira] [Assigned] (SPARK-17104) LogicalRelation.newInstance should follow the semantics of MultiInstanceRelation

[ https://issues.apache.org/jira/browse/SPARK-17104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17104: Assignee: Apache Spark > LogicalRelation.newInstance should follow the semantics of > Mul

[jira] [Commented] (SPARK-17104) LogicalRelation.newInstance should follow the semantics of MultiInstanceRelation

[ https://issues.apache.org/jira/browse/SPARK-17104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424168#comment-15424168 ] Apache Spark commented on SPARK-17104: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-17095) Latex and Scala doc do not play nicely

[ https://issues.apache.org/jira/browse/SPARK-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424195#comment-15424195 ] Jagadeesan A S commented on SPARK-17095: [~srowen] I would like to work this issu

[jira] [Comment Edited] (SPARK-17103) Can not define class variable in repl

[ https://issues.apache.org/jira/browse/SPARK-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424228#comment-15424228 ] Jakob Odersky edited comment on SPARK-17103 at 8/17/16 9:52 AM: ---

[jira] [Commented] (SPARK-17103) Can not define class variable in repl

[ https://issues.apache.org/jira/browse/SPARK-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424228#comment-15424228 ] Jakob Odersky commented on SPARK-17103: --- That's true, the spark repl is basically j

[jira] [Comment Edited] (SPARK-17103) Can not define class variable in repl

[ https://issues.apache.org/jira/browse/SPARK-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424228#comment-15424228 ] Jakob Odersky edited comment on SPARK-17103 at 8/17/16 9:53 AM: ---

[jira] [Commented] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424242#comment-15424242 ] Laurent Hoss commented on SPARK-12430: -- In spark 2.0 this should be less an issue, a

[jira] [Commented] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424277#comment-15424277 ] Ewan Leith commented on SPARK-17099: I've done a quick test in Spark 1.6.1 and this p

[jira] [Commented] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

[ https://issues.apache.org/jira/browse/SPARK-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424287#comment-15424287 ] Apache Spark commented on SPARK-16968: -- User 'GraceH' has created a pull request for

[jira] [Created] (SPARK-17105) Create spark context with random uuid app name if app name is not set in configuration

sandeep purohit created SPARK-17105: --- Summary: Create spark context with random uuid app name if app name is not set in configuration Key: SPARK-17105 URL: https://issues.apache.org/jira/browse/SPARK-17105

[jira] [Commented] (SPARK-17105) Create spark context with random uuid app name if app name is not set in configuration

[ https://issues.apache.org/jira/browse/SPARK-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424293#comment-15424293 ] Apache Spark commented on SPARK-17105: -- User 'phalodi' has created a pull request fo

[jira] [Assigned] (SPARK-17105) Create spark context with random uuid app name if app name is not set in configuration

[ https://issues.apache.org/jira/browse/SPARK-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17105: Assignee: (was: Apache Spark) > Create spark context with random uuid app name if app

[jira] [Assigned] (SPARK-17105) Create spark context with random uuid app name if app name is not set in configuration

[ https://issues.apache.org/jira/browse/SPARK-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17105: Assignee: Apache Spark > Create spark context with random uuid app name if app name is not

[jira] [Updated] (SPARK-16947) Support type coercion and foldable expression for inline tables

[ https://issues.apache.org/jira/browse/SPARK-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-16947: -- Assignee: Peter Lee (was: Herman van Hovell) > Support type coercion and foldable expr

[jira] [Created] (SPARK-17106) Simplify subquery interface

Herman van Hovell created SPARK-17106: - Summary: Simplify subquery interface Key: SPARK-17106 URL: https://issues.apache.org/jira/browse/SPARK-17106 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-17105) Create spark context with random uuid app name if app name is not set in configuration

[ https://issues.apache.org/jira/browse/SPARK-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17105. --- Resolution: Duplicate > Create spark context with random uuid app name if app name is not set in > c

[jira] [Commented] (SPARK-17105) Create spark context with random uuid app name if app name is not set in configuration

[ https://issues.apache.org/jira/browse/SPARK-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424301#comment-15424301 ] sandeep purohit commented on SPARK-17105: - [~srowen] SPARK-16966 is for spark ses

[jira] [Commented] (SPARK-17105) Create spark context with random uuid app name if app name is not set in configuration

[ https://issues.apache.org/jira/browse/SPARK-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424307#comment-15424307 ] Sean Owen commented on SPARK-17105: --- I don't think we want to change that behavior for

[jira] [Updated] (SPARK-17106) Simplify subquery interface

[ https://issues.apache.org/jira/browse/SPARK-17106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17106: -- Description: The current subquery expression interface contains a little bit of technic

[jira] [Assigned] (SPARK-17106) Simplify subquery interface

[ https://issues.apache.org/jira/browse/SPARK-17106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17106: Assignee: Herman van Hovell (was: Apache Spark) > Simplify subquery interface > -

[jira] [Commented] (SPARK-17106) Simplify subquery interface

[ https://issues.apache.org/jira/browse/SPARK-17106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424316#comment-15424316 ] Apache Spark commented on SPARK-17106: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-17106) Simplify subquery interface

[ https://issues.apache.org/jira/browse/SPARK-17106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17106: Assignee: Apache Spark (was: Herman van Hovell) > Simplify subquery interface > -

[jira] [Commented] (SPARK-16253) make spark sql compatible with hive sql that using python script transform like using 'xxx.py'

[ https://issues.apache.org/jira/browse/SPARK-16253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424325#comment-15424325 ] liuyongliang commented on SPARK-16253: -- i meet the same error too. could u tell me h

[jira] [Commented] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

[ https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424335#comment-15424335 ] Fabian Boehnlein commented on SPARK-10872: -- Seeing that exception on 1.6.* and 2

[jira] [Comment Edited] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

[ https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424335#comment-15424335 ] Fabian Boehnlein edited comment on SPARK-10872 at 8/17/16 11:51 AM: ---

[jira] [Commented] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424356#comment-15424356 ] Herman van Hovell commented on SPARK-17099: --- TL;DR: This is caused by a bug in

[jira] [Commented] (SPARK-16253) make spark sql compatible with hive sql that using python script transform like using 'xxx.py'

[ https://issues.apache.org/jira/browse/SPARK-16253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424381#comment-15424381 ] liuyongliang commented on SPARK-16253: -- i meet the same error too. could u tell me h

[jira] [Comment Edited] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424356#comment-15424356 ] Herman van Hovell edited comment on SPARK-17099 at 8/17/16 12:02 PM: --

[jira] [Commented] (SPARK-16253) make spark sql compatible with hive sql that using python script transform like using 'xxx.py'

[ https://issues.apache.org/jira/browse/SPARK-16253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424388#comment-15424388 ] zenglinxi commented on SPARK-16253: --- wait a minute please, I'm working on this PR > ma

[jira] [Assigned] (SPARK-16253) make spark sql compatible with hive sql that using python script transform like using 'xxx.py'

[ https://issues.apache.org/jira/browse/SPARK-16253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16253: Assignee: (was: Apache Spark) > make spark sql compatible with hive sql that using pyt

[jira] [Assigned] (SPARK-16253) make spark sql compatible with hive sql that using python script transform like using 'xxx.py'

[ https://issues.apache.org/jira/browse/SPARK-16253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16253: Assignee: Apache Spark > make spark sql compatible with hive sql that using python script

[jira] [Commented] (SPARK-16253) make spark sql compatible with hive sql that using python script transform like using 'xxx.py'

[ https://issues.apache.org/jira/browse/SPARK-16253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424392#comment-15424392 ] Apache Spark commented on SPARK-16253: -- User 'zenglinxi0615' has created a pull requ

[jira] [Comment Edited] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424356#comment-15424356 ] Herman van Hovell edited comment on SPARK-17099 at 8/17/16 12:12 PM: --

[jira] [Created] (SPARK-17107) Remove redundant pushdown rule for set

Liang-Chi Hsieh created SPARK-17107: --- Summary: Remove redundant pushdown rule for set Key: SPARK-17107 URL: https://issues.apache.org/jira/browse/SPARK-17107 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-17107) Remove redundant pushdown rule for Union

[ https://issues.apache.org/jira/browse/SPARK-17107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17107: Summary: Remove redundant pushdown rule for Union (was: Remove redundant pushdown rule for

[jira] [Assigned] (SPARK-17107) Remove redundant pushdown rule for Union

[ https://issues.apache.org/jira/browse/SPARK-17107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17107: Assignee: Apache Spark > Remove redundant pushdown rule for Union > --

[jira] [Commented] (SPARK-17107) Remove redundant pushdown rule for Union

[ https://issues.apache.org/jira/browse/SPARK-17107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424407#comment-15424407 ] Apache Spark commented on SPARK-17107: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-17107) Remove redundant pushdown rule for Union

[ https://issues.apache.org/jira/browse/SPARK-17107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17107: Assignee: (was: Apache Spark) > Remove redundant pushdown rule for Union > ---

[jira] [Resolved] (SPARK-17032) Add test cases for methods in ParserUtils

[ https://issues.apache.org/jira/browse/SPARK-17032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17032. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 > Add t

[jira] [Commented] (SPARK-17095) Latex and Scala doc do not play nicely

[ https://issues.apache.org/jira/browse/SPARK-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424417#comment-15424417 ] Apache Spark commented on SPARK-17095: -- User 'jagadeesanas2' has created a pull requ

[jira] [Assigned] (SPARK-17095) Latex and Scala doc do not play nicely

[ https://issues.apache.org/jira/browse/SPARK-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17095: Assignee: (was: Apache Spark) > Latex and Scala doc do not play nicely > -

[jira] [Assigned] (SPARK-17095) Latex and Scala doc do not play nicely

[ https://issues.apache.org/jira/browse/SPARK-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17095: Assignee: Apache Spark > Latex and Scala doc do not play nicely >

[jira] [Resolved] (SPARK-16444) Isotonic Regression wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-16444. -- Resolution: Fixed Fix Version/s: 2.1.0 > Isotonic Regression wrapper in SparkR > ---

[jira] [Commented] (SPARK-11328) Provide more informative error message when direct parquet output committer is used and there is a file already exists error.

[ https://issues.apache.org/jira/browse/SPARK-11328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424550#comment-15424550 ] Rahul Bhatia commented on SPARK-11328: -- I'm still finding symptoms of this error in

[jira] [Resolved] (SPARK-17106) Simplify subquery interface

[ https://issues.apache.org/jira/browse/SPARK-17106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-17106. Resolution: Fixed Fix Version/s: 2.1.0 > Simplify subquery interface > -

[jira] [Commented] (SPARK-11106) Should ML Models contains single models or Pipelines?

[ https://issues.apache.org/jira/browse/SPARK-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424689#comment-15424689 ] Jeff Levy commented on SPARK-11106: --- The objections to implementing RFormula in pySpark

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424709#comment-15424709 ] Leonid commented on SPARK-2243: --- If you have a necessity to work with lots of Spark contexts

[jira] [Comment Edited] (SPARK-11106) Should ML Models contains single models or Pipelines?

[ https://issues.apache.org/jira/browse/SPARK-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424689#comment-15424689 ] Jeff Levy edited comment on SPARK-11106 at 8/17/16 3:26 PM: T

[jira] [Created] (SPARK-17108) BIGINT and INT comparison failure in spark sql

Sai Krishna Kishore Beathanabhotla created SPARK-17108: -- Summary: BIGINT and INT comparison failure in spark sql Key: SPARK-17108 URL: https://issues.apache.org/jira/browse/SPARK-17108

[jira] [Updated] (SPARK-17108) BIGINT and INT comparison failure in spark sql

[ https://issues.apache.org/jira/browse/SPARK-17108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17108: -- Description: I have a Hive table with the following definition: {noformat} create table

[jira] [Commented] (SPARK-17108) BIGINT and INT comparison failure in spark sql

[ https://issues.apache.org/jira/browse/SPARK-17108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424831#comment-15424831 ] Herman van Hovell commented on SPARK-17108: --- As a work around you could add a c

[jira] [Updated] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

[ https://issues.apache.org/jira/browse/SPARK-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17109: - Target Version/s: (was: 1.6.2, 2.0.1, 2.1.0) > When we serialize UserDefinedGenerator to json, scala re

[jira] [Updated] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

[ https://issues.apache.org/jira/browse/SPARK-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17109: - Issue Type: Bug (was: Test) > When we serialize UserDefinedGenerator to json, scala reflection throws an

[jira] [Created] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

Yin Huai created SPARK-17109: Summary: When we serialize UserDefinedGenerator to json, scala reflection throws an error Key: SPARK-17109 URL: https://issues.apache.org/jira/browse/SPARK-17109 Project: Spa

[jira] [Updated] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

[ https://issues.apache.org/jira/browse/SPARK-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17109: - Assignee: (was: Wenchen Fan) > When we serialize UserDefinedGenerator to json, scala reflection throw

[jira] [Commented] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

[ https://issues.apache.org/jira/browse/SPARK-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424842#comment-15424842 ] Yin Huai commented on SPARK-17109: -- The definition of {{UserDefinedGenerator}} is {code

[jira] [Resolved] (SPARK-17102) bypass UserDefinedGenerator for json format check

[ https://issues.apache.org/jira/browse/SPARK-17102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-17102. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 1.6.3 Issue r

[jira] [Created] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

Tomer Kaftan created SPARK-17110: Summary: Pyspark with locality ANY throw java.io.StreamCorruptedException Key: SPARK-17110 URL: https://issues.apache.org/jira/browse/SPARK-17110 Project: Spark

[jira] [Commented] (SPARK-17098) "SELECT COUNT(NULL) OVER ()" throws UnsupportedOperationException during analysis

[ https://issues.apache.org/jira/browse/SPARK-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424906#comment-15424906 ] Dongjoon Hyun commented on SPARK-17098: --- Hi, [~joshrosen]. According to your error

[jira] [Updated] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

[ https://issues.apache.org/jira/browse/SPARK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomer Kaftan updated SPARK-17110: - Description: In Pyspark 2.0.0, any task that accesses cached data non-locally throws a StreamCor

[jira] [Commented] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

[ https://issues.apache.org/jira/browse/SPARK-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424907#comment-15424907 ] Yin Huai commented on SPARK-17109: -- Yea, seems scala 2.11 is fine (I also tested this te

[jira] [Updated] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

[ https://issues.apache.org/jira/browse/SPARK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomer Kaftan updated SPARK-17110: - Description: In Pyspark 2.0.0, any task that accesses cached data non-locally throws a StreamCor

[jira] [Updated] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

[ https://issues.apache.org/jira/browse/SPARK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomer Kaftan updated SPARK-17110: - Description: In Pyspark 2.0.0, any task that accesses cached data non-locally throws a StreamCor

[jira] [Updated] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

[ https://issues.apache.org/jira/browse/SPARK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomer Kaftan updated SPARK-17110: - Description: In Pyspark 2.0.0, any task that accesses cached data non-locally throws a StreamCor

[jira] [Updated] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

[ https://issues.apache.org/jira/browse/SPARK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomer Kaftan updated SPARK-17110: - Description: In Pyspark 2.0.0, any task that accesses cached data non-locally throws a StreamCor

[jira] [Updated] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

[ https://issues.apache.org/jira/browse/SPARK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomer Kaftan updated SPARK-17110: - Environment: Cluster of 2 AWS r3.xlarge nodes launched via ec2 scripts, Spark 2.0.0, hadoop: yarn

[jira] [Commented] (SPARK-17098) "SELECT COUNT(NULL) OVER ()" throws UnsupportedOperationException during analysis

[ https://issues.apache.org/jira/browse/SPARK-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424955#comment-15424955 ] Dongjoon Hyun commented on SPARK-17098: --- Actually, `SELECT COUNT(1 + NULL) OVER ()`

[jira] [Comment Edited] (SPARK-17103) Can not define class variable in repl

[ https://issues.apache.org/jira/browse/SPARK-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424228#comment-15424228 ] Jakob Odersky edited comment on SPARK-17103 at 8/17/16 5:28 PM: ---

[jira] [Commented] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

[ https://issues.apache.org/jira/browse/SPARK-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424979#comment-15424979 ] Iulian Dragos commented on SPARK-17109: --- No, it seems strange. I suggest you print

[jira] [Assigned] (SPARK-17098) "SELECT COUNT(NULL) OVER ()" throws UnsupportedOperationException during analysis

[ https://issues.apache.org/jira/browse/SPARK-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17098: Assignee: Apache Spark > "SELECT COUNT(NULL) OVER ()" throws UnsupportedOperationException

[jira] [Assigned] (SPARK-17098) "SELECT COUNT(NULL) OVER ()" throws UnsupportedOperationException during analysis

[ https://issues.apache.org/jira/browse/SPARK-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17098: Assignee: (was: Apache Spark) > "SELECT COUNT(NULL) OVER ()" throws UnsupportedOperati

[jira] [Commented] (SPARK-17098) "SELECT COUNT(NULL) OVER ()" throws UnsupportedOperationException during analysis

[ https://issues.apache.org/jira/browse/SPARK-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425001#comment-15425001 ] Apache Spark commented on SPARK-17098: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Commented] (SPARK-17103) Can not define class variable in repl

[ https://issues.apache.org/jira/browse/SPARK-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425041#comment-15425041 ] Shixiong Zhu commented on SPARK-17103: -- It's similar to https://issues.scala-lang.or

[jira] [Commented] (SPARK-17103) Can not define class variable in repl

[ https://issues.apache.org/jira/browse/SPARK-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425070#comment-15425070 ] Shixiong Zhu commented on SPARK-17103: -- Right now a workaround is just importing cla

[jira] [Commented] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

[ https://issues.apache.org/jira/browse/SPARK-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425073#comment-15425073 ] Yin Huai commented on SPARK-17109: -- For Scala 2.10, {{tpe}} is {{Tuple3}}. For Scala 2.1

[jira] [Issue Comment Deleted] (SPARK-14146) Imported implicits can't be found in Spark REPL in some cases

[ https://issues.apache.org/jira/browse/SPARK-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-14146: - Comment: was deleted (was: The upstream ticket) > Imported implicits can't be found in Spark REP

[jira] [Commented] (SPARK-17109) When we serialize UserDefinedGenerator to json, scala reflection throws an error

[ https://issues.apache.org/jira/browse/SPARK-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425082#comment-15425082 ] Iulian Dragos commented on SPARK-17109: --- So the problem is somewhere along the call

  1   2   >