[jira] [Updated] (SPARK-8155) support of proxy user not working in spaced username on windows

[ https://issues.apache.org/jira/browse/SPARK-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaveen Raajan updated SPARK-8155: - Fix Version/s: (was: 1.3.0) > support of proxy user not working in spaced username on windows

[jira] [Assigned] (SPARK-8157) should use expression.unapply to match in HiveTypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8157: --- Assignee: (was: Apache Spark) > should use expression.unapply to match in HiveTypeCoercio

[jira] [Commented] (SPARK-8157) should use expression.unapply to match in HiveTypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576661#comment-14576661 ] Apache Spark commented on SPARK-8157: - User 'adrian-wang' has created a pull request f

[jira] [Assigned] (SPARK-8157) should use expression.unapply to match in HiveTypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8157: --- Assignee: Apache Spark > should use expression.unapply to match in HiveTypeCoercion > ---

[jira] [Created] (SPARK-8157) should use expression.unapply to match in HiveTypeCoercion

Adrian Wang created SPARK-8157: -- Summary: should use expression.unapply to match in HiveTypeCoercion Key: SPARK-8157 URL: https://issues.apache.org/jira/browse/SPARK-8157 Project: Spark Issue Ty

[jira] [Comment Edited] (SPARK-8096) how to convert dataframe field to LabelPoint

[ https://issues.apache.org/jira/browse/SPARK-8096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573922#comment-14573922 ] bofei.xiao edited comment on SPARK-8096 at 6/8/15 6:28 AM: --- I'm

[jira] [Assigned] (SPARK-8153) Add configuration for disabling partial aggregation in runtime

[ https://issues.apache.org/jira/browse/SPARK-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8153: --- Assignee: Apache Spark > Add configuration for disabling partial aggregation in runtime > ---

[jira] [Commented] (SPARK-8153) Add configuration for disabling partial aggregation in runtime

[ https://issues.apache.org/jira/browse/SPARK-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576649#comment-14576649 ] Apache Spark commented on SPARK-8153: - User 'navis' has created a pull request for thi

[jira] [Assigned] (SPARK-8153) Add configuration for disabling partial aggregation in runtime

[ https://issues.apache.org/jira/browse/SPARK-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8153: --- Assignee: (was: Apache Spark) > Add configuration for disabling partial aggregation in ru

[jira] [Resolved] (SPARK-8154) Remove Term/Code type aliases in code generation

[ https://issues.apache.org/jira/browse/SPARK-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8154. Resolution: Fixed Fix Version/s: 1.5.0 > Remove Term/Code type aliases in code generation > -

[jira] [Commented] (SPARK-8072) Better AnalysisException for writing DataFrame with identically named columns

[ https://issues.apache.org/jira/browse/SPARK-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576639#comment-14576639 ] Reynold Xin commented on SPARK-8072: Yes - adding a rule in CheckAnalysis.scala to che

[jira] [Commented] (SPARK-8071) Run PySpark dataframe.rollup/cube test failed

[ https://issues.apache.org/jira/browse/SPARK-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576627#comment-14576627 ] Weizhong commented on SPARK-8071: - Hi [~davies], In JDK 1.7.0_76 also can reproduce again

[jira] [Commented] (SPARK-8156) DataFrame created by hiveContext can not create table to other database except "defualt"

[ https://issues.apache.org/jira/browse/SPARK-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576597#comment-14576597 ] baishuo commented on SPARK-8156: hiveContext.sql("""use testdb""") val df = (1 to 3).map(i

[jira] [Comment Edited] (SPARK-8156) DataFrame created by hiveContext can not create table to other database except "defualt"

[ https://issues.apache.org/jira/browse/SPARK-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576597#comment-14576597 ] baishuo edited comment on SPARK-8156 at 6/8/15 4:57 AM: the follow

[jira] [Created] (SPARK-8156) DataFrame created by hiveContext can not create table to other database except "defualt"

baishuo created SPARK-8156: -- Summary: DataFrame created by hiveContext can not create table to other database except "defualt" Key: SPARK-8156 URL: https://issues.apache.org/jira/browse/SPARK-8156 Project:

[jira] [Comment Edited] (SPARK-8072) Better AnalysisException for writing DataFrame with identically named columns

[ https://issues.apache.org/jira/browse/SPARK-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14572714#comment-14572714 ] Animesh Baranawal edited comment on SPARK-8072 at 6/8/15 4:25 AM: --

[jira] [Created] (SPARK-8155) support of proxy user not working in spaced username on windows

Kaveen Raajan created SPARK-8155: Summary: support of proxy user not working in spaced username on windows Key: SPARK-8155 URL: https://issues.apache.org/jira/browse/SPARK-8155 Project: Spark

[jira] [Updated] (SPARK-8152) Dataframe Join Ignores Condition

[ https://issues.apache.org/jira/browse/SPARK-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Doi updated SPARK-8152: Attachment: field_choice_pinpointed.png Pinpointed the issue to the groupBy line. Grouping by the "itemReco

[jira] [Commented] (SPARK-7173) Support YARN node label expressions for the application master

[ https://issues.apache.org/jira/browse/SPARK-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576565#comment-14576565 ] Sandy Ryza commented on SPARK-7173: --- This requires additional work on top of SPARK-6470

[jira] [Commented] (SPARK-8154) Remove Term/Code type aliases in code generation

[ https://issues.apache.org/jira/browse/SPARK-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576553#comment-14576553 ] Apache Spark commented on SPARK-8154: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8154) Remove Term/Code type aliases in code generation

[ https://issues.apache.org/jira/browse/SPARK-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8154: --- Assignee: Apache Spark (was: Reynold Xin) > Remove Term/Code type aliases in code generation

[jira] [Assigned] (SPARK-8154) Remove Term/Code type aliases in code generation

[ https://issues.apache.org/jira/browse/SPARK-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8154: --- Assignee: Reynold Xin (was: Apache Spark) > Remove Term/Code type aliases in code generation

[jira] [Created] (SPARK-8154) Remove Term/Code type aliases in code generation

Reynold Xin created SPARK-8154: -- Summary: Remove Term/Code type aliases in code generation Key: SPARK-8154 URL: https://issues.apache.org/jira/browse/SPARK-8154 Project: Spark Issue Type: Improv

[jira] [Commented] (SPARK-7173) Support YARN node label expressions for the application master

[ https://issues.apache.org/jira/browse/SPARK-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576547#comment-14576547 ] Fei Wang commented on SPARK-7173: - is this resolved by spark-6470? > Support YARN node la

[jira] [Commented] (SPARK-8122) ParquetRelation.enableLogForwarding() may fail to configure loggers

[ https://issues.apache.org/jira/browse/SPARK-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576536#comment-14576536 ] Konstantin Shaposhnikov commented on SPARK-8122: Yes, a strong reference i

[jira] [Resolved] (SPARK-8149) Break ExpressionEvaluationSuite down to multiple files

[ https://issues.apache.org/jira/browse/SPARK-8149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8149. Resolution: Fixed Fix Version/s: 1.5.0 > Break ExpressionEvaluationSuite down to multiple fil

[jira] [Updated] (SPARK-8152) Dataframe Join Ignores Condition

[ https://issues.apache.org/jira/browse/SPARK-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Doi updated SPARK-8152: Target Version/s: 1.3.1 > Dataframe Join Ignores Condition > > >

[jira] [Created] (SPARK-8153) Add configuration for disabling partial aggregation in runtime

Navis created SPARK-8153: Summary: Add configuration for disabling partial aggregation in runtime Key: SPARK-8153 URL: https://issues.apache.org/jira/browse/SPARK-8153 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-8152) Dataframe Join Ignores Condition

[ https://issues.apache.org/jira/browse/SPARK-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Doi updated SPARK-8152: Attachment: side-by-side.png In this screenshot, the dataframes "purchasedRecItems" and "grouped_B" should

[jira] [Created] (SPARK-8152) Dataframe Join Ignores Condition

Eric Doi created SPARK-8152: --- Summary: Dataframe Join Ignores Condition Key: SPARK-8152 URL: https://issues.apache.org/jira/browse/SPARK-8152 Project: Spark Issue Type: Bug Reporter: Er

[jira] [Assigned] (SPARK-8151) Pipeline components should correctly implement copy

[ https://issues.apache.org/jira/browse/SPARK-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8151: --- Assignee: Apache Spark (was: Xiangrui Meng) > Pipeline components should correctly implement

[jira] [Assigned] (SPARK-8151) Pipeline components should correctly implement copy

[ https://issues.apache.org/jira/browse/SPARK-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8151: --- Assignee: Xiangrui Meng (was: Apache Spark) > Pipeline components should correctly implement

[jira] [Commented] (SPARK-8151) Pipeline components should correctly implement copy

[ https://issues.apache.org/jira/browse/SPARK-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576525#comment-14576525 ] Apache Spark commented on SPARK-8151: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-8151) Pipeline components should correctly implement copy

Xiangrui Meng created SPARK-8151: Summary: Pipeline components should correctly implement copy Key: SPARK-8151 URL: https://issues.apache.org/jira/browse/SPARK-8151 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3266) JavaDoubleRDD doesn't contain max()

[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3266: --- Issue Type: Bug (was: Improvement) > JavaDoubleRDD doesn't contain max() > --

[jira] [Updated] (SPARK-3266) JavaDoubleRDD doesn't contain max()

[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3266: --- Issue Type: Improvement (was: Bug) > JavaDoubleRDD doesn't contain max() > --

[jira] [Updated] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5342: --- Issue Type: New Feature (was: Bug) > Allow long running Spark apps to run on secure YARN/HDFS

[jira] [Updated] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2883: --- Issue Type: New Feature (was: Bug) > Spark Support for ORCFile format > -

[jira] [Commented] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576467#comment-14576467 ] Tathagata Das commented on SPARK-8080: -- Just to add to what Sean Owen said, the model

[jira] [Created] (SPARK-8150) IDFModel must implement copy

Joseph K. Bradley created SPARK-8150: Summary: IDFModel must implement copy Key: SPARK-8150 URL: https://issues.apache.org/jira/browse/SPARK-8150 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8149) Break ExpressionEvaluationSuite down to multiple files

[ https://issues.apache.org/jira/browse/SPARK-8149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8149: --- Assignee: Reynold Xin (was: Apache Spark) > Break ExpressionEvaluationSuite down to multiple

[jira] [Assigned] (SPARK-8149) Break ExpressionEvaluationSuite down to multiple files

[ https://issues.apache.org/jira/browse/SPARK-8149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8149: --- Assignee: Apache Spark (was: Reynold Xin) > Break ExpressionEvaluationSuite down to multiple

[jira] [Commented] (SPARK-8149) Break ExpressionEvaluationSuite down to multiple files

[ https://issues.apache.org/jira/browse/SPARK-8149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576449#comment-14576449 ] Apache Spark commented on SPARK-8149: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-8149) Break ExpressionEvaluationSuite down to multiple files

Reynold Xin created SPARK-8149: -- Summary: Break ExpressionEvaluationSuite down to multiple files Key: SPARK-8149 URL: https://issues.apache.org/jira/browse/SPARK-8149 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8117) Push codegen into Expression

[ https://issues.apache.org/jira/browse/SPARK-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8117: --- Issue Type: Improvement (was: Bug) > Push codegen into Expression > > >

[jira] [Resolved] (SPARK-7813) Push code generation into expression definition

[ https://issues.apache.org/jira/browse/SPARK-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7813. Resolution: Duplicate Fix Version/s: 1.5.0 > Push code generation into expression definition

[jira] [Resolved] (SPARK-8117) Push codegen into Expression

[ https://issues.apache.org/jira/browse/SPARK-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8117. Resolution: Fixed Fix Version/s: 1.5.0 > Push codegen into Expression > -

[jira] [Commented] (SPARK-7998) A better frequent item API

[ https://issues.apache.org/jira/browse/SPARK-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576439#comment-14576439 ] Amey Chaugule commented on SPARK-7998: -- Are you proposing a method freqItemsList that

[jira] [Updated] (SPARK-6964) Support Cancellation in the Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6964: Labels: (was: backport-needed) > Support Cancellation in the Thrift Server > -

[jira] [Commented] (SPARK-8148) Do not use FloatType in partition column inference

[ https://issues.apache.org/jira/browse/SPARK-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576407#comment-14576407 ] Apache Spark commented on SPARK-8148: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8148) Do not use FloatType in partition column inference

[ https://issues.apache.org/jira/browse/SPARK-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8148: --- Assignee: Reynold Xin (was: Apache Spark) > Do not use FloatType in partition column inferen

[jira] [Assigned] (SPARK-8148) Do not use FloatType in partition column inference

[ https://issues.apache.org/jira/browse/SPARK-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8148: --- Assignee: Apache Spark (was: Reynold Xin) > Do not use FloatType in partition column inferen

[jira] [Created] (SPARK-8148) Do not use FloatType in partition column inference

Reynold Xin created SPARK-8148: -- Summary: Do not use FloatType in partition column inference Key: SPARK-8148 URL: https://issues.apache.org/jira/browse/SPARK-8148 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-7733) Update build, code to use Java 7 for 1.5.0+

[ https://issues.apache.org/jira/browse/SPARK-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7733: - Priority: Minor (was: Major) > Update build, code to use Java 7 for 1.5.0+ >

[jira] [Resolved] (SPARK-7733) Update build, code to use Java 7 for 1.5.0+

[ https://issues.apache.org/jira/browse/SPARK-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7733. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6265 [https://github.com/ap

[jira] [Commented] (SPARK-5567) Add prediction methods to LDA

[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576371#comment-14576371 ] Joseph K. Bradley commented on SPARK-5567: -- Keeping the shared code in an object

[jira] [Commented] (SPARK-5567) Add prediction methods to LDA

[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576368#comment-14576368 ] Joseph K. Bradley commented on SPARK-5567: -- Yes, it should be 3-4 months from now

[jira] [Commented] (SPARK-7893) Complex Operators between Graphs

[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576366#comment-14576366 ] Joseph K. Bradley commented on SPARK-7893: -- [~shijinkui] Your PR should be tagged

[jira] [Commented] (SPARK-7893) Complex Operators between Graphs

[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576365#comment-14576365 ] Joseph K. Bradley commented on SPARK-7893: -- Sounds good. Graph union seems prett

[jira] [Updated] (SPARK-7894) Graph Union Operator

[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7894: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-7893 > Graph Union Operator

[jira] [Resolved] (SPARK-8004) Spark does not enclose column names when fetchting from jdbc sources

[ https://issues.apache.org/jira/browse/SPARK-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8004. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Assignee: Liang-Chi H

[jira] [Commented] (SPARK-5567) Add prediction methods to LDA

[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576358#comment-14576358 ] yuhao yang commented on SPARK-5567: --- I guess the major consideration is proper code reus

[jira] [Comment Edited] (SPARK-7893) Complex Operators between Graphs

[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576294#comment-14576294 ] Andy Huang edited comment on SPARK-7893 at 6/7/15 4:52 PM: --- I to

[jira] [Comment Edited] (SPARK-7893) Complex Operators between Graphs

[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576294#comment-14576294 ] Andy Huang edited comment on SPARK-7893 at 6/7/15 4:51 PM: --- I to

[jira] [Commented] (SPARK-7893) Complex Operators between Graphs

[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576294#comment-14576294 ] Andy Huang commented on SPARK-7893: --- I totally agree with u. The reason why we implement

[jira] [Commented] (SPARK-7893) Complex Operators between Graphs

[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576277#comment-14576277 ] Andy Huang commented on SPARK-7893: --- Thanks. Yup, it's a long term issue and the target

[jira] [Commented] (SPARK-5567) Add prediction methods to LDA

[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576270#comment-14576270 ] Chris Fusting commented on SPARK-5567: -- Is there a target date for this work? 1.5.0 s

[jira] [Commented] (SPARK-8147) Add ability to decorate RDD iterators

[ https://issues.apache.org/jira/browse/SPARK-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576235#comment-14576235 ] Yuri Makhno commented on SPARK-8147: [~srowen] exception in iterator will fail spark j

[jira] [Commented] (SPARK-8147) Add ability to decorate RDD iterators

[ https://issues.apache.org/jira/browse/SPARK-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576234#comment-14576234 ] Sean Owen commented on SPARK-8147: -- I think this just trades one failure for another, and

[jira] [Commented] (SPARK-8147) Add ability to decorate RDD iterators

[ https://issues.apache.org/jira/browse/SPARK-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576230#comment-14576230 ] Yuri Makhno commented on SPARK-8147: [~srowen] we want something similar to the follow

[jira] [Resolved] (SPARK-7042) Spark version of akka-actor_2.11 is not compatible with the official akka-actor_2.11 2.3.x

[ https://issues.apache.org/jira/browse/SPARK-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7042. -- Resolution: Fixed Issue resolved by pull request 6492 [https://github.com/apache/spark/pull/6492] > Spa

[jira] [Commented] (SPARK-8147) Add ability to decorate RDD iterators

[ https://issues.apache.org/jira/browse/SPARK-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576220#comment-14576220 ] Sean Owen commented on SPARK-8147: -- Hm, how does a wrapper manage this though? it can't c

[jira] [Created] (SPARK-8147) Add ability to decorate RDD iterators

Yuri Makhno created SPARK-8147: -- Summary: Add ability to decorate RDD iterators Key: SPARK-8147 URL: https://issues.apache.org/jira/browse/SPARK-8147 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-8136) AM link download test can be flaky

[ https://issues.apache.org/jira/browse/SPARK-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8136. -- Resolution: Fixed Fix Version/s: 1.5.0 > AM link download test can be flaky > ---

[jira] [Commented] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

[ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576168#comment-14576168 ] Cheng Lian commented on SPARK-2551: --- Made this a subtask of SPARK-5463. > Cleanup Filte

[jira] [Updated] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

[ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2551: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-5463 > Cleanup FilteringParquetRowInputFo

[jira] [Resolved] (SPARK-5451) And predicates are not properly pushed down

[ https://issues.apache.org/jira/browse/SPARK-5451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5451. --- Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Thomas Omans This issue is fixed by u

[jira] [Resolved] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-8118. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6670 [https://github.com/

[jira] [Updated] (SPARK-4118) Create python bindings for Streaming KMeans

[ https://issues.apache.org/jira/browse/SPARK-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-4118: --- Priority: Major (was: Minor) > Create python bindings for Streaming KMeans >

[jira] [Updated] (SPARK-4127) Streaming Linear Regression- Python bindings

[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-4127: --- Priority: Major (was: Minor) > Streaming Linear Regression- Python bindings > ---

[jira] [Resolved] (SPARK-8146) DataFrame Python API: Alias replace in DataFrameNaFunctions

[ https://issues.apache.org/jira/browse/SPARK-8146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8146. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 > DataFrame Python API: Alias

[jira] [Commented] (SPARK-8117) Push codegen into Expression

[ https://issues.apache.org/jira/browse/SPARK-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576146#comment-14576146 ] Apache Spark commented on SPARK-8117: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-4258) NPE with new Parquet Filters

[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576141#comment-14576141 ] Cheng Lian commented on SPARK-4258: --- SPARK-7743 fixes this by upgrading Parquet to 1.7.0

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4258: -- Fix Version/s: 1.5.0 > NPE with new Parquet Filters > > > K

[jira] [Resolved] (SPARK-4258) NPE with new Parquet Filters

[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-4258. --- Resolution: Fixed Assignee: Thomas Omans > NPE with new Parquet Filters > --

[jira] [Resolved] (SPARK-8141) Precompute datatypes for partition columns and reuse it

[ https://issues.apache.org/jira/browse/SPARK-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-8141. --- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8141) Precompute datatypes for partition columns and reuse it

[ https://issues.apache.org/jira/browse/SPARK-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8141: -- Affects Version/s: 1.4.0 > Precompute datatypes for partition columns and reuse it > ---

[jira] [Updated] (SPARK-8141) Precompute datatypes for partition columns and reuse it

[ https://issues.apache.org/jira/browse/SPARK-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8141: -- Assignee: Liang-Chi Hsieh > Precompute datatypes for partition columns and reuse it > --

[jira] [Commented] (SPARK-4258) NPE with new Parquet Filters

[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576138#comment-14576138 ] Cheng Lian commented on SPARK-4258: --- Yeah, actually we've just upgraded Parquet to 1.7.0