[jira] [Assigned] (SPARK-8850) Turn unsafe mode on by default

[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8850: --- Assignee: (was: Apache Spark) > Turn unsafe mode on by default >

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634630#comment-14634630 ] Apache Spark commented on SPARK-8850: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-8850) Turn unsafe mode on by default

[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8850: --- Assignee: Apache Spark > Turn unsafe mode on by default > -- > >

[jira] [Updated] (SPARK-9165) Implement code generation for CreateArray, CreateStruct, and CreateNamedStruct

[ https://issues.apache.org/jira/browse/SPARK-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9165: --- Assignee: Yijie Shen > Implement code generation for CreateArray, CreateStruct, and CreateNamedStruct

[jira] [Updated] (SPARK-9152) Implement code generation for Like and RLike

[ https://issues.apache.org/jira/browse/SPARK-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9152: --- Assignee: Liang-Chi Hsieh > Implement code generation for Like and RLike > ---

[jira] [Updated] (SPARK-9154) Implement code generation for StringFormat

[ https://issues.apache.org/jira/browse/SPARK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9154: --- Assignee: Tarek Auel > Implement code generation for StringFormat > --

[jira] [Resolved] (SPARK-9100) DataFrame reader/writer shortcut methods for ORC

[ https://issues.apache.org/jira/browse/SPARK-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-9100. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7444 [https://github.com/

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634652#comment-14634652 ] Reynold Xin commented on SPARK-9213: I think hbase/presto both use joni. We can look a

[jira] [Commented] (SPARK-8906) Move all internal data source related classes out of sources package

[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634655#comment-14634655 ] Apache Spark commented on SPARK-8906: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8906) Move all internal data source related classes out of sources package

[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8906: --- Assignee: (was: Apache Spark) > Move all internal data source related classes out of sour

[jira] [Assigned] (SPARK-8906) Move all internal data source related classes out of sources package

[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8906: --- Assignee: Apache Spark > Move all internal data source related classes out of sources package

[jira] [Assigned] (SPARK-8906) Move all internal data source related classes out of sources package

[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-8906: -- Assignee: Reynold Xin > Move all internal data source related classes out of sources package >

[jira] [Assigned] (SPARK-8850) Turn unsafe mode on by default

[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-8850: - Assignee: Josh Rosen > Turn unsafe mode on by default > -- > >

[jira] [Commented] (SPARK-9162) Implement code generation for ScalaUDF

[ https://issues.apache.org/jira/browse/SPARK-9162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634671#comment-14634671 ] Josh Rosen commented on SPARK-9162: --- Marking this as a blocker of SPARK-8850, the ticket

[jira] [Resolved] (SPARK-8256) string function: regexp_replace

[ https://issues.apache.org/jira/browse/SPARK-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8256. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7468 [https://github.com/

[jira] [Resolved] (SPARK-8255) string function: regexp_extract

[ https://issues.apache.org/jira/browse/SPARK-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8255. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7468 [https://github.com/

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634716#comment-14634716 ] Yu Ishikawa commented on SPARK-9121: Even though I had changed the code as follows, th

[jira] [Resolved] (SPARK-8230) complex function: size

[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8230. Resolution: Fixed Assignee: Pedro Rodriguez (was: Cheng Hao) Fix Version/s: 1.5.0 >

[jira] [Comment Edited] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634716#comment-14634716 ] Yu Ishikawa edited comment on SPARK-9121 at 7/21/15 7:54 AM: -

[jira] [Resolved] (SPARK-9173) UnionPushDown should also support Intersect and Except in addition to Union

[ https://issues.apache.org/jira/browse/SPARK-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9173. Resolution: Fixed Assignee: Yijie Shen Fix Version/s: 1.5.0 > UnionPushDown should a

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634733#comment-14634733 ] Yu Ishikawa commented on SPARK-9121: Ah, I could avoid the warnings to call {{expect_e

[jira] [Updated] (SPARK-9199) Upgrade Tachyon dependency to 0.7.0

[ https://issues.apache.org/jira/browse/SPARK-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoyuan Li updated SPARK-9199: -- Assignee: Calvin Jia > Upgrade Tachyon dependency to 0.7.0 > --- > >

[jira] [Resolved] (SPARK-8875) Shuffle code cleanup: remove BlockStoreShuffleFetcher class

[ https://issues.apache.org/jira/browse/SPARK-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8875. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7268 [https://github.com/

[jira] [Commented] (SPARK-9197) Cached RDD partitions are lost when executors are dynamically deallocated

[ https://issues.apache.org/jira/browse/SPARK-9197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634748#comment-14634748 ] Kostas Sakellis commented on SPARK-9197: I think this is a duplicate of: https://i

[jira] [Created] (SPARK-9214) support ml.NaiveBayes for Python

Yanbo Liang created SPARK-9214: -- Summary: support ml.NaiveBayes for Python Key: SPARK-9214 URL: https://issues.apache.org/jira/browse/SPARK-9214 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634751#comment-14634751 ] Apache Spark commented on SPARK-9121: - User 'yu-iskw' has created a pull request for t

[jira] [Assigned] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9121: --- Assignee: (was: Apache Spark) > Get rid of the warnings about `no visible global function

[jira] [Assigned] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9121: --- Assignee: Apache Spark > Get rid of the warnings about `no visible global function definition

[jira] [Assigned] (SPARK-9214) support ml.NaiveBayes for Python

[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9214: --- Assignee: Apache Spark > support ml.NaiveBayes for Python >

[jira] [Commented] (SPARK-9214) support ml.NaiveBayes for Python

[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634759#comment-14634759 ] Apache Spark commented on SPARK-9214: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-9214) support ml.NaiveBayes for Python

[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9214: --- Assignee: (was: Apache Spark) > support ml.NaiveBayes for Python > --

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634761#comment-14634761 ] Yu Ishikawa commented on SPARK-9121: Actually, we could get rid of the warnings. But i

[jira] [Resolved] (SPARK-9197) Cached RDD partitions are lost when executors are dynamically deallocated

[ https://issues.apache.org/jira/browse/SPARK-9197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9197. -- Resolution: Duplicate > Cached RDD partitions are lost when executors are dynamically deallocated >

[jira] [Commented] (SPARK-9195) RDD/Storage metrics don't update cached partition counts when executors are removed/lost

[ https://issues.apache.org/jira/browse/SPARK-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634783#comment-14634783 ] Sean Owen commented on SPARK-9195: -- Just linking the JIRAs to record I suspect it's the s

[jira] [Updated] (SPARK-9137) Unified label verification for Classifier

[ https://issues.apache.org/jira/browse/SPARK-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9137: --- Summary: Unified label verification for Classifier (was: Unified label verification for Predictor) >

[jira] [Updated] (SPARK-9137) Unified label verification for Classifier

[ https://issues.apache.org/jira/browse/SPARK-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9137: --- Description: We should to check label valid before training model for ml.classification such as Logist

[jira] [Updated] (SPARK-9210) checkValidAggregateExpression() throws exceptions with bad error messages

[ https://issues.apache.org/jira/browse/SPARK-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9210: - Priority: Trivial (was: Minor) > checkValidAggregateExpression() throws exceptions with bad error message

[jira] [Resolved] (SPARK-5450) Add APIs to save a graph as a SequenceFile and load it

[ https://issues.apache.org/jira/browse/SPARK-5450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5450. -- Resolution: Won't Fix > Add APIs to save a graph as a SequenceFile and load it > ---

[jira] [Resolved] (SPARK-5352) Add getPartitionStrategy in Graph

[ https://issues.apache.org/jira/browse/SPARK-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5352. -- Resolution: Won't Fix > Add getPartitionStrategy in Graph > - > >

[jira] [Resolved] (SPARK-6281) Support incremental updates for Graph

[ https://issues.apache.org/jira/browse/SPARK-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6281. -- Resolution: Won't Fix > Support incremental updates for Graph > - >

[jira] [Updated] (SPARK-9066) Improve cartesian performance

[ https://issues.apache.org/jira/browse/SPARK-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-9066: Description: Currently, for CartesianProduct, if right plan partition record number are small than left par

[jira] [Updated] (SPARK-9066) Improve cartesian performance

[ https://issues.apache.org/jira/browse/SPARK-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-9066: Description: Currently, for CartesianProduct, if right plan partition record number are small than left par

[jira] [Created] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

Tathagata Das created SPARK-9215: Summary: Implement WAL-free Kinesis receiver that give at-least once guarantee Key: SPARK-9215 URL: https://issues.apache.org/jira/browse/SPARK-9215 Project: Spark

[jira] [Updated] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

[ https://issues.apache.org/jira/browse/SPARK-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9215: - Description: https://docs.google.com/document/d/1k0dl270EnK7uExrsCE7jYw7PYx0YC935uBcxn3p0f58/edit?

[jira] [Created] (SPARK-9216) Defined KinesisBackedBlockRDDs

Tathagata Das created SPARK-9216: Summary: Defined KinesisBackedBlockRDDs Key: SPARK-9216 URL: https://issues.apache.org/jira/browse/SPARK-9216 Project: Spark Issue Type: Sub-task C

[jira] [Commented] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

[ https://issues.apache.org/jira/browse/SPARK-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634888#comment-14634888 ] Tathagata Das commented on SPARK-9215: -- [~c...@koeninger.org] [~jerryshao] [~hshreedh

[jira] [Updated] (SPARK-9216) Define KinesisBackedBlockRDDs

[ https://issues.apache.org/jira/browse/SPARK-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9216: - Summary: Define KinesisBackedBlockRDDs (was: Defined KinesisBackedBlockRDDs) > Define KinesisBac

[jira] [Created] (SPARK-9217) Update Kinesis Receiver to record sequence numbers

Tathagata Das created SPARK-9217: Summary: Update Kinesis Receiver to record sequence numbers Key: SPARK-9217 URL: https://issues.apache.org/jira/browse/SPARK-9217 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9059) Update Python Direct Kafka Word count examples to show the use of HasOffsetRanges

[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9059: - Priority: Minor (was: Major) Description: Update Python examples of Direct Kafka word count to acc

[jira] [Resolved] (SPARK-8401) Build system scala version selection script fails on Mac OS X

[ https://issues.apache.org/jira/browse/SPARK-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8401. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6832 [https://github.com/ap

[jira] [Updated] (SPARK-8401) Build system scala version selection script fails on Mac OS X

[ https://issues.apache.org/jira/browse/SPARK-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8401: - Assignee: Michael Allman Priority: Minor (was: Major) > Build system scala version selection script f

[jira] [Issue Comment Deleted] (SPARK-9131) UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Guerra updated SPARK-9131: --- Comment: was deleted (was: It seems the odd result depends on the size of the dataset. I am trying to

[jira] [Commented] (SPARK-9131) UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634912#comment-14634912 ] Luis Guerra commented on SPARK-9131: It seems the odd result depends on the size of th

[jira] [Commented] (SPARK-9131) UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634913#comment-14634913 ] Luis Guerra commented on SPARK-9131: It seems the odd result depends on the size of th

[jira] [Commented] (SPARK-9122) spark.mllib regression should support batch predict

[ https://issues.apache.org/jira/browse/SPARK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634918#comment-14634918 ] Yanbo Liang commented on SPARK-9122: [~josephkb] I will work on it~ > spark.mllib reg

[jira] [Created] (SPARK-9218) Falls back to getAllPartitions when getPartitionsByFilter fails

Cheng Lian created SPARK-9218: - Summary: Falls back to getAllPartitions when getPartitionsByFilter fails Key: SPARK-9218 URL: https://issues.apache.org/jira/browse/SPARK-9218 Project: Spark Issu

[jira] [Updated] (SPARK-9120) Add multivariate regression (or prediction) interface

[ https://issues.apache.org/jira/browse/SPARK-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-9120: Description: org.apache.spark.ml.regression.RegressionModel supports prediction only for a

[jira] [Commented] (SPARK-9192) add initialization phase for expression

[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14634976#comment-14634976 ] Cheng Lian commented on SPARK-9192: --- Could you please provide some context and motivatio

[jira] [Updated] (SPARK-9120) Add multivariate regression (or prediction) interface

[ https://issues.apache.org/jira/browse/SPARK-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-9120: Description: org.apache.spark.ml.regression.RegressionModel supports prediction only for a

[jira] [Created] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

Mohsen Zainalpour created SPARK-9219: Summary: ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD Key: SPARK-9219 URL: https://issues.apache.org/jira/browse/SPARK-9219 Project

[jira] [Comment Edited] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635027#comment-14635027 ] Yijie Shen edited comment on SPARK-9183 at 7/21/15 12:23 PM: -

[jira] [Commented] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635027#comment-14635027 ] Yijie Shen commented on SPARK-9183: --- [~joshrosen] I can't reproduce this NPE, I've tried

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635030#comment-14635030 ] Sean Owen commented on SPARK-9219: -- More info please, like, how to reproduce this? > Cla

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635063#comment-14635063 ] Mohsen Zainalpour commented on SPARK-9219: -- I compiled Spark 1.4.1 with Scala 2.1

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635067#comment-14635067 ] Sean Owen commented on SPARK-9219: -- I suspect it's because you are mixing two versions of

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635085#comment-14635085 ] Mohsen Zainalpour commented on SPARK-9219: -- I my dependency list, I explicitly me

[jira] [Comment Edited] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635085#comment-14635085 ] Mohsen Zainalpour edited comment on SPARK-9219 at 7/21/15 1:11 PM: -

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635088#comment-14635088 ] Sean Owen commented on SPARK-9219: -- Possible problems: you aren't marking the dependency

[jira] [Commented] (SPARK-8695) TreeAggregation shouldn't be triggered when it doesn't save wall-clock time

[ https://issues.apache.org/jira/browse/SPARK-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635099#comment-14635099 ] Apache Spark commented on SPARK-8695: - User 'piganesh' has created a pull request for

[jira] [Commented] (SPARK-3157) Avoid duplicated stats in DecisionTree extractLeftRightNodeAggregates

[ https://issues.apache.org/jira/browse/SPARK-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635117#comment-14635117 ] Perinkulam I Ganesh commented on SPARK-3157: This function has been removed un

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635135#comment-14635135 ] Mohsen Zainalpour commented on SPARK-9219: -- yes that`s the reason! I`m not markin

[jira] [Resolved] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9219. -- Resolution: Not A Problem > ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD > --

[jira] [Updated] (SPARK-9192) add initialization phase for expression

[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9192: --- Description: Some expressions have mutable states and need to be initialized first(like Rand, WeekOfY

[jira] [Updated] (SPARK-7712) Window Function Improvements

[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-7712: - External issue URL: (was: https://github.com/hvanhovell/spark-window) > Window Function

[jira] [Updated] (SPARK-7712) Window Function Improvements

[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-7712: - Summary: Window Function Improvements (was: Native Spark Window Functions & Performance I

[jira] [Updated] (SPARK-7712) Window Function Improvements

[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-7712: - Description: This is an umbrella ticket for Window Function Improvements targetted at SPAR

[jira] [Updated] (SPARK-9192) add initialization phase for expression

[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9192: --- Description: Some expressions have mutable states and need to be initialized first(like Rand, WeekOfY

[jira] [Commented] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

[ https://issues.apache.org/jira/browse/SPARK-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635179#comment-14635179 ] Cody Koeninger commented on SPARK-9215: --- I left some comments in the doc. Is Chris

[jira] [Updated] (SPARK-8641) Native Spark Window Functions

[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-8641: - Description: The current Window implementation uses Hive UDAFs for all aggregation operat

[jira] [Created] (SPARK-9220) Streaming K-means implementation exception while processing windowed stream

Iaroslav Zeigerman created SPARK-9220: - Summary: Streaming K-means implementation exception while processing windowed stream Key: SPARK-9220 URL: https://issues.apache.org/jira/browse/SPARK-9220 P

[jira] [Commented] (SPARK-8641) Native Spark Window Functions

[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635205#comment-14635205 ] Herman van Hovell commented on SPARK-8641: -- We need to wait for the new UDAF inte

[jira] [Updated] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-9019: -- Attachment: debug-log-spark-1.5-fail spark-submit-log-1.5.0-fail > spark-submit

[jira] [Commented] (SPARK-9220) Streaming K-means implementation exception while processing windowed stream

[ https://issues.apache.org/jira/browse/SPARK-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635240#comment-14635240 ] Iaroslav Zeigerman commented on SPARK-9220: --- Looks like the issue reproduces onl

[jira] [Resolved] (SPARK-9081) fillna/dropna should also fill/drop NaN values in addition to null values

[ https://issues.apache.org/jira/browse/SPARK-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9081. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7523 [https://github.com/

[jira] [Resolved] (SPARK-9168) Add nanvl expression

[ https://issues.apache.org/jira/browse/SPARK-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9168. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7523 [https://github.com/

[jira] [Created] (SPARK-9221) Support IntervalType in Range Frame

Herman van Hovell created SPARK-9221: Summary: Support IntervalType in Range Frame Key: SPARK-9221 URL: https://issues.apache.org/jira/browse/SPARK-9221 Project: Spark Issue Type: Sub-tas

[jira] [Resolved] (SPARK-8915) Add @since tags to mllib.classification

[ https://issues.apache.org/jira/browse/SPARK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8915. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7371 [https://githu

[jira] [Updated] (SPARK-8915) Add @since tags to mllib.classification

[ https://issues.apache.org/jira/browse/SPARK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8915: - Assignee: Xiangrui Meng > Add @since tags to mllib.classification > --

[jira] [Updated] (SPARK-8915) Add @since tags to mllib.classification

[ https://issues.apache.org/jira/browse/SPARK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8915: - Assignee: Patrick Baier (was: Xiangrui Meng) > Add @since tags to mllib.classification >

[jira] [Updated] (SPARK-8922) Add @since tags to mllib.evaluation

[ https://issues.apache.org/jira/browse/SPARK-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8922: - Shepherd: Shuo Xiang > Add @since tags to mllib.evaluation > --- >

[jira] [Updated] (SPARK-8915) Add @since tags to mllib.classification

[ https://issues.apache.org/jira/browse/SPARK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8915: - Shepherd: DB Tsai > Add @since tags to mllib.classification >

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635300#comment-14635300 ] Shivaram Venkataraman commented on SPARK-9121: -- Yeah we can add `install-dev.

[jira] [Resolved] (SPARK-9193) Avoid assigning tasks to executors under killing

[ https://issues.apache.org/jira/browse/SPARK-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-9193. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7528 [https://github.

[jira] [Closed] (SPARK-9036) SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

[ https://issues.apache.org/jira/browse/SPARK-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9036. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > SparkListenerExecutorMetri

[jira] [Updated] (SPARK-9193) Avoid assigning tasks to executors under killing

[ https://issues.apache.org/jira/browse/SPARK-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-9193: Fix Version/s: 1.4.2 > Avoid assigning tasks to executors under killing > --

[jira] [Closed] (SPARK-9128) Get outerclasses and objects at the same time in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-9128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9128. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Get outerclasses and objec

[jira] [Updated] (SPARK-7171) Allow for more flexible use of metric sources

[ https://issues.apache.org/jira/browse/SPARK-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7171: - Assignee: Jacek Lewandowski > Allow for more flexible use of metric sources >

[jira] [Closed] (SPARK-7171) Allow for more flexible use of metric sources

[ https://issues.apache.org/jira/browse/SPARK-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7171. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Allow for more flexible us

[jira] [Closed] (SPARK-4598) Paginate stage page to avoid OOM with > 100,000 tasks

[ https://issues.apache.org/jira/browse/SPARK-4598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4598. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 Target Version/s:

[jira] [Closed] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

[ https://issues.apache.org/jira/browse/SPARK-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5423. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > ExternalAppendOnlyMap won'

  1   2   3   >