[jira] [Commented] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702604#comment-14702604 ] Shivaram Venkataraman commented on SPARK-4888: -- Yeah we can definitely do a f

[jira] [Commented] (SPARK-9357) Remove JoinedRow

[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702603#comment-14702603 ] Cheng Hao commented on SPARK-9357: -- JoinedRow is probably in high efficiency for case lik

[jira] [Commented] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702599#comment-14702599 ] Jie Huang commented on SPARK-9552: -- [~andrewor14] any comment for this bug? > Add force

[jira] [Commented] (SPARK-7218) Create a real iterator with open/close for Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702584#comment-14702584 ] Cheng Hao commented on SPARK-7218: -- Can you give some BKM for this task? > Create a real

[jira] [Resolved] (SPARK-10099) Use @deprecated instead of @Deprecated in Scala code

[ https://issues.apache.org/jira/browse/SPARK-10099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-10099. --- Resolution: Fixed Fix Version/s: 1.5.0 > Use @deprecated instead of @Deprecated in Sca

[jira] [Resolved] (SPARK-9967) Rename the SparkConf property to spark.streaming.backpressure.{enable --> enabled}

[ https://issues.apache.org/jira/browse/SPARK-9967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9967. -- Resolution: Fixed Fix Version/s: 1.5.0 > Rename the SparkConf property to spark.streaming

[jira] [Commented] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702575#comment-14702575 ] Sean Owen commented on SPARK-4888: -- [~shivaram] what do you think of the state of a lot o

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702563#comment-14702563 ] Yu Ishikawa commented on SPARK-9427: I see. Thank you for letting me know. > Add exp

[jira] [Commented] (SPARK-9911) User guide for MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702559#comment-14702559 ] Apache Spark commented on SPARK-9911: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-9911) User guide for MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9911: --- Assignee: Manoj Kumar (was: Apache Spark) > User guide for MulticlassClassificationEvaluator

[jira] [Assigned] (SPARK-9911) User guide for MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9911: --- Assignee: Apache Spark (was: Manoj Kumar) > User guide for MulticlassClassificationEvaluator

[jira] [Commented] (SPARK-6813) SparkR style guide

[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702556#comment-14702556 ] Yu Ishikawa commented on SPARK-6813: We did it. I appreciate your support. > SparkR s

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702552#comment-14702552 ] Yu Ishikawa commented on SPARK-9427: Alright. > Add expression functions in SparkR >

[jira] [Updated] (SPARK-10099) Use @deprecated instead of @Deprecated in Scala code

[ https://issues.apache.org/jira/browse/SPARK-10099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10099: Assignee: Tathagata Das (was: Xiangrui Meng) > Use @deprecated instead of @Deprecated in Scala cod

[jira] [Updated] (SPARK-9427) Add expression functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9427: - Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) > Add expression functions in SparkR

[jira] [Updated] (SPARK-6840) SparkR: private package functions unavailable when using lapplyPartition in package

[ https://issues.apache.org/jira/browse/SPARK-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6840: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > SparkR: private package functions u

[jira] [Updated] (SPARK-6834) Failed with error: ‘invalid package name’ Error in as.name(name) : attempt to use zero-length variable name

[ https://issues.apache.org/jira/browse/SPARK-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6834: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Failed with error: ‘invalid package

[jira] [Updated] (SPARK-6837) SparkR failure in processClosure

[ https://issues.apache.org/jira/browse/SPARK-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6837: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > SparkR failure in processClosure >

[jira] [Commented] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702533#comment-14702533 ] Shivaram Venkataraman commented on SPARK-4888: -- I'm removing a target version

[jira] [Updated] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-4888: - Target Version/s: (was: 1.5.0) > Spark EC2 doesn't mount local disks for i2.8xla

[jira] [Commented] (SPARK-6192) Enhance MLlib's Python API (GSoC 2015)

[ https://issues.apache.org/jira/browse/SPARK-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702528#comment-14702528 ] Reynold Xin commented on SPARK-6192: Is this one completely done? > Enhance MLlib's

[jira] [Updated] (SPARK-6826) `hashCode` support for arbitrary R objects

[ https://issues.apache.org/jira/browse/SPARK-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6826: - Target Version/s: (was: 1.5.0) > `hashCode` support for arbitrary R objects > --

[jira] [Updated] (SPARK-6822) lapplyPartition passes empty list to function

[ https://issues.apache.org/jira/browse/SPARK-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6822: - Target Version/s: (was: 1.5.0) > lapplyPartition passes empty list to function >

[jira] [Updated] (SPARK-7465) DAG visualization: RDD dependencies not always shown

[ https://issues.apache.org/jira/browse/SPARK-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7465: --- Target Version/s: 1.6.0 (was: 1.5.0) > DAG visualization: RDD dependencies not always shown > ---

[jira] [Updated] (SPARK-6814) Support sorting for any data type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-6814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6814: - Target Version/s: (was: 1.5.0) > Support sorting for any data type in SparkR > -

[jira] [Updated] (SPARK-7471) DAG visualization: show call site information

[ https://issues.apache.org/jira/browse/SPARK-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7471: --- Target Version/s: 1.6.0 (was: 1.5.0) > DAG visualization: show call site information > --

[jira] [Resolved] (SPARK-6813) SparkR style guide

[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6813. -- Resolution: Fixed Assignee: Yu Ishikawa Fix Version/s: 1.5.0 I'm

[jira] [Updated] (SPARK-7349) DAG visualization: add legend to explain the content

[ https://issues.apache.org/jira/browse/SPARK-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7349: --- Target Version/s: 1.6.0 (was: 1.5.0) > DAG visualization: add legend to explain the content > ---

[jira] [Comment Edited] (SPARK-7178) Improve DataFrame documentation and code samples

[ https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702520#comment-14702520 ] Reynold Xin edited comment on SPARK-7178 at 8/19/15 5:37 AM: -

[jira] [Updated] (SPARK-7041) Avoid writing empty files in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7041: --- Target Version/s: 1.6.0 (was: 1.5.0) > Avoid writing empty files in BypassMergeSortShuffleWriter > --

[jira] [Updated] (SPARK-7463) DAG visualization improvements

[ https://issues.apache.org/jira/browse/SPARK-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7463: --- Target Version/s: 1.6.0 (was: 1.5.0) > DAG visualization improvements > -

[jira] [Updated] (SPARK-7025) Create a Java-friendly input source API

[ https://issues.apache.org/jira/browse/SPARK-7025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7025: --- Target Version/s: 1.6.0 (was: 1.5.0) > Create a Java-friendly input source API >

[jira] [Updated] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7780: --- Target Version/s: 1.6.0 (was: 1.5.0) > The intercept in LogisticRegressionWithLBFGS should not be regularized

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7348: --- Target Version/s: 1.6.0 (was: 1.5.0) > DAG visualization: add links to RDD page > ---

[jira] [Closed] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-7355. -- Resolution: Later > FlakyTest - o.a.s.DriverSuite > - > > Ke

[jira] [Closed] (SPARK-7178) Improve DataFrame documentation and code samples

[ https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-7178. -- Resolution: Duplicate Closing this one since we will update DataFrame documentation in other tickets.

[jira] [Resolved] (SPARK-8496) Do not run slow tests for every PR

[ https://issues.apache.org/jira/browse/SPARK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8496. Resolution: Later > Do not run slow tests for every PR > -- > >

[jira] [Closed] (SPARK-7416) Shuffle performance metrics umbrella

[ https://issues.apache.org/jira/browse/SPARK-7416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-7416. -- Resolution: Later > Shuffle performance metrics umbrella > > >

[jira] [Updated] (SPARK-8496) Do not run slow tests for every PR

[ https://issues.apache.org/jira/browse/SPARK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8496: --- Target Version/s: (was: 1.6.0) > Do not run slow tests for every PR > --

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702519#comment-14702519 ] Shivaram Venkataraman commented on SPARK-9427: -- [~yuu.ishik...@gmail.com] I r

[jira] [Updated] (SPARK-9654) Add IndexToString in Pyspark

[ https://issues.apache.org/jira/browse/SPARK-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9654: --- Target Version/s: 1.6.0 (was: 1.5.0) > Add IndexToString in Pyspark > >

[jira] [Updated] (SPARK-8496) Do not run slow tests for every PR

[ https://issues.apache.org/jira/browse/SPARK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8496: --- Target Version/s: 1.6.0 (was: 1.5.0) > Do not run slow tests for every PR > -

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9972: - Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) > Add `struct`, `encode` and `decode`

[jira] [Assigned] (SPARK-10106) Add `ifelse` Column function to SparkR

[ https://issues.apache.org/jira/browse/SPARK-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10106: Assignee: Apache Spark > Add `ifelse` Column function to SparkR >

[jira] [Commented] (SPARK-10106) Add `ifelse` Column function to SparkR

[ https://issues.apache.org/jira/browse/SPARK-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702515#comment-14702515 ] Apache Spark commented on SPARK-10106: -- User 'yu-iskw' has created a pull request fo

[jira] [Updated] (SPARK-9857) Add expression functions into SparkR which conflict with the existing R's generic

[ https://issues.apache.org/jira/browse/SPARK-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9857: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Add expression functions into Spark

[jira] [Assigned] (SPARK-10106) Add `ifelse` Column function to SparkR

[ https://issues.apache.org/jira/browse/SPARK-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10106: Assignee: (was: Apache Spark) > Add `ifelse` Column function to SparkR > -

[jira] [Updated] (SPARK-10079) Make `column` and `col` functions be S4 functions

[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10079: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Make `column` and `col` function

[jira] [Resolved] (SPARK-9952) Fix N^2 loop when DAGScheduler.getPreferredLocsInternal accesses cacheLocs

[ https://issues.apache.org/jira/browse/SPARK-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9952. Resolution: Fixed Fix Version/s: 1.5.0 > Fix N^2 loop when DAGScheduler.getPreferredLocsInter

[jira] [Updated] (SPARK-6798) Fix Date serialization in SparkR

[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6798: - Target Version/s: (was: 1.5.0) > Fix Date serialization in SparkR >

[jira] [Updated] (SPARK-9302) collect()/head() failed with JSON of some format

[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Target Version/s: (was: 1.5.0) > collect()/head() failed with JSON of some forma

[jira] [Updated] (SPARK-9302) Handle complex JSON types in collect()/head()

[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Summary: Handle complex JSON types in collect()/head() (was: collect()/head() fai

[jira] [Commented] (SPARK-8469) Application timeline view unreadable with many executors

[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702511#comment-14702511 ] Andrew Or commented on SPARK-8469: -- I've spoken with a few actual dynamic allocation user

[jira] [Updated] (SPARK-9302) collect()/head() failed with JSON of some format

[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Issue Type: Improvement (was: Bug) > collect()/head() failed with JSON of some fo

[jira] [Commented] (SPARK-9302) collect()/head() failed with JSON of some format

[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702510#comment-14702510 ] Shivaram Venkataraman commented on SPARK-9302: -- There is a PR open that I thi

[jira] [Updated] (SPARK-10106) Add `ifelse` Column function to SparkR

[ https://issues.apache.org/jira/browse/SPARK-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10106: Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Add `ifelse` Column function to SparkR > ---

[jira] [Updated] (SPARK-10043) Add window functions into SparkR

[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10043: Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) > Add window functions into SparkR > -

[jira] [Updated] (SPARK-10043) Add window functions into SparkR

[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10043: Target Version/s: 1.6.0 (was: 1.5.0) > Add window functions into SparkR >

[jira] [Updated] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10058: Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Flaky test: HeartbeatReceiverSuite: normal heartbeat

[jira] [Closed] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-7689. -- Resolution: Later > Deprecate spark.cleaner.ttl > --- > > Key: S

[jira] [Commented] (SPARK-7992) Hide private classes/objects in in generated Java API doc

[ https://issues.apache.org/jira/browse/SPARK-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702500#comment-14702500 ] Reynold Xin commented on SPARK-7992: [~mengxr] what's going on with this one? > Hide

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702501#comment-14702501 ] Reynold Xin commented on SPARK-7780: I'm assuming this is going to 1.6 / 1.5.1? > Th

[jira] [Updated] (SPARK-8115) Remove TestData

[ https://issues.apache.org/jira/browse/SPARK-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8115: --- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Remove TestData > --- > > K

[jira] [Resolved] (SPARK-8445) MLlib 1.5 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8445. Resolution: Fixed Fix Version/s: 1.5.0 Closing this one since 1.5 is almost over :) > MLlib

[jira] [Commented] (SPARK-8521) Feature Transformers in 1.5

[ https://issues.apache.org/jira/browse/SPARK-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702488#comment-14702488 ] Reynold Xin commented on SPARK-8521: Can we close this one or move the undone one to 1

[jira] [Updated] (SPARK-8469) Application timeline view unreadable with many executors

[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8469: --- Target Version/s: 1.6.0 (was: 1.5.0) > Application timeline view unreadable with many executors > ---

[jira] [Commented] (SPARK-8580) Add Parquet files generated by different systems to test interoperability and compatibility

[ https://issues.apache.org/jira/browse/SPARK-8580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702486#comment-14702486 ] Reynold Xin commented on SPARK-8580: If you add this last minute we can include it in

[jira] [Updated] (SPARK-8966) Design a mechanism to ensure that temporary files created in tasks are cleaned up after failures

[ https://issues.apache.org/jira/browse/SPARK-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8966: --- Parent Issue: SPARK-9697 (was: SPARK-9565) > Design a mechanism to ensure that temporary files create

[jira] [Updated] (SPARK-8580) Add Parquet files generated by different systems to test interoperability and compatibility

[ https://issues.apache.org/jira/browse/SPARK-8580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8580: --- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Add Parquet files generated by different systems to tes

[jira] [Updated] (SPARK-8716) Write tests for executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8716: --- Target Version/s: 1.6.0 (was: 1.5.0) > Write tests for executor shared cache feature > --

[jira] [Updated] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8939: --- Target Version/s: 1.5.1 (was: 1.5.0) > YARN EC2 default setting fails with IllegalArgumentException >

[jira] [Updated] (SPARK-8966) Design a mechanism to ensure that temporary files created in tasks are cleaned up after failures

[ https://issues.apache.org/jira/browse/SPARK-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8966: --- Target Version/s: 1.6.0 (was: 1.5.0) > Design a mechanism to ensure that temporary files created in t

[jira] [Updated] (SPARK-8987) Increase test coverage of DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8987: --- Target Version/s: 1.6.0 (was: 1.5.0) > Increase test coverage of DAGScheduler > -

[jira] [Updated] (SPARK-9026) SimpleFutureAction.onComplete should not tie up a separate thread for each callback

[ https://issues.apache.org/jira/browse/SPARK-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9026: --- Target Version/s: 1.6.0 (was: 1.5.0) > SimpleFutureAction.onComplete should not tie up a separate thr

[jira] [Updated] (SPARK-9158) PyLint should only fail on error

[ https://issues.apache.org/jira/browse/SPARK-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9158: --- Target Version/s: 1.6.0 (was: 1.5.0) > PyLint should only fail on error > ---

[jira] [Commented] (SPARK-9302) collect()/head() failed with JSON of some format

[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702478#comment-14702478 ] Reynold Xin commented on SPARK-9302: [~shivaram] is this targeted for 1.5? > collect

[jira] [Updated] (SPARK-9226) Change default log level to WARN in python REPL

[ https://issues.apache.org/jira/browse/SPARK-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9226: --- Target Version/s: 1.6.0 (was: 1.5.0) > Change default log level to WARN in python REPL >

[jira] [Commented] (SPARK-9226) Change default log level to WARN in python REPL

[ https://issues.apache.org/jira/browse/SPARK-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702477#comment-14702477 ] Reynold Xin commented on SPARK-9226: [~alope107] do you want to submit a pull request

[jira] [Updated] (SPARK-9226) Change default log level to WARN in python REPL

[ https://issues.apache.org/jira/browse/SPARK-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9226: --- Fix Version/s: (was: 1.5.0) > Change default log level to WARN in python REPL > --

[jira] [Resolved] (SPARK-9508) Align graphx programming guide with the updated Pregel code

[ https://issues.apache.org/jira/browse/SPARK-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9508. Resolution: Fixed Assignee: Alexander Ulanov Fix Version/s: (was: 1.4.0)

[jira] [Updated] (SPARK-9545) Run Maven tests in pull request builder if title has "[maven-test]" in it

[ https://issues.apache.org/jira/browse/SPARK-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9545: --- Target Version/s: 1.6.0 (was: 1.5.0) > Run Maven tests in pull request builder if title has "[maven-t

[jira] [Resolved] (SPARK-9705) outdated Python 3 and IPython information

[ https://issues.apache.org/jira/browse/SPARK-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9705. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.5.0 > outdated Python 3 and

[jira] [Resolved] (SPARK-10093) Invalid transformations for TungstenProject of struct type

[ https://issues.apache.org/jira/browse/SPARK-10093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10093. - Resolution: Fixed Fix Version/s: 1.5.0 > Invalid transformations for TungstenProject of st

[jira] [Resolved] (SPARK-10096) CreateStruct/CreateArray/CreateNamedStruct broken with UDFs

[ https://issues.apache.org/jira/browse/SPARK-10096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10096. - Resolution: Fixed Fix Version/s: 1.5.0 > CreateStruct/CreateArray/CreateNamedStruct broken

[jira] [Updated] (SPARK-10106) Add `ifelse` Column function to SparkR

[ https://issues.apache.org/jira/browse/SPARK-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-10106: Description: Add a column function on a DataFrame like `ifelse` in R to SparkR. I guess we could im

[jira] [Created] (SPARK-10106) Add `ifelse` Column function to SparkR

Yu Ishikawa created SPARK-10106: --- Summary: Add `ifelse` Column function to SparkR Key: SPARK-10106 URL: https://issues.apache.org/jira/browse/SPARK-10106 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-10105) Adding most k frequent words parameter to Word2Vec implementation

[ https://issues.apache.org/jira/browse/SPARK-10105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10105: Assignee: Apache Spark > Adding most k frequent words parameter to Word2Vec implementation

[jira] [Commented] (SPARK-10105) Adding most k frequent words parameter to Word2Vec implementation

[ https://issues.apache.org/jira/browse/SPARK-10105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702412#comment-14702412 ] Apache Spark commented on SPARK-10105: -- User 'tmnd1991' has created a pull request f

[jira] [Assigned] (SPARK-10105) Adding most k frequent words parameter to Word2Vec implementation

[ https://issues.apache.org/jira/browse/SPARK-10105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10105: Assignee: (was: Apache Spark) > Adding most k frequent words parameter to Word2Vec imp

[jira] [Assigned] (SPARK-10073) Python withColumn for existing column name not consistent with scala

[ https://issues.apache.org/jira/browse/SPARK-10073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10073: Assignee: Davies Liu (was: Apache Spark) > Python withColumn for existing column name not

[jira] [Commented] (SPARK-10073) Python withColumn for existing column name not consistent with scala

[ https://issues.apache.org/jira/browse/SPARK-10073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702408#comment-14702408 ] Apache Spark commented on SPARK-10073: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-10073) Python withColumn for existing column name not consistent with scala

[ https://issues.apache.org/jira/browse/SPARK-10073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10073: Assignee: Apache Spark (was: Davies Liu) > Python withColumn for existing column name not

[jira] [Updated] (SPARK-10087) In some cases, all reducers are scheduled to the same executor

[ https://issues.apache.org/jira/browse/SPARK-10087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10087: - Target Version/s: 1.6.0 > In some cases, all reducers are scheduled to the same executor > --

[jira] [Updated] (SPARK-10100) AggregateFunction2's Max is slower than AggregateExpression1's MaxFunction

[ https://issues.apache.org/jira/browse/SPARK-10100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10100: - Assignee: Herman van Hovell (was: Yin Huai) > AggregateFunction2's Max is slower than AggregateExpressio

[jira] [Commented] (SPARK-10100) AggregateFunction2's Max is slower than AggregateExpression1's MaxFunction

[ https://issues.apache.org/jira/browse/SPARK-10100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702398#comment-14702398 ] Yin Huai commented on SPARK-10100: -- [~hvanhovell] How's the performance? > AggregateFun

[jira] [Resolved] (SPARK-10095) Should not use the private field of BigInteger

[ https://issues.apache.org/jira/browse/SPARK-10095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10095. Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8286 [https://github.c

[jira] [Commented] (SPARK-9627) SQL job failed if the dataframe with string columns is cached

[ https://issues.apache.org/jira/browse/SPARK-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702390#comment-14702390 ] Davies Liu commented on SPARK-9627: --- I can reproduce it with latest master. > SQL job f

[jira] [Commented] (SPARK-9627) SQL job failed if the dataframe with string columns is cached

[ https://issues.apache.org/jira/browse/SPARK-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702387#comment-14702387 ] Davies Liu commented on SPARK-9627: --- The `df.show()` will succeed, but `df.groupBy(df.da

[jira] [Commented] (SPARK-10075) Add `when` expressino function in SparkR

[ https://issues.apache.org/jira/browse/SPARK-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702382#comment-14702382 ] Shivaram Venkataraman commented on SPARK-10075: --- Resolved by https://github

[jira] [Resolved] (SPARK-10075) Add `when` expressino function in SparkR

[ https://issues.apache.org/jira/browse/SPARK-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10075. --- Resolution: Fixed Fix Version/s: 1.5.0 > Add `when` expressino functio

  1   2   3   4   >