[jira] [Resolved] (SPARK-20720) 'Executor Summary' should show the exact number, 'Removed Executors' should display the specific number, in the Application Page

[ https://issues.apache.org/jira/browse/SPARK-20720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20720. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 17961 [https://github.co

[jira] [Assigned] (SPARK-20720) 'Executor Summary' should show the exact number, 'Removed Executors' should display the specific number, in the Application Page

[ https://issues.apache.org/jira/browse/SPARK-20720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20720: - Assignee: guoxiaolongzte > 'Executor Summary' should show the exact number, 'Removed Executors'

[jira] [Resolved] (SPARK-20705) The sort function can not be used in the master page when you use Firefox or Google Chrome.

[ https://issues.apache.org/jira/browse/SPARK-20705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20705. --- Resolution: Fixed Fix Version/s: 2.1.2 2.2.0 Issue resolved by pull request

[jira] [Assigned] (SPARK-20705) The sort function can not be used in the master page when you use Firefox or Google Chrome.

[ https://issues.apache.org/jira/browse/SPARK-20705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20705: - Assignee: guoxiaolongzte > The sort function can not be used in the master page when you use Fir

[jira] [Assigned] (SPARK-20395) Update Scala to 2.11.11 and zinc to 0.3.15

[ https://issues.apache.org/jira/browse/SPARK-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20395: Assignee: Sean Owen (was: Apache Spark) > Update Scala to 2.11.11 and zinc to 0.3.15 > --

[jira] [Assigned] (SPARK-20395) Update Scala to 2.11.11 and zinc to 0.3.15

[ https://issues.apache.org/jira/browse/SPARK-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20395: Assignee: Apache Spark (was: Sean Owen) > Update Scala to 2.11.11 and zinc to 0.3.15 > --

[jira] [Commented] (SPARK-20395) Update Scala to 2.11.11 and zinc to 0.3.15

[ https://issues.apache.org/jira/browse/SPARK-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010039#comment-16010039 ] Apache Spark commented on SPARK-20395: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-20395) Upgrade to Scala 2.11.11

[ https://issues.apache.org/jira/browse/SPARK-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20395: - Assignee: Sean Owen Target Version/s: 2.3.0 Labels: (was: dependencie

[jira] [Updated] (SPARK-20395) Update Scala to 2.11.11 and zinc to 0.3.15

[ https://issues.apache.org/jira/browse/SPARK-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20395: -- Summary: Update Scala to 2.11.11 and zinc to 0.3.15 (was: Upgrade to Scala 2.11.11) > Update Scala to

[jira] [Resolved] (SPARK-20228) Random Forest instable results depending on spark.executor.memory

[ https://issues.apache.org/jira/browse/SPARK-20228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20228. --- Resolution: Not A Problem > Random Forest instable results depending on spark.executor.memory > -

[jira] [Resolved] (SPARK-20608) Standby namenodes should be allowed to included in yarn.spark.access.namenodes to support HDFS HA

[ https://issues.apache.org/jira/browse/SPARK-20608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20608. --- Resolution: Not A Problem > Standby namenodes should be allowed to included in > yarn.spark.access.n

[jira] [Resolved] (SPARK-20489) Different results in local mode and yarn mode when working with dates (silent corruption due to system timezone setting)

[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20489. --- Resolution: Not A Problem > Different results in local mode and yarn mode when working with dates (si

[jira] [Commented] (SPARK-20703) Add an operator for writing data out

[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010021#comment-16010021 ] Liang-Chi Hsieh commented on SPARK-20703: - [~tejasp] * It is a physical plan. Cu

[jira] [Updated] (SPARK-20737) Mechanism for cleanup hooks, for structured-streaming sinks on executor shutdown.

[ https://issues.apache.org/jira/browse/SPARK-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-20737: Issue Type: Improvement (was: Bug) > Mechanism for cleanup hooks, for structured-streaming

[jira] [Updated] (SPARK-20737) Mechanism for cleanup hooks, for structured-streaming sinks on executor shutdown.

[ https://issues.apache.org/jira/browse/SPARK-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-20737: Labels: Kafka (was: ) > Mechanism for cleanup hooks, for structured-streaming sinks on exe

[jira] [Updated] (SPARK-20737) Mechanism for cleanup hooks, for structured-streaming sinks on executor shutdown.

[ https://issues.apache.org/jira/browse/SPARK-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-20737: Description: Add a standard way of cleanup during shutdown of executors for structured str

[jira] [Created] (SPARK-20737) Mechanism for cleanup hooks, for structured-streaming sinks on executor shutdown.

Prashant Sharma created SPARK-20737: --- Summary: Mechanism for cleanup hooks, for structured-streaming sinks on executor shutdown. Key: SPARK-20737 URL: https://issues.apache.org/jira/browse/SPARK-20737

[jira] [Commented] (SPARK-20703) Add an operator for writing data out

[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009978#comment-16009978 ] Tejas Patil commented on SPARK-20703: - for dynamic partitioned tables, number of part

[jira] [Commented] (SPARK-20703) Add an operator for writing data out

[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009977#comment-16009977 ] Tejas Patil commented on SPARK-20703: - [~viirya] : - Would this new operator be a ph

[jira] [Comment Edited] (SPARK-20703) Add an operator for writing data out

[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009966#comment-16009966 ] Liang-Chi Hsieh edited comment on SPARK-20703 at 5/15/17 3:56 AM: -

[jira] [Comment Edited] (SPARK-20703) Add an operator for writing data out

[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009966#comment-16009966 ] Liang-Chi Hsieh edited comment on SPARK-20703 at 5/15/17 3:48 AM: -

[jira] [Commented] (SPARK-20703) Add an operator for writing data out

[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009966#comment-16009966 ] Liang-Chi Hsieh commented on SPARK-20703: - I've done something locally. Currentl

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009950#comment-16009950 ] Apache Spark commented on SPARK-15767: -- User 'zhengruifeng' has created a pull reque

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009948#comment-16009948 ] zhengruifeng commented on SPARK-15767: -- I will have a try, if nobody work on it. >

[jira] [Commented] (SPARK-19879) Spark UI table sort breaks event timeline

[ https://issues.apache.org/jira/browse/SPARK-19879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009945#comment-16009945 ] guoxiaolongzte commented on SPARK-19879: Can you upload attachments? I do not qui

[jira] [Comment Edited] (SPARK-19879) Spark UI table sort breaks event timeline

[ https://issues.apache.org/jira/browse/SPARK-19879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009945#comment-16009945 ] guoxiaolongzte edited comment on SPARK-19879 at 5/15/17 3:01 AM: --

[jira] [Assigned] (SPARK-20728) Make ORCFileFormat configurable between sql/hive and sql/core

[ https://issues.apache.org/jira/browse/SPARK-20728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20728: Assignee: Apache Spark > Make ORCFileFormat configurable between sql/hive and sql/core > -

[jira] [Assigned] (SPARK-20728) Make ORCFileFormat configurable between sql/hive and sql/core

[ https://issues.apache.org/jira/browse/SPARK-20728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20728: Assignee: (was: Apache Spark) > Make ORCFileFormat configurable between sql/hive and s

[jira] [Commented] (SPARK-20728) Make ORCFileFormat configurable between sql/hive and sql/core

[ https://issues.apache.org/jira/browse/SPARK-20728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009939#comment-16009939 ] Apache Spark commented on SPARK-20728: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs

[ https://issues.apache.org/jira/browse/SPARK-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009908#comment-16009908 ] Apache Spark commented on SPARK-19320: -- User 'yanji84' has created a pull request fo

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009867#comment-16009867 ] Henri L commented on SPARK-19568: - @Felix Cheung I want to get SparkR working again and i

[jira] [Assigned] (SPARK-20736) PySpark StringIndexer supports StringOrderType

[ https://issues.apache.org/jira/browse/SPARK-20736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20736: Assignee: Apache Spark > PySpark StringIndexer supports StringOrderType >

[jira] [Assigned] (SPARK-20736) PySpark StringIndexer supports StringOrderType

[ https://issues.apache.org/jira/browse/SPARK-20736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20736: Assignee: (was: Apache Spark) > PySpark StringIndexer supports StringOrderType > -

[jira] [Commented] (SPARK-20736) PySpark StringIndexer supports StringOrderType

[ https://issues.apache.org/jira/browse/SPARK-20736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009851#comment-16009851 ] Apache Spark commented on SPARK-20736: -- User 'actuaryzhang' has created a pull reque

[jira] [Created] (SPARK-20736) PySpark StringIndexer supports StringOrderType

Wayne Zhang created SPARK-20736: --- Summary: PySpark StringIndexer supports StringOrderType Key: SPARK-20736 URL: https://issues.apache.org/jira/browse/SPARK-20736 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-20726) R wrapper for SQL broadcast

[ https://issues.apache.org/jira/browse/SPARK-20726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20726. -- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s: 2.3.0

[jira] [Comment Edited] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009830#comment-16009830 ] Felix Cheung edited comment on SPARK-19568 at 5/14/17 7:37 PM:

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009831#comment-16009831 ] Felix Cheung commented on SPARK-19568: -- .. based on that, I might just resolve this

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009830#comment-16009830 ] Felix Cheung commented on SPARK-19568: -- I checked the Rd files are generated and inc

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009818#comment-16009818 ] Wes McKinney commented on SPARK-18924: -- [~deanchen] once R bindings for Arrow are in

[jira] [Commented] (SPARK-20247) Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar

[ https://issues.apache.org/jira/browse/SPARK-20247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009809#comment-16009809 ] Sean Owen commented on SPARK-20247: --- I generally don't think you can expect to remove J

[jira] [Commented] (SPARK-6235) Address various 2G limits

[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009808#comment-16009808 ] Jamie Hutton commented on SPARK-6235: - Hi there, Is there any update on when this will

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009786#comment-16009786 ] Dean Chen commented on SPARK-18924: --- Great, we've been following the effort on https:/

[jira] [Comment Edited] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009783#comment-16009783 ] Wes McKinney edited comment on SPARK-18924 at 5/14/17 4:00 PM:

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009783#comment-16009783 ] Wes McKinney commented on SPARK-18924: -- I can also with this, particularly on the C+

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009778#comment-16009778 ] Henri L commented on SPARK-19568: - What is a status of this? Is it possible to help someh

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009771#comment-16009771 ] Uwe L. Korn commented on SPARK-18924: - Note that there is already work on the Scala<-

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009760#comment-16009760 ] Dean Chen commented on SPARK-18924: --- [~mengxr] The collect performance in SparkR is a h

[jira] [Commented] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009758#comment-16009758 ] Apache Spark commented on SPARK-20735: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20735: Assignee: Apache Spark > Enable cross join in TPCDSQueryBenchmark > --

[jira] [Assigned] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20735: Assignee: (was: Apache Spark) > Enable cross join in TPCDSQueryBenchmark > ---

[jira] [Updated] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20735: -- Component/s: Tests > Enable cross join in TPCDSQueryBenchmark > ---

[jira] [Created] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

Dongjoon Hyun created SPARK-20735: - Summary: Enable cross join in TPCDSQueryBenchmark Key: SPARK-20735 URL: https://issues.apache.org/jira/browse/SPARK-20735 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20733) Permission Error: Access Denied

[ https://issues.apache.org/jira/browse/SPARK-20733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009634#comment-16009634 ] Sean Owen commented on SPARK-20733: --- None of this suggests a Spark problem. I don't thi