[jira] [Commented] (SPARK-20703) Add an operator for writing data out

2017-05-14 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009978#comment-16009978 ] Tejas Patil commented on SPARK-20703: - for dynamic partitioned tables, number of partitions produced

[jira] [Commented] (SPARK-20703) Add an operator for writing data out

2017-05-14 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009977#comment-16009977 ] Tejas Patil commented on SPARK-20703: - [~viirya] : - Would this new operator be a physical plan node

[jira] [Comment Edited] (SPARK-20703) Add an operator for writing data out

2017-05-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009966#comment-16009966 ] Liang-Chi Hsieh edited comment on SPARK-20703 at 5/15/17 3:56 AM: -- I've

[jira] [Comment Edited] (SPARK-20703) Add an operator for writing data out

2017-05-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009966#comment-16009966 ] Liang-Chi Hsieh edited comment on SPARK-20703 at 5/15/17 3:48 AM: -- I've

[jira] [Commented] (SPARK-20703) Add an operator for writing data out

2017-05-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009966#comment-16009966 ] Liang-Chi Hsieh commented on SPARK-20703: - I've done something locally. Currently I wrap the

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009950#comment-16009950 ] Apache Spark commented on SPARK-15767: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2017-05-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009948#comment-16009948 ] zhengruifeng commented on SPARK-15767: -- I will have a try, if nobody work on it. > Decision Tree

[jira] [Commented] (SPARK-19879) Spark UI table sort breaks event timeline

2017-05-14 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009945#comment-16009945 ] guoxiaolongzte commented on SPARK-19879: Can you upload attachments? I do not quite understand

[jira] [Comment Edited] (SPARK-19879) Spark UI table sort breaks event timeline

2017-05-14 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009945#comment-16009945 ] guoxiaolongzte edited comment on SPARK-19879 at 5/15/17 3:01 AM: - Can you

[jira] [Assigned] (SPARK-20728) Make ORCFileFormat configurable between sql/hive and sql/core

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20728: Assignee: Apache Spark > Make ORCFileFormat configurable between sql/hive and sql/core >

[jira] [Assigned] (SPARK-20728) Make ORCFileFormat configurable between sql/hive and sql/core

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20728: Assignee: (was: Apache Spark) > Make ORCFileFormat configurable between sql/hive and

[jira] [Commented] (SPARK-20728) Make ORCFileFormat configurable between sql/hive and sql/core

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009939#comment-16009939 ] Apache Spark commented on SPARK-20728: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009908#comment-16009908 ] Apache Spark commented on SPARK-19320: -- User 'yanji84' has created a pull request for this issue:

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

2017-05-14 Thread Henri L (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009867#comment-16009867 ] Henri L commented on SPARK-19568: - @Felix Cheung I want to get SparkR working again and it looks like

[jira] [Assigned] (SPARK-20736) PySpark StringIndexer supports StringOrderType

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20736: Assignee: Apache Spark > PySpark StringIndexer supports StringOrderType >

[jira] [Assigned] (SPARK-20736) PySpark StringIndexer supports StringOrderType

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20736: Assignee: (was: Apache Spark) > PySpark StringIndexer supports StringOrderType >

[jira] [Commented] (SPARK-20736) PySpark StringIndexer supports StringOrderType

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009851#comment-16009851 ] Apache Spark commented on SPARK-20736: -- User 'actuaryzhang' has created a pull request for this

[jira] [Created] (SPARK-20736) PySpark StringIndexer supports StringOrderType

2017-05-14 Thread Wayne Zhang (JIRA)
Wayne Zhang created SPARK-20736: --- Summary: PySpark StringIndexer supports StringOrderType Key: SPARK-20736 URL: https://issues.apache.org/jira/browse/SPARK-20736 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-20726) R wrapper for SQL broadcast

2017-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20726. -- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s: 2.3.0

[jira] [Comment Edited] (SPARK-19568) Must include class/method documentation for CRAN check

2017-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009830#comment-16009830 ] Felix Cheung edited comment on SPARK-19568 at 5/14/17 7:37 PM: --- I checked

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

2017-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009831#comment-16009831 ] Felix Cheung commented on SPARK-19568: -- .. based on that, I might just resolve this bug as it is..

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

2017-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009830#comment-16009830 ] Felix Cheung commented on SPARK-19568: -- I checked the Rd files are generated and included in a

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

2017-05-14 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009818#comment-16009818 ] Wes McKinney commented on SPARK-18924: -- [~deanchen] once R bindings for Arrow are in ship shape,

[jira] [Commented] (SPARK-20247) Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar

2017-05-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009809#comment-16009809 ] Sean Owen commented on SPARK-20247: --- I generally don't think you can expect to remove JARs you added to

[jira] [Commented] (SPARK-6235) Address various 2G limits

2017-05-14 Thread Jamie Hutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009808#comment-16009808 ] Jamie Hutton commented on SPARK-6235: - Hi there, Is there any update on when this will be included in

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

2017-05-14 Thread Dean Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009786#comment-16009786 ] Dean Chen commented on SPARK-18924: --- Great, we've been following the effort on

[jira] [Comment Edited] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

2017-05-14 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009783#comment-16009783 ] Wes McKinney edited comment on SPARK-18924 at 5/14/17 4:00 PM: --- I can also

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

2017-05-14 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009783#comment-16009783 ] Wes McKinney commented on SPARK-18924: -- I can also with this, particularly on the C++ side. I was

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

2017-05-14 Thread Henri L (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009778#comment-16009778 ] Henri L commented on SPARK-19568: - What is a status of this? Is it possible to help somehow to get this

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

2017-05-14 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009771#comment-16009771 ] Uwe L. Korn commented on SPARK-18924: - Note that there is already work on the Scala<->Python bridge

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

2017-05-14 Thread Dean Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009760#comment-16009760 ] Dean Chen commented on SPARK-18924: --- [~mengxr] The collect performance in SparkR is a huge pain point

[jira] [Commented] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009758#comment-16009758 ] Apache Spark commented on SPARK-20735: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20735: Assignee: Apache Spark > Enable cross join in TPCDSQueryBenchmark >

[jira] [Assigned] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

2017-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20735: Assignee: (was: Apache Spark) > Enable cross join in TPCDSQueryBenchmark >

[jira] [Updated] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

2017-05-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20735: -- Component/s: Tests > Enable cross join in TPCDSQueryBenchmark >

[jira] [Created] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

2017-05-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-20735: - Summary: Enable cross join in TPCDSQueryBenchmark Key: SPARK-20735 URL: https://issues.apache.org/jira/browse/SPARK-20735 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20733) Permission Error: Access Denied

2017-05-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009634#comment-16009634 ] Sean Owen commented on SPARK-20733: --- None of this suggests a Spark problem. I don't think admin