[jira] [Resolved] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-11 Thread Brett Randall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brett Randall resolved SPARK-15685. --- Resolution: Fixed Fix Version/s: 2.0.2 > StackOverflowError (VirtualMachineError) or N

[jira] [Commented] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-11 Thread Brett Randall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248776#comment-16248776 ] Brett Randall commented on SPARK-15685: --- [~srowen] this seems to be fixed in 2.0.2,

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-11 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248745#comment-16248745 ] Tejas Patil commented on SPARK-22042: - Am trying out the suggestion discussed in htt

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248743#comment-16248743 ] Apache Spark commented on SPARK-22042: -- User 'tejasapatil' has created a pull reques

[jira] [Resolved] (SPARK-8824) Support Parquet time related logical types

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-8824. Resolution: Fixed > Support Parquet time related logical types > ---

[jira] [Resolved] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-10365. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19702 [https://githu

[jira] [Assigned] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-10365: --- Assignee: Wenchen Fan > Support Parquet logical type TIMESTAMP_MICROS >

[jira] [Updated] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15685: -- Priority: Major (was: Critical) Fix Version/s: (was: 2.0.2) > StackOverflowError (Virtual

[jira] [Updated] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-11 Thread Brett Randall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brett Randall updated SPARK-15685: -- Fix Version/s: 2.0.2 > StackOverflowError (VirtualMachineError) or NoClassDefFoundError > (Lin

[jira] [Commented] (SPARK-22464) <=> is not supported by Hive metastore partition predicate pushdown

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248635#comment-16248635 ] Apache Spark commented on SPARK-22464: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

2017-11-11 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248628#comment-16248628 ] Timothy Hunter commented on SPARK-21866: [~josephkb] if I am not mistaken, the im

[jira] [Commented] (SPARK-22488) The view resolution in the SparkSession internal table() API

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248618#comment-16248618 ] Apache Spark commented on SPARK-22488: -- User 'gatorsmile' has created a pull request

[jira] [Resolved] (SPARK-22488) The view resolution in the SparkSession internal table() API

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22488. - Resolution: Fixed Fix Version/s: 2.3.0 > The view resolution in the SparkSession internal

[jira] [Updated] (SPARK-22496) beeline display operation log

2017-11-11 Thread StephenZou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] StephenZou updated SPARK-22496: --- Description: For now,when end user runs queries in beeline or in hue through STS, no logs are displa

[jira] [Assigned] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21693: Assignee: (was: Apache Spark) > AppVeyor tests reach the time limit, 1.5 hours, someti

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248524#comment-16248524 ] Apache Spark commented on SPARK-21693: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21693: Assignee: Apache Spark > AppVeyor tests reach the time limit, 1.5 hours, sometimes in Spar

[jira] [Assigned] (SPARK-22462) SQL metrics missing after foreach operation on dataframe

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22462: --- Assignee: Liang-Chi Hsieh > SQL metrics missing after foreach operation on dataframe > -

[jira] [Resolved] (SPARK-22462) SQL metrics missing after foreach operation on dataframe

2017-11-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22462. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19689 [https://githu

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248470#comment-16248470 ] Hyukjin Kwon commented on SPARK-21693: -- For caching, yup, so, looks that's why the t

[jira] [Resolved] (SPARK-22433) Linear regression R^2 train/test terminology related

2017-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22433. --- Resolution: Won't Fix I would say it's not essential to change anything given this discussion, but if

[jira] [Assigned] (SPARK-22476) Add new function dayofweek in R

2017-11-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22476: Assignee: Hyukjin Kwon > Add new function dayofweek in R > ---

[jira] [Resolved] (SPARK-22476) Add new function dayofweek in R

2017-11-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22476. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19706 [https://git

[jira] [Resolved] (SPARK-19759) ALSModel.predict on Dataframes : potential optimization by not using blas

2017-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19759. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19685 [https://github.co

[jira] [Assigned] (SPARK-19759) ALSModel.predict on Dataframes : potential optimization by not using blas

2017-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19759: - Assignee: Marco Gaido > ALSModel.predict on Dataframes : potential optimization by not using bla

[jira] [Assigned] (SPARK-22496) beeline display operation log

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22496: Assignee: Apache Spark > beeline display operation log > - > >

[jira] [Assigned] (SPARK-22496) beeline display operation log

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22496: Assignee: (was: Apache Spark) > beeline display operation log > --

[jira] [Commented] (SPARK-22496) beeline display operation log

2017-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248422#comment-16248422 ] Apache Spark commented on SPARK-22496: -- User 'ChenjunZou' has created a pull request

[jira] [Created] (SPARK-22496) beeline display operation log

2017-11-11 Thread StephenZou (JIRA)
StephenZou created SPARK-22496: -- Summary: beeline display operation log Key: SPARK-22496 URL: https://issues.apache.org/jira/browse/SPARK-22496 Project: Spark Issue Type: Improvement C

[jira] [Commented] (SPARK-22406) pyspark version tag is wrong on PyPi

2017-11-11 Thread Holden Karau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248405#comment-16248405 ] Holden Karau commented on SPARK-22406: -- Yes, although this should be fixed in the do