[jira] [Commented] (SPARK-20176) Spark Dataframe UDAF issue

[ https://issues.apache.org/jira/browse/SPARK-20176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953025#comment-15953025 ] Dinesh Man Amatya commented on SPARK-20176: --- Following is the shortened code for generating

[jira] [Commented] (SPARK-20188) Catalog recoverPartitions should allow specifying the database name

[ https://issues.apache.org/jira/browse/SPARK-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952997#comment-15952997 ] Xiao Li commented on SPARK-20188: - The changes are many. I might submit the one tomorrow. Found a bug in

[jira] [Resolved] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20197. -- Resolution: Fixed > CRAN check fail with package installation >

[jira] [Commented] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952948#comment-15952948 ] Felix Cheung commented on SPARK-20197: -- merged https://github.com/apache/spark/pull/17515 to

[jira] [Commented] (SPARK-20188) Catalog recoverPartitions should allow specifying the database name

[ https://issues.apache.org/jira/browse/SPARK-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952905#comment-15952905 ] Xiao Li commented on SPARK-20188: - Yes! In different Catalog APIs, we have different input formats. We

[jira] [Commented] (SPARK-18570) Consider supporting other R formula operators

[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952887#comment-15952887 ] Krishna Kalyan commented on SPARK-18570: [~felixcheung] I currently not working on this. Sorry

[jira] [Commented] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952885#comment-15952885 ] Apache Spark commented on SPARK-20197: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952884#comment-15952884 ] Apache Spark commented on SPARK-20197: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952879#comment-15952879 ] Apache Spark commented on SPARK-20197: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20197: Assignee: Felix Cheung (was: Apache Spark) > CRAN check fail with package installation

[jira] [Commented] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952878#comment-15952878 ] Apache Spark commented on SPARK-20197: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20197: Assignee: Apache Spark (was: Felix Cheung) > CRAN check fail with package installation

[jira] [Updated] (SPARK-20197) CRAN check fail with package installation

[ https://issues.apache.org/jira/browse/SPARK-20197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20197: - Description: Failed -

[jira] [Created] (SPARK-20197) CRAN check fail with package installation

Felix Cheung created SPARK-20197: Summary: CRAN check fail with package installation Key: SPARK-20197 URL: https://issues.apache.org/jira/browse/SPARK-20197 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20180) Unlimited max pattern length in Prefix span

[ https://issues.apache.org/jira/browse/SPARK-20180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952828#comment-15952828 ] Cyril de Vogelaere commented on SPARK-20180: I'm not arguing for no max at all. Just for a

[jira] [Assigned] (SPARK-20196) Python to add catalog API for refreshByPath

[ https://issues.apache.org/jira/browse/SPARK-20196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20196: Assignee: Apache Spark (was: Felix Cheung) > Python to add catalog API for refreshByPath

[jira] [Commented] (SPARK-20196) Python to add catalog API for refreshByPath

[ https://issues.apache.org/jira/browse/SPARK-20196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952823#comment-15952823 ] Apache Spark commented on SPARK-20196: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-20196) Python to add catalog API for refreshByPath

[ https://issues.apache.org/jira/browse/SPARK-20196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20196: Assignee: Felix Cheung (was: Apache Spark) > Python to add catalog API for refreshByPath

[jira] [Created] (SPARK-20196) Python to add catalog API for refreshByPath

Felix Cheung created SPARK-20196: Summary: Python to add catalog API for refreshByPath Key: SPARK-20196 URL: https://issues.apache.org/jira/browse/SPARK-20196 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20195) SparkR to add createTable catalog API and deprecate createExternalTable

[ https://issues.apache.org/jira/browse/SPARK-20195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20195: Assignee: Felix Cheung (was: Apache Spark) > SparkR to add createTable catalog API and

[jira] [Commented] (SPARK-20195) SparkR to add createTable catalog API and deprecate createExternalTable

[ https://issues.apache.org/jira/browse/SPARK-20195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952815#comment-15952815 ] Apache Spark commented on SPARK-20195: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-20195) SparkR to add createTable catalog API and deprecate createExternalTable

[ https://issues.apache.org/jira/browse/SPARK-20195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20195: Assignee: Apache Spark (was: Felix Cheung) > SparkR to add createTable catalog API and

[jira] [Created] (SPARK-20195) SparkR to add createTable catalog API and deprecate createExternalTable

Felix Cheung created SPARK-20195: Summary: SparkR to add createTable catalog API and deprecate createExternalTable Key: SPARK-20195 URL: https://issues.apache.org/jira/browse/SPARK-20195 Project:

[jira] [Resolved] (SPARK-20159) Support complete Catalog API in R

[ https://issues.apache.org/jira/browse/SPARK-20159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20159. -- Resolution: Fixed Fix Version/s: 2.2.0 > Support complete Catalog API in R >

[jira] [Commented] (SPARK-18570) Consider supporting other R formula operators

[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952808#comment-15952808 ] Felix Cheung commented on SPARK-18570: -- [~KrishnaKalyan3]are you working on this? > Consider

[jira] [Commented] (SPARK-18822) Support ML Pipeline in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952806#comment-15952806 ] Felix Cheung commented on SPARK-18822: -- right, sorry didn't get around to work on this... > Support

[jira] [Commented] (SPARK-20180) Unlimited max pattern length in Prefix span

[ https://issues.apache.org/jira/browse/SPARK-20180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952768#comment-15952768 ] Sean Owen commented on SPARK-20180: --- It sounds like you're arguing for no max at all -- what do you

[jira] [Comment Edited] (SPARK-20180) Unlimited max pattern length in Prefix span

[ https://issues.apache.org/jira/browse/SPARK-20180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952618#comment-15952618 ] Cyril de Vogelaere edited comment on SPARK-20180 at 4/2/17 4:50 PM:

[jira] [Resolved] (SPARK-9414) HiveContext:saveAsTable creates wrong partition for existing hive table(append mode)

[ https://issues.apache.org/jira/browse/SPARK-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-9414. - Resolution: Cannot Reproduce I am resolving this per the comment above. Please reopen this if I

[jira] [Commented] (SPARK-19532) [Core]`DataStreamer for file` threads of DFSOutputStream leak if set `spark.speculation` to true

[ https://issues.apache.org/jira/browse/SPARK-19532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952730#comment-15952730 ] Hyukjin Kwon commented on SPARK-19532: -- It sounds no one except for the reporter could reproduce

[jira] [Resolved] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20157. --- Resolution: Won't Fix > In the menu ‘Storage’in Web UI, click the Go button, and shows no paging

[jira] [Assigned] (SPARK-20194) Support partition pruning for InMemoryCatalog

[ https://issues.apache.org/jira/browse/SPARK-20194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20194: Assignee: (was: Apache Spark) > Support partition pruning for InMemoryCatalog >

[jira] [Assigned] (SPARK-20194) Support partition pruning for InMemoryCatalog

[ https://issues.apache.org/jira/browse/SPARK-20194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20194: Assignee: Apache Spark > Support partition pruning for InMemoryCatalog >

[jira] [Commented] (SPARK-20194) Support partition pruning for InMemoryCatalog

[ https://issues.apache.org/jira/browse/SPARK-20194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952710#comment-15952710 ] Apache Spark commented on SPARK-20194: -- User 'adrian-ionescu' has created a pull request for this

[jira] [Resolved] (SPARK-20135) spark thriftserver2: no job running but containers not release on yarn

[ https://issues.apache.org/jira/browse/SPARK-20135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20135. --- Resolution: Invalid > spark thriftserver2: no job running but containers not release on yarn >

[jira] [Resolved] (SPARK-20141) jdbc query gives ORA-00903

[ https://issues.apache.org/jira/browse/SPARK-20141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20141. --- Resolution: Not A Problem > jdbc query gives ORA-00903 > -- > >

[jira] [Assigned] (SPARK-20173) Throw NullPointerException when HiveThriftServer2 is shutdown

[ https://issues.apache.org/jira/browse/SPARK-20173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20173: - Assignee: zuotingbing Priority: Minor (was: Major) > Throw NullPointerException when

[jira] [Resolved] (SPARK-20173) Throw NullPointerException when HiveThriftServer2 is shutdown

[ https://issues.apache.org/jira/browse/SPARK-20173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20173. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17496

[jira] [Updated] (SPARK-19999) Test failures in Spark Core due to java.nio.Bits.unaligned()

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1: -- Fix Version/s: 2.1.1 > Test failures in Spark Core due to java.nio.Bits.unaligned() >

[jira] [Assigned] (SPARK-20123) $SPARK_HOME variable might have spaces in it(e.g. $SPARK_HOME=/home/spark build/spark), then build spark failed.

[ https://issues.apache.org/jira/browse/SPARK-20123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20123: - Assignee: zuotingbing > $SPARK_HOME variable might have spaces in it(e.g.

[jira] [Resolved] (SPARK-20123) $SPARK_HOME variable might have spaces in it(e.g. $SPARK_HOME=/home/spark build/spark), then build spark failed.

[ https://issues.apache.org/jira/browse/SPARK-20123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20123. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17452

[jira] [Resolved] (SPARK-20143) DataType.fromJson should throw an exception with better message

[ https://issues.apache.org/jira/browse/SPARK-20143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20143. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0 > DataType.fromJson should

[jira] [Created] (SPARK-20194) Support partition pruning for InMemoryCatalog

Adrian Ionescu created SPARK-20194: -- Summary: Support partition pruning for InMemoryCatalog Key: SPARK-20194 URL: https://issues.apache.org/jira/browse/SPARK-20194 Project: Spark Issue

[jira] [Updated] (SPARK-20193) Selecting empty struct causes ExpressionEncoder error.

[ https://issues.apache.org/jira/browse/SPARK-20193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Ionescu updated SPARK-20193: --- Description: {{def struct(cols: Column*): Column}} Given the above signature and the lack of

[jira] [Created] (SPARK-20193) Selecting empty struct causes ExpressionEncoder error.

Adrian Ionescu created SPARK-20193: -- Summary: Selecting empty struct causes ExpressionEncoder error. Key: SPARK-20193 URL: https://issues.apache.org/jira/browse/SPARK-20193 Project: Spark

[jira] [Comment Edited] (SPARK-20180) Unlimited max pattern length in Prefix span

[ https://issues.apache.org/jira/browse/SPARK-20180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952618#comment-15952618 ] Cyril de Vogelaere edited comment on SPARK-20180 at 4/2/17 10:39 AM: -

[jira] [Commented] (SPARK-20180) Unlimited max pattern length in Prefix span

[ https://issues.apache.org/jira/browse/SPARK-20180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952618#comment-15952618 ] Cyril de Vogelaere commented on SPARK-20180: Yes they can, it's really not a critical issue

[jira] [Assigned] (SPARK-20190) '/applications/[app-id]/jobs' in rest api,status should be [running|succeeded|failed|unknown]

[ https://issues.apache.org/jira/browse/SPARK-20190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20190: - Assignee: guoxiaolongzte Priority: Trivial (was: Minor) > '/applications/[app-id]/jobs' in

[jira] [Commented] (SPARK-19999) Test failures in Spark Core due to java.nio.Bits.unaligned()

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952568#comment-15952568 ] Apache Spark commented on SPARK-1: -- User 'kiszk' has created a pull request for this issue: