[jira] [Updated] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18745: Fix Version/s: (was: 2.1.1) 2.1.0 > java.lang.IndexOutOfBoundsException runn

[jira] [Updated] (SPARK-18795) SparkR vignette update: ksTest

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18795: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18807: Fix Version/s: (was: 2.1.1) 2.1.0 > Should suppress output print for calls t

[jira] [Updated] (SPARK-18628) Update handle invalid documentation string

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18628: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Upda

[jira] [Updated] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18810: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18815) NPE when collecting column stats for string/binary column having only null values

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18815: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > NPE

[jira] [Updated] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18774: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Igno

[jira] [Updated] (SPARK-18794) SparkR vignette update: gbt

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18794: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18751) Deadlock when SparkContext.stop is called in Utils.tryOrStopSparkContext

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18751: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Dead

[jira] [Updated] (SPARK-18840) HDFSCredentialProvider throws exception in non-HDFS security environment

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18840: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > HDFS

[jira] [Updated] (SPARK-18835) Do not expose shaded types in JavaTypeInference API

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18835: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Do n

[jira] [Updated] (SPARK-18349) Update R API documentation on ml model summary

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18349: Fix Version/s: (was: 2.1.1) 2.1.0 > Update R API documentation on ml model s

[jira] [Updated] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17822: Fix Version/s: (was: 2.1.1) (was: 2.0.3) (was: 2.2

[jira] [Updated] (SPARK-18681) Throw Filtering is supported only on partition keys of type string exception

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18681: Fix Version/s: (was: 2.1.1) 2.1.0 > Throw Filtering is supported only on par

[jira] [Updated] (SPARK-18797) Update spark.logit in sparkr-vignettes

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18797: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Upda

[jira] [Updated] (SPARK-18812) Clarify "Spark ML"

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18812: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Clar

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18816: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > exec

[jira] [Updated] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18811: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Stre

[jira] [Updated] (SPARK-18793) SparkR vignette update: random forest

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18793: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18760) Provide consistent format output for all file formats

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18760: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Prov

[jira] [Updated] (SPARK-18325) SparkR 2.1 QA: Check for new R APIs requiring example code

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18325: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18590) R - Include package vignettes and help pages, build source package in Spark distribution

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18590: Fix Version/s: (was: 2.1.1) 2.1.0 > R - Include package vignettes and help p

[jira] [Updated] (SPARK-18865) SparkR vignettes MLP and LDA updates

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18865: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17822: Fix Version/s: 2.0.3 > JVMObjectTracker.objMap may leak JVM objects > -

[jira] [Resolved] (SPARK-18869) Add TreeNode.p that returns BaseType

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18869. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 > Add TreeNode.p that retu

[jira] [Commented] (SPARK-18862) Split SparkR mllib.R into multiple files

2016-12-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750435#comment-15750435 ] Yanbo Liang commented on SPARK-18862: - Great! I found other R packages organize sourc

[jira] [Resolved] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

2016-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18875. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 Issue

[jira] [Updated] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

2016-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-18875: -- Assignee: Dongjoon Hyun > Fix R API doc generation by adding `DESCRIPTION` file

[jira] [Resolved] (SPARK-18849) Vignettes final checks for Spark 2.1

2016-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18849. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Created] (SPARK-18876) An error occurred while trying to connect to the Java server

2016-12-14 Thread pranludi (JIRA)
pranludi created SPARK-18876: Summary: An error occurred while trying to connect to the Java server Key: SPARK-18876 URL: https://issues.apache.org/jira/browse/SPARK-18876 Project: Spark Issue T

[jira] [Commented] (SPARK-18862) Split SparkR mllib.R into multiple files

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750614#comment-15750614 ] Felix Cheung commented on SPARK-18862: -- ah :) Would we end up having mllib-gmm.R, ml

[jira] [Commented] (SPARK-18455) General support for correlated subquery processing

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750638#comment-15750638 ] Reynold Xin commented on SPARK-18455: - Thanks for sharing the doc. This is a really w

[jira] [Created] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

2016-12-14 Thread Navya Krishnappa (JIRA)
Navya Krishnappa created SPARK-18877: Summary: Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20 Key: SPARK-18877 U

[jira] [Assigned] (SPARK-17119) Add configuration property to allow the history server to delete .inprogress files

2016-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17119: Assignee: (was: Apache Spark) > Add configuration property to allow the history server

[jira] [Commented] (SPARK-17119) Add configuration property to allow the history server to delete .inprogress files

2016-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750683#comment-15750683 ] Apache Spark commented on SPARK-17119: -- User 'cnZach' has created a pull request for

[jira] [Assigned] (SPARK-17119) Add configuration property to allow the history server to delete .inprogress files

2016-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17119: Assignee: Apache Spark > Add configuration property to allow the history server to delete

[jira] [Commented] (SPARK-18669) Update Apache docs regard watermarking in Structured Streaming

2016-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750690#comment-15750690 ] Apache Spark commented on SPARK-18669: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-18669) Update Apache docs regard watermarking in Structured Streaming

2016-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18669: Assignee: Apache Spark (was: Tathagata Das) > Update Apache docs regard watermarking in S

[jira] [Assigned] (SPARK-18669) Update Apache docs regard watermarking in Structured Streaming

2016-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18669: Assignee: Tathagata Das (was: Apache Spark) > Update Apache docs regard watermarking in S

[jira] [Created] (SPARK-18878) Fix/investigate the more identified test failures in Java/Scala on Windows

2016-12-14 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-18878: Summary: Fix/investigate the more identified test failures in Java/Scala on Windows Key: SPARK-18878 URL: https://issues.apache.org/jira/browse/SPARK-18878 Project: S

[jira] [Commented] (SPARK-18878) Fix/investigate the more identified test failures in Java/Scala on Windows

2016-12-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750709#comment-15750709 ] Hyukjin Kwon commented on SPARK-18878: -- cc [~srowen] Currently, the test failures we

<    1   2   3