[jira] [Commented] (SPARK-18878) Fix/investigate the more identified test failures in Java/Scala on Windows

[ https://issues.apache.org/jira/browse/SPARK-18878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750709#comment-15750709 ] Hyukjin Kwon commented on SPARK-18878: -- cc [~srowen] Currently, the test failures we

[jira] [Created] (SPARK-18878) Fix/investigate the more identified test failures in Java/Scala on Windows

Hyukjin Kwon created SPARK-18878: Summary: Fix/investigate the more identified test failures in Java/Scala on Windows Key: SPARK-18878 URL: https://issues.apache.org/jira/browse/SPARK-18878 Project: S

[jira] [Assigned] (SPARK-18669) Update Apache docs regard watermarking in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18669: Assignee: Tathagata Das (was: Apache Spark) > Update Apache docs regard watermarking in S

[jira] [Assigned] (SPARK-18669) Update Apache docs regard watermarking in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18669: Assignee: Apache Spark (was: Tathagata Das) > Update Apache docs regard watermarking in S

[jira] [Commented] (SPARK-18669) Update Apache docs regard watermarking in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750690#comment-15750690 ] Apache Spark commented on SPARK-18669: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-17119) Add configuration property to allow the history server to delete .inprogress files

[ https://issues.apache.org/jira/browse/SPARK-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17119: Assignee: Apache Spark > Add configuration property to allow the history server to delete

[jira] [Commented] (SPARK-17119) Add configuration property to allow the history server to delete .inprogress files

[ https://issues.apache.org/jira/browse/SPARK-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750683#comment-15750683 ] Apache Spark commented on SPARK-17119: -- User 'cnZach' has created a pull request for

[jira] [Assigned] (SPARK-17119) Add configuration property to allow the history server to delete .inprogress files

[ https://issues.apache.org/jira/browse/SPARK-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17119: Assignee: (was: Apache Spark) > Add configuration property to allow the history server

[jira] [Created] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

Navya Krishnappa created SPARK-18877: Summary: Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20 Key: SPARK-18877 U

[jira] [Commented] (SPARK-18455) General support for correlated subquery processing

[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750638#comment-15750638 ] Reynold Xin commented on SPARK-18455: - Thanks for sharing the doc. This is a really w

[jira] [Commented] (SPARK-18862) Split SparkR mllib.R into multiple files

[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750614#comment-15750614 ] Felix Cheung commented on SPARK-18862: -- ah :) Would we end up having mllib-gmm.R, ml

[jira] [Created] (SPARK-18876) An error occurred while trying to connect to the Java server

pranludi created SPARK-18876: Summary: An error occurred while trying to connect to the Java server Key: SPARK-18876 URL: https://issues.apache.org/jira/browse/SPARK-18876 Project: Spark Issue T

[jira] [Resolved] (SPARK-18849) Vignettes final checks for Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18849. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Updated] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-18875: -- Assignee: Dongjoon Hyun > Fix R API doc generation by adding `DESCRIPTION` file

[jira] [Resolved] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18875. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 Issue

[jira] [Commented] (SPARK-18862) Split SparkR mllib.R into multiple files

[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750435#comment-15750435 ] Yanbo Liang commented on SPARK-18862: - Great! I found other R packages organize sourc

[jira] [Resolved] (SPARK-18869) Add TreeNode.p that returns BaseType

[ https://issues.apache.org/jira/browse/SPARK-18869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18869. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 > Add TreeNode.p that retu

[jira] [Updated] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17822: Fix Version/s: 2.0.3 > JVMObjectTracker.objMap may leak JVM objects > -

[jira] [Updated] (SPARK-18793) SparkR vignette update: random forest

[ https://issues.apache.org/jira/browse/SPARK-18793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18793: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18865) SparkR vignettes MLP and LDA updates

[ https://issues.apache.org/jira/browse/SPARK-18865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18865: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18751) Deadlock when SparkContext.stop is called in Utils.tryOrStopSparkContext

[ https://issues.apache.org/jira/browse/SPARK-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18751: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Dead

[jira] [Updated] (SPARK-18840) HDFSCredentialProvider throws exception in non-HDFS security environment

[ https://issues.apache.org/jira/browse/SPARK-18840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18840: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > HDFS

[jira] [Updated] (SPARK-18835) Do not expose shaded types in JavaTypeInference API

[ https://issues.apache.org/jira/browse/SPARK-18835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18835: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Do n

[jira] [Updated] (SPARK-18349) Update R API documentation on ml model summary

[ https://issues.apache.org/jira/browse/SPARK-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18349: Fix Version/s: (was: 2.1.1) 2.1.0 > Update R API documentation on ml model s

[jira] [Updated] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17822: Fix Version/s: (was: 2.1.1) (was: 2.0.3) (was: 2.2

[jira] [Updated] (SPARK-18681) Throw Filtering is supported only on partition keys of type string exception

[ https://issues.apache.org/jira/browse/SPARK-18681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18681: Fix Version/s: (was: 2.1.1) 2.1.0 > Throw Filtering is supported only on par

[jira] [Updated] (SPARK-18797) Update spark.logit in sparkr-vignettes

[ https://issues.apache.org/jira/browse/SPARK-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18797: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Upda

[jira] [Updated] (SPARK-18812) Clarify "Spark ML"

[ https://issues.apache.org/jira/browse/SPARK-18812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18812: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Clar

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18816: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > exec

[jira] [Updated] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18811: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Stre

[jira] [Updated] (SPARK-18760) Provide consistent format output for all file formats

[ https://issues.apache.org/jira/browse/SPARK-18760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18760: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Prov

[jira] [Updated] (SPARK-18325) SparkR 2.1 QA: Check for new R APIs requiring example code

[ https://issues.apache.org/jira/browse/SPARK-18325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18325: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18590) R - Include package vignettes and help pages, build source package in Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18590: Fix Version/s: (was: 2.1.1) 2.1.0 > R - Include package vignettes and help p

[jira] [Updated] (SPARK-18815) NPE when collecting column stats for string/binary column having only null values

[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18815: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > NPE

[jira] [Updated] (SPARK-18794) SparkR vignette update: gbt

[ https://issues.apache.org/jira/browse/SPARK-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18794: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18795) SparkR vignette update: ksTest

[ https://issues.apache.org/jira/browse/SPARK-18795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18795: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18807: Fix Version/s: (was: 2.1.1) 2.1.0 > Should suppress output print for calls t

[jira] [Updated] (SPARK-18628) Update handle invalid documentation string

[ https://issues.apache.org/jira/browse/SPARK-18628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18628: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Upda

[jira] [Updated] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18810: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Spar

[jira] [Updated] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18774: Fix Version/s: (was: 2.1.1) (was: 2.2.0) 2.1.0 > Igno

[jira] [Updated] (SPARK-18790) Keep a general offset history of stream batches

[ https://issues.apache.org/jira/browse/SPARK-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18790: Fix Version/s: (was: 2.1.1) 2.1.0 > Keep a general offset history of stream

[jira] [Updated] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18745: Fix Version/s: (was: 2.1.1) 2.1.0 > java.lang.IndexOutOfBoundsException runn

[jira] [Updated] (SPARK-16589) Chained cartesian produces incorrect number of records

[ https://issues.apache.org/jira/browse/SPARK-16589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16589: Fix Version/s: (was: 2.1.1) 2.1.0 > Chained cartesian produces incorrect num

[jira] [Updated] (SPARK-18843) Fix timeout in awaitResultInForkJoinSafely

[ https://issues.apache.org/jira/browse/SPARK-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18843: Fix Version/s: (was: 2.1.1) 2.1.0 > Fix timeout in awaitResultInForkJoinSafe

[jira] [Resolved] (SPARK-18856) Newly created catalog table assumed to have 0 rows and 0 bytes

[ https://issues.apache.org/jira/browse/SPARK-18856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18856. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.1.0 > Newly created cata

[jira] [Assigned] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18875: Assignee: Apache Spark > Fix R API doc generation by adding `DESCRIPTION` file > -

[jira] [Assigned] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18875: Assignee: (was: Apache Spark) > Fix R API doc generation by adding `DESCRIPTION` file

[jira] [Commented] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750404#comment-15750404 ] Apache Spark commented on SPARK-18875: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Updated] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18875: -- Description: Since 1.4.0, R API document index page has a broken link on `DESCRIPTION file`. T

[jira] [Created] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

Dongjoon Hyun created SPARK-18875: - Summary: Fix R API doc generation by adding `DESCRIPTION` file Key: SPARK-18875 URL: https://issues.apache.org/jira/browse/SPARK-18875 Project: Spark Issue

[jira] [Commented] (SPARK-18281) toLocalIterator yields time out error on pyspark2

[ https://issues.apache.org/jira/browse/SPARK-18281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750281#comment-15750281 ] Liang-Chi Hsieh commented on SPARK-18281: - [~mwdus...@us.ibm.com] BTW, I updated

[jira] [Commented] (SPARK-18281) toLocalIterator yields time out error on pyspark2

[ https://issues.apache.org/jira/browse/SPARK-18281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750246#comment-15750246 ] Liang-Chi Hsieh commented on SPARK-18281: - [~mwdus...@us.ibm.com] Thanks for this

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750217#comment-15750217 ] Sital Kedia commented on SPARK-18838: - [~zsxwing] - Its not only the ExecutorAllocati

[jira] [Assigned] (SPARK-18838) High latency of event processing for large jobs

[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18838: Assignee: (was: Apache Spark) > High latency of event processing for large jobs >

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750209#comment-15750209 ] Apache Spark commented on SPARK-18838: -- User 'sitalkedia' has created a pull request

[jira] [Assigned] (SPARK-18838) High latency of event processing for large jobs

[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18838: Assignee: Apache Spark > High latency of event processing for large jobs > ---

[jira] [Created] (SPARK-18874) First phase: Deferring the correlated predicate pull up to Optimizer phase

Nattavut Sutyanyong created SPARK-18874: --- Summary: First phase: Deferring the correlated predicate pull up to Optimizer phase Key: SPARK-18874 URL: https://issues.apache.org/jira/browse/SPARK-18874

[jira] [Created] (SPARK-18873) New test cases for scalar subquery

Nattavut Sutyanyong created SPARK-18873: --- Summary: New test cases for scalar subquery Key: SPARK-18873 URL: https://issues.apache.org/jira/browse/SPARK-18873 Project: Spark Issue Type:

[jira] [Created] (SPARK-18872) New test cases for EXISTS subquery

Nattavut Sutyanyong created SPARK-18872: --- Summary: New test cases for EXISTS subquery Key: SPARK-18872 URL: https://issues.apache.org/jira/browse/SPARK-18872 Project: Spark Issue Type:

[jira] [Commented] (SPARK-18699) Spark CSV parsing types other than String throws exception when malformed

[ https://issues.apache.org/jira/browse/SPARK-18699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750163#comment-15750163 ] Rishi Kamaleswaran commented on SPARK-18699: Thanks for the reply! Unfortunat

[jira] [Commented] (SPARK-18281) toLocalIterator yields time out error on pyspark2

[ https://issues.apache.org/jira/browse/SPARK-18281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750158#comment-15750158 ] Liang-Chi Hsieh commented on SPARK-18281: - Hi [~holdenk], what you meant for "we

[jira] [Created] (SPARK-18871) New test cases for IN subquery

Nattavut Sutyanyong created SPARK-18871: --- Summary: New test cases for IN subquery Key: SPARK-18871 URL: https://issues.apache.org/jira/browse/SPARK-18871 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-18455) General support for correlated subquery processing

[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750145#comment-15750145 ] Nattavut Sutyanyong commented on SPARK-18455: - Quantified predicate is not pl

[jira] [Comment Edited] (SPARK-18455) General support for correlated subquery processing

[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750128#comment-15750128 ] Nattavut Sutyanyong edited comment on SPARK-18455 at 12/15/16 2:17 AM:

[jira] [Updated] (SPARK-18455) General support for correlated subquery processing

[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nattavut Sutyanyong updated SPARK-18455: Attachment: SPARK-18455-scoping-doc.pdf Scoping document > General support for cor

[jira] [Resolved] (SPARK-18861) Spark-SQL unconsistent behavior with "struct" expressions

[ https://issues.apache.org/jira/browse/SPARK-18861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-18861. -- Resolution: Not A Problem I see. This seems actually a behaviour documented in https://github.

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750076#comment-15750076 ] Apache Spark commented on SPARK-18817: -- User 'shivaram' has created a pull request f

[jira] [Assigned] (SPARK-18870) Distinct aggregates give incorrect answers on streaming dataframes

[ https://issues.apache.org/jira/browse/SPARK-18870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18870: Assignee: Tathagata Das (was: Apache Spark) > Distinct aggregates give incorrect answers

[jira] [Assigned] (SPARK-18870) Distinct aggregates give incorrect answers on streaming dataframes

[ https://issues.apache.org/jira/browse/SPARK-18870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18870: Assignee: Apache Spark (was: Tathagata Das) > Distinct aggregates give incorrect answers

[jira] [Commented] (SPARK-18870) Distinct aggregates give incorrect answers on streaming dataframes

[ https://issues.apache.org/jira/browse/SPARK-18870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750061#comment-15750061 ] Apache Spark commented on SPARK-18870: -- User 'tdas' has created a pull request for t

[jira] [Closed] (SPARK-18783) ML StringIndexer does not work with nested fields

[ https://issues.apache.org/jira/browse/SPARK-18783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-18783. - Resolution: Won't Fix > ML StringIndexer does not work with nested fields > -

[jira] [Commented] (SPARK-18783) ML StringIndexer does not work with nested fields

[ https://issues.apache.org/jira/browse/SPARK-18783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750057#comment-15750057 ] Joseph K. Bradley commented on SPARK-18783: --- I'd separate this into 2 issues: 1

[jira] [Commented] (SPARK-18699) Spark CSV parsing types other than String throws exception when malformed

[ https://issues.apache.org/jira/browse/SPARK-18699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750050#comment-15750050 ] Hyukjin Kwon commented on SPARK-18699: -- BTW, maybe you could try to set {{nullValue}

[jira] [Commented] (SPARK-18795) SparkR vignette update: ksTest

[ https://issues.apache.org/jira/browse/SPARK-18795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750043#comment-15750043 ] Joseph K. Bradley commented on SPARK-18795: --- No problem, thanks for understandi

[jira] [Commented] (SPARK-18374) Incorrect words in StopWords/english.txt

[ https://issues.apache.org/jira/browse/SPARK-18374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750041#comment-15750041 ] Joseph K. Bradley commented on SPARK-18374: --- Oh nice, I didn't realize that was

[jira] [Updated] (SPARK-18849) Vignettes final checks for Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18849: -- Target Version/s: 2.1.0 > Vignettes final checks for Spark 2.1 > --

[jira] [Resolved] (SPARK-18703) Insertion/CTAS against Hive Tables: Staging Directories and Data Files Not Dropped Until Normal Termination of JVM

[ https://issues.apache.org/jira/browse/SPARK-18703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18703. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.2.0 > Insertion/CTAS against

[jira] [Updated] (SPARK-18870) Distinct aggregates give incorrect answers on streaming dataframes

[ https://issues.apache.org/jira/browse/SPARK-18870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-18870: -- Affects Version/s: 2.0.2 Target Version/s: 2.1.0 Component/s: Structured Streamin

[jira] [Created] (SPARK-18870) Distinct aggregates give incorrect answers on streaming dataframes

Tathagata Das created SPARK-18870: - Summary: Distinct aggregates give incorrect answers on streaming dataframes Key: SPARK-18870 URL: https://issues.apache.org/jira/browse/SPARK-18870 Project: Spark

[jira] [Updated] (SPARK-18865) SparkR vignettes MLP and LDA updates

[ https://issues.apache.org/jira/browse/SPARK-18865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18865: -- Target Version/s: 2.1.0 (was: 2.1.1, 2.2.0) > SparkR vignettes MLP and LDA updates > -

[jira] [Updated] (SPARK-18865) SparkR vignettes MLP and LDA updates

[ https://issues.apache.org/jira/browse/SPARK-18865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18865: -- Fix Version/s: 2.2.0 2.1.1 > SparkR vignettes MLP and LDA updates >

[jira] [Updated] (SPARK-18865) SparkR vignettes MLP and LDA updates

[ https://issues.apache.org/jira/browse/SPARK-18865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18865: -- Issue Type: Documentation (was: Bug) > SparkR vignettes MLP and LDA updates >

[jira] [Resolved] (SPARK-18865) SparkR vignettes MLP and LDA updates

[ https://issues.apache.org/jira/browse/SPARK-18865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18865. -- Resolution: Fixed Assignee: Miao Wang Target Version/s: 2.1.1, 2.2.0 > Sp

[jira] [Updated] (SPARK-18869) Add TreeNode.p that returns BaseType

[ https://issues.apache.org/jira/browse/SPARK-18869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18869: Description: After the bug fix in SPARK-18854, TreeNode.apply now returns TreeNode[_] rather than a

[jira] [Updated] (SPARK-18869) Add TreeNode.p that returns BaseType

[ https://issues.apache.org/jira/browse/SPARK-18869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18869: Summary: Add TreeNode.p that returns BaseType (was: Add lp and pp to plan nodes for getting logica

[jira] [Assigned] (SPARK-18869) Add lp and pp to plan nodes for getting logical plans and physical plans

[ https://issues.apache.org/jira/browse/SPARK-18869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18869: Assignee: Apache Spark (was: Reynold Xin) > Add lp and pp to plan nodes for getting logic

[jira] [Commented] (SPARK-18869) Add lp and pp to plan nodes for getting logical plans and physical plans

[ https://issues.apache.org/jira/browse/SPARK-18869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749968#comment-15749968 ] Apache Spark commented on SPARK-18869: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-18869) Add lp and pp to plan nodes for getting logical plans and physical plans

[ https://issues.apache.org/jira/browse/SPARK-18869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18869: Assignee: Reynold Xin (was: Apache Spark) > Add lp and pp to plan nodes for getting logic

[jira] [Created] (SPARK-18869) Add lp and pp to plan nodes for getting logical plans and physical plans

Reynold Xin created SPARK-18869: --- Summary: Add lp and pp to plan nodes for getting logical plans and physical plans Key: SPARK-18869 URL: https://issues.apache.org/jira/browse/SPARK-18869 Project: Spark

[jira] [Assigned] (SPARK-18868) Flaky Test: StreamingQueryListenerSuite

[ https://issues.apache.org/jira/browse/SPARK-18868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18868: Assignee: Apache Spark > Flaky Test: StreamingQueryListenerSuite > ---

[jira] [Assigned] (SPARK-18868) Flaky Test: StreamingQueryListenerSuite

[ https://issues.apache.org/jira/browse/SPARK-18868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18868: Assignee: (was: Apache Spark) > Flaky Test: StreamingQueryListenerSuite >

[jira] [Commented] (SPARK-18868) Flaky Test: StreamingQueryListenerSuite

[ https://issues.apache.org/jira/browse/SPARK-18868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749915#comment-15749915 ] Apache Spark commented on SPARK-18868: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-18849) Vignettes final checks for Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18849: Assignee: Apache Spark (was: Felix Cheung) > Vignettes final checks for Spark 2.1 > -

[jira] [Assigned] (SPARK-18849) Vignettes final checks for Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18849: Assignee: Felix Cheung (was: Apache Spark) > Vignettes final checks for Spark 2.1 > -

[jira] [Commented] (SPARK-18849) Vignettes final checks for Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749906#comment-15749906 ] Apache Spark commented on SPARK-18849: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-18854) getNodeNumbered and generateTreeString are not consistent

[ https://issues.apache.org/jira/browse/SPARK-18854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-18854: --- Assignee: Reynold Xin > getNodeNumbered and generateTreeString are not consistent >

[jira] [Resolved] (SPARK-18854) getNodeNumbered and generateTreeString are not consistent

[ https://issues.apache.org/jira/browse/SPARK-18854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18854. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 Target Version

[jira] [Assigned] (SPARK-18867) Throw cause if IsolatedClientLoad can't create client

[ https://issues.apache.org/jira/browse/SPARK-18867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18867: Assignee: Apache Spark > Throw cause if IsolatedClientLoad can't create client > -

[jira] [Assigned] (SPARK-18867) Throw cause if IsolatedClientLoad can't create client

[ https://issues.apache.org/jira/browse/SPARK-18867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18867: Assignee: (was: Apache Spark) > Throw cause if IsolatedClientLoad can't create client

[jira] [Commented] (SPARK-18867) Throw cause if IsolatedClientLoad can't create client

[ https://issues.apache.org/jira/browse/SPARK-18867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749893#comment-15749893 ] Apache Spark commented on SPARK-18867: -- User 'jojochuang' has created a pull request

  1   2   3   >