[jira] [Resolved] (SPARK-25723) spark sql External DataSource question

[ https://issues.apache.org/jira/browse/SPARK-25723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25723. -- Resolution: Invalid > spark sql External DataSource question > ---

[jira] [Commented] (SPARK-25723) spark sql External DataSource question

[ https://issues.apache.org/jira/browse/SPARK-25723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1802#comment-1802 ] Hyukjin Kwon commented on SPARK-25723: -- [~zhiyin1233], Please provide more informat

[jira] [Commented] (SPARK-24291) Data source table is not displaying records when files are uploaded to table location

[ https://issues.apache.org/jira/browse/SPARK-24291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1800#comment-1800 ] Hyukjin Kwon commented on SPARK-24291: -- [~kool...@gmail.com], Can you refresh the t

[jira] [Resolved] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25648. -- Resolution: Invalid Leaving this resolved since there's not enough information. > Spark 2.3.1

[jira] [Resolved] (SPARK-22505) toDF() / createDataFrame() type inference doesn't work as expected

[ https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22505. -- Resolution: Not A Problem This is fundamental differences between Python and CSV daatasources.

[jira] [Commented] (SPARK-22505) toDF() / createDataFrame() type inference doesn't work as expected

[ https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1797#comment-1797 ] Hyukjin Kwon commented on SPARK-22505: -- You should set the option `inferSchema` >

[jira] [Resolved] (SPARK-25455) Spark bundles jackson library version, which is vulnerable

[ https://issues.apache.org/jira/browse/SPARK-25455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25455. -- Resolution: Duplicate > Spark bundles jackson library version, which is vulnerable >

[jira] [Commented] (SPARK-24233) Union Operation on Read of Dataframe does NOT produce correct result

[ https://issues.apache.org/jira/browse/SPARK-24233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1789#comment-1789 ] Hyukjin Kwon commented on SPARK-24233: -- Why did you use {{par}}? Can you try withou

[jira] [Updated] (SPARK-24233) Union Operation on Read of Dataframe does NOT produce correct result

[ https://issues.apache.org/jira/browse/SPARK-24233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24233: - Description: I know that I can use wild card * to read all subfolders. But, I am trying to use

[jira] [Updated] (SPARK-24233) Union Operation on Read of Dataframe does NOT produce correct result

[ https://issues.apache.org/jira/browse/SPARK-24233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24233: - Description: I know that I can use wild card * to read all subfolders. But, I am trying to use

[jira] [Updated] (SPARK-24233) Union Operation on Read of Dataframe does NOT produce correct result

[ https://issues.apache.org/jira/browse/SPARK-24233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24233: - Description: I know that I can use wild card * to read all subfolders. But, I am trying to use

[jira] [Commented] (SPARK-25452) Query with where clause is giving unexpected result in case of float column

[ https://issues.apache.org/jira/browse/SPARK-25452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1781#comment-1781 ] Hyukjin Kwon commented on SPARK-25452: -- [~shivuson...@gmail.com], are you still wor

[jira] [Reopened] (SPARK-14352) approxQuantile should support multi columns

[ https://issues.apache.org/jira/browse/SPARK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-14352: -- > approxQuantile should support multi columns > --- > >

[jira] [Assigned] (SPARK-14352) approxQuantile should support multi columns

[ https://issues.apache.org/jira/browse/SPARK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-14352: Assignee: (was: zhengruifeng) > approxQuantile should support multi columns > ---

[jira] [Resolved] (SPARK-14352) approxQuantile should support multi columns

[ https://issues.apache.org/jira/browse/SPARK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-14352. -- Resolution: Duplicate > approxQuantile should support multi columns >

[jira] [Resolved] (SPARK-25437) Using OpenHashMap replace HashMap improve Encoder Performance

[ https://issues.apache.org/jira/browse/SPARK-25437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25437. -- Resolution: Invalid > Using OpenHashMap replace HashMap improve Encoder Performance >

[jira] [Resolved] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25179. - Resolution: Fixed Fix Version/s: 2.4.0 > Document the features that require Pyarrow 0.10 > --

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1775#comment-1775 ] Wenchen Fan commented on SPARK-14220: - You will find it when Spark 2.4.0 is released

[jira] [Commented] (SPARK-24064) [Spark SQL] Create table using csv does not support binary column Type

[ https://issues.apache.org/jira/browse/SPARK-24064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1765#comment-1765 ] Hyukjin Kwon commented on SPARK-24064: -- That's trivial. It explicitly throws an exc

[jira] [Resolved] (SPARK-24064) [Spark SQL] Create table using csv does not support binary column Type

[ https://issues.apache.org/jira/browse/SPARK-24064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24064. -- Resolution: Won't Fix > [Spark SQL] Create table using csv does not support binary column Typ

[jira] [Commented] (SPARK-25545) CSV loading with DROPMALFORMED mode doesn't correctly drop rows that do not confirm to non-nullable schema fields

[ https://issues.apache.org/jira/browse/SPARK-25545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1758#comment-1758 ] Hyukjin Kwon commented on SPARK-25545: -- See the discussion at https://github.com/ap

[jira] [Updated] (SPARK-25864) Make main args set correctly in BenchmarkBase

[ https://issues.apache.org/jira/browse/SPARK-25864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-25864: -- Description: Set main args correctly in BenchmarkBase, to make it accessible for its subclass. It will benef

[jira] [Updated] (SPARK-25864) Make main args set correctly in BenchmarkBase

[ https://issues.apache.org/jira/browse/SPARK-25864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-25864: -- Description: Set main args correctly in BenchmarkBase, to make it accessible for its subclass. It will benef

[jira] [Updated] (SPARK-25864) Make main args set correctly in BenchmarkBase

[ https://issues.apache.org/jira/browse/SPARK-25864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-25864: -- Summary: Make main args set correctly in BenchmarkBase (was: Make mainArgs correctly set in BenchmarkBase) >

[jira] [Updated] (SPARK-25864) Make mainArgs correctly set in BenchmarkBase

[ https://issues.apache.org/jira/browse/SPARK-25864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-25864: -- Description: Save main args correctly in BenchmarkBase, to make it accessible for its subclass. It will bene

[jira] [Updated] (SPARK-25864) Make mainArgs correctly set in BenchmarkBase

[ https://issues.apache.org/jira/browse/SPARK-25864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-25864: -- Description: Make mainArgs correctly set in BenchmarkBase, it will benefit: * BuiltInDataSourceWriteBenchmark

[jira] [Updated] (SPARK-25864) Make mainArgs correctly set in BenchmarkBase

[ https://issues.apache.org/jira/browse/SPARK-25864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-25864: -- Description: Make mainArgs correctly set in BenchmarkBase, it will benefit: - BuiltInDataSourceWriteBenchmark

[jira] [Updated] (SPARK-25864) Make mainArgs correctly set in BenchmarkBase

[ https://issues.apache.org/jira/browse/SPARK-25864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-25864: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-25475 > Make mainArgs correctly set in BenchmarkBase >

[jira] [Created] (SPARK-25864) Make mainArgs correctly set in BenchmarkBase

yucai created SPARK-25864: - Summary: Make mainArgs correctly set in BenchmarkBase Key: SPARK-25864 URL: https://issues.apache.org/jira/browse/SPARK-25864 Project: Spark Issue Type: Bug Comp

[jira] [Assigned] (SPARK-25797) Views created via 2.1 cannot be read via 2.2+

[ https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25797: - Assignee: Chenxiao Mao > Views created via 2.1 cannot be read via 2.2+ > --

[jira] [Updated] (SPARK-25797) Views created via 2.1 cannot be read via 2.2+

[ https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25797: -- Fix Version/s: 2.4.0 > Views created via 2.1 cannot be read via 2.2+ > ---

[jira] [Resolved] (SPARK-25797) Views created via 2.1 cannot be read via 2.2+

[ https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25797. --- Resolution: Fixed Fix Version/s: 2.3.3 2.2.3 Issue resolved by pul

[jira] [Commented] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala

[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1736#comment-1736 ] Ruslan Dautkhanov commented on SPARK-25863: --- It seems error happens here [htt

[jira] [Updated] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala:1

[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-25863: -- Affects Version/s: 2.3.1 > java.lang.UnsupportedOperationException: empty.max at > or

[jira] [Commented] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala

[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1726#comment-1726 ] Ruslan Dautkhanov commented on SPARK-25863: --- This happens only on one of our h

[jira] [Created] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala:1

Ruslan Dautkhanov created SPARK-25863: - Summary: java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala:1475) Key

[jira] [Resolved] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25293. -- Resolution: Invalid Yea, the answer looks correct. > Dataframe write to csv saves part files

[jira] [Assigned] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25179: Assignee: Hyukjin Kwon (was: Bryan Cutler) > Document the features that require Pyarrow

[jira] [Commented] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1683#comment-1683 ] Apache Spark commented on SPARK-25179: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25179: Assignee: Apache Spark (was: Bryan Cutler) > Document the features that require Pyarrow

[jira] [Commented] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1682#comment-1682 ] Apache Spark commented on SPARK-25179: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25179: Assignee: Bryan Cutler (was: Apache Spark) > Document the features that require Pyarrow

[jira] [Updated] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25179: - Issue Type: Sub-task (was: Task) Parent: SPARK-21187 > Document the features that requi

[jira] [Resolved] (SPARK-25787) [K8S] Spark can't use data locality information

[ https://issues.apache.org/jira/browse/SPARK-25787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25787. -- Resolution: Cannot Reproduce I can't reproduce this given the information here. I am leaving t

[jira] [Updated] (SPARK-25674) If the records are incremented by more than 1 at a time,the number of bytes might rarely ever get updated

[ https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25674: Fix Version/s: (was: 2.4.1) (was: 3.0.0) 2.4.0 > If the reco

[jira] [Updated] (SPARK-25636) spark-submit swallows the failure reason when there is an error connecting to master

[ https://issues.apache.org/jira/browse/SPARK-25636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25636: Fix Version/s: (was: 2.4.1) (was: 3.0.0) 2.4.0 > spark-submi

[jira] [Updated] (SPARK-25677) Configuring zstd compression in JDBC throwing IllegalArgumentException Exception

[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25677: Fix Version/s: (was: 2.4.1) (was: 3.0.0) 2.4.0 > Configuring

[jira] [Updated] (SPARK-25639) Add documentation on foreachBatch, and multiple watermark policy

[ https://issues.apache.org/jira/browse/SPARK-25639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25639: Fix Version/s: (was: 2.4.1) 2.4.0 > Add documentation on foreachBatch, and multiple

[jira] [Updated] (SPARK-24787) Events being dropped at an alarming rate due to hsync being slow for eventLogging

[ https://issues.apache.org/jira/browse/SPARK-24787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24787: Fix Version/s: (was: 2.4.1) (was: 3.0.0) 2.4.0 > Events bein

[jira] [Resolved] (SPARK-25816) Functions does not resolve Columns correctly

[ https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25816. - Resolution: Fixed Fix Version/s: 2.4.0 2.3.3 > Functions does not resolve Colu

[jira] [Updated] (SPARK-25795) Fix CSV SparkR SQL Example

[ https://issues.apache.org/jira/browse/SPARK-25795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25795: Fix Version/s: (was: 2.4.1) (was: 3.0.0) 2.4.0 > Fix CSV Spa

[jira] [Updated] (SPARK-25805) Flaky test: DataFrameSuite.SPARK-25159 unittest failure

[ https://issues.apache.org/jira/browse/SPARK-25805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25805: Fix Version/s: (was: 2.4.1) (was: 3.0.0) 2.4.0 > Flaky test:

[jira] [Updated] (SPARK-25803) The -n option to docker-image-tool.sh causes other options to be ignored

[ https://issues.apache.org/jira/browse/SPARK-25803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25803: Fix Version/s: (was: 2.4.1) (was: 3.0.0) 2.4.0 > The -n opti

[jira] [Updated] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25697: Fix Version/s: (was: 2.4.1) 2.4.0 > When zstd compression enabled in progress appli

[jira] [Assigned] (SPARK-25816) Functions does not resolve Columns correctly

[ https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25816: --- Assignee: Peter Toth > Functions does not resolve Columns correctly > -

[jira] [Updated] (SPARK-25271) Creating parquet table with all the column null throws exception

[ https://issues.apache.org/jira/browse/SPARK-25271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25271: -- Priority: Critical (was: Major) > Creating parquet table with all the column null throws exce

[jira] [Updated] (SPARK-23907) Support regr_* functions

[ https://issues.apache.org/jira/browse/SPARK-23907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23907: -- Target Version/s: (was: 2.4.0) > Support regr_* functions > > >

[jira] [Resolved] (SPARK-23907) Support regr_* functions

[ https://issues.apache.org/jira/browse/SPARK-23907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-23907. --- Resolution: Won't Do > Support regr_* functions > > >

[jira] [Reopened] (SPARK-23907) Support regr_* functions

[ https://issues.apache.org/jira/browse/SPARK-23907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-23907: --- > Support regr_* functions > > > Key: SPARK-23907 >

[jira] [Updated] (SPARK-23907) Support regr_* functions

[ https://issues.apache.org/jira/browse/SPARK-23907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23907: -- Fix Version/s: (was: 2.4.0) > Support regr_* functions > > >

[jira] [Resolved] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat and OrcFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25806. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22802 [https://github.c

[jira] [Assigned] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat and OrcFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25806: - Assignee: liuxian > The instanceof FileSplit is redundant for ParquetFileFormat and OrcFileFor

[jira] [Commented] (SPARK-24437) Memory leak in UnsafeHashedRelation

[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1572#comment-1572 ] t oo commented on SPARK-24437: -- can this be merged? > Memory leak in UnsafeHashedRelation

[jira] [Commented] (SPARK-22575) Making Spark Thrift Server clean up its cache

[ https://issues.apache.org/jira/browse/SPARK-22575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1573#comment-1573 ] t oo commented on SPARK-22575: -- can this be merged? > Making Spark Thrift Server clean up

[jira] [Commented] (SPARK-25862) Remove rangeBetween APIs introduced in SPARK-21608

[ https://issues.apache.org/jira/browse/SPARK-25862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1568#comment-1568 ] Apache Spark commented on SPARK-25862: -- User 'rxin' has created a pull request for

[jira] [Commented] (SPARK-21608) Window rangeBetween() API should allow literal boundary

[ https://issues.apache.org/jira/browse/SPARK-21608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1567#comment-1567 ] Apache Spark commented on SPARK-21608: -- User 'rxin' has created a pull request for

[jira] [Assigned] (SPARK-25862) Remove rangeBetween APIs introduced in SPARK-21608

[ https://issues.apache.org/jira/browse/SPARK-25862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25862: Assignee: Apache Spark (was: Reynold Xin) > Remove rangeBetween APIs introduced in SPARK

[jira] [Assigned] (SPARK-25862) Remove rangeBetween APIs introduced in SPARK-21608

[ https://issues.apache.org/jira/browse/SPARK-25862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25862: Assignee: Reynold Xin (was: Apache Spark) > Remove rangeBetween APIs introduced in SPARK

[jira] [Commented] (SPARK-25862) Remove rangeBetween APIs introduced in SPARK-21608

[ https://issues.apache.org/jira/browse/SPARK-25862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1566#comment-1566 ] Apache Spark commented on SPARK-25862: -- User 'rxin' has created a pull request for

[jira] [Commented] (SPARK-25841) Redesign window function rangeBetween API

[ https://issues.apache.org/jira/browse/SPARK-25841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1559#comment-1559 ] Reynold Xin commented on SPARK-25841: - I posted api proposal sketches in  https://is

[jira] [Updated] (SPARK-25843) Redesign rangeBetween API

[ https://issues.apache.org/jira/browse/SPARK-25843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-25843: Description: See parent ticket for more information. Two proposals with sketches:   Proposal 1. c

[jira] [Created] (SPARK-25862) Remove rangeBetween APIs introduced in SPARK-21608

Reynold Xin created SPARK-25862: --- Summary: Remove rangeBetween APIs introduced in SPARK-21608 Key: SPARK-25862 URL: https://issues.apache.org/jira/browse/SPARK-25862 Project: Spark Issue Type:

[jira] [Commented] (SPARK-25816) Functions does not resolve Columns correctly

[ https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1523#comment-1523 ] Dongjoon Hyun commented on SPARK-25816: --- Thank you, [~bzhang] and [~petertoth]. I

[jira] [Updated] (SPARK-25816) Functions does not resolve Columns correctly

[ https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25816: -- Affects Version/s: 2.4.0 > Functions does not resolve Columns correctly >

[jira] [Updated] (SPARK-25816) Functions does not resolve Columns correctly

[ https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25816: -- Affects Version/s: 2.3.2 > Functions does not resolve Columns correctly >

[jira] [Updated] (SPARK-25758) Deprecate BisectingKMeans compute cost

[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25758: -- Labels: 3.0.0 (was: ) > Deprecate BisectingKMeans compute cost >

[jira] [Resolved] (SPARK-25845) Fix MatchError for calendar interval type in rangeBetween

[ https://issues.apache.org/jira/browse/SPARK-25845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-25845. -- Resolution: Fixed Fix Version/s: 3.0.0 Resolved by https://github.com/apache/spark/pull

[jira] [Commented] (SPARK-25758) Deprecate BisectingKMeans compute cost

[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1343#comment-1343 ] Apache Spark commented on SPARK-25758: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-25758) Deprecate BisectingKMeans compute cost

[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25758: Assignee: Marco Gaido (was: Apache Spark) > Deprecate BisectingKMeans compute cost > ---

[jira] [Assigned] (SPARK-25758) Deprecate BisectingKMeans compute cost

[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25758: Assignee: Apache Spark (was: Marco Gaido) > Deprecate BisectingKMeans compute cost > ---

[jira] [Updated] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat and OrcFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25806: Summary: The instanceof FileSplit is redundant for ParquetFileFormat and OrcFileFormat (was: The instan

[jira] [Updated] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25806: Description: The instance of FileSplit is redundant  {color:#33}in the {color}{color:#f79232}ParquetFi

[jira] [Assigned] (SPARK-25833) Views without column names created by Hive are not readable by Spark

[ https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25833: Assignee: Apache Spark > Views without column names created by Hive are not readable by S

[jira] [Assigned] (SPARK-25833) Views without column names created by Hive are not readable by Spark

[ https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25833: Assignee: (was: Apache Spark) > Views without column names created by Hive are not re

[jira] [Commented] (SPARK-25833) Views without column names created by Hive are not readable by Spark

[ https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1302#comment-1302 ] Apache Spark commented on SPARK-25833: -- User 'seancxmao' has created a pull request

[jira] [Commented] (SPARK-25833) Views without column names created by Hive are not readable by Spark

[ https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1303#comment-1303 ] Apache Spark commented on SPARK-25833: -- User 'seancxmao' has created a pull request