[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Created] (SPARK-30262) Fix NumberFormatException when totalSize is empty

chenliang created SPARK-30262: - Summary: Fix NumberFormatException when totalSize is empty Key: SPARK-30262 URL: https://issues.apache.org/jira/browse/SPARK-30262 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

[ https://issues.apache.org/jira/browse/SPARK-30261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30261: -- Description: For SparkSQL,When we do some alter operations on hive table, the owner of hive table wou

[jira] [Updated] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

[ https://issues.apache.org/jira/browse/SPARK-30261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30261: -- Description: For SparkSQL,When we do some alter operations on hive table, the owner of hive table wou

[jira] [Updated] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

[ https://issues.apache.org/jira/browse/SPARK-30261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30261: -- Description: For SparkSQL,When we do some alter operations on hive table, the owner of hive table wou

[jira] [Commented] (SPARK-29940) Whether contains schema for this parameter "spark.yarn.historyServer.address"

[ https://issues.apache.org/jira/browse/SPARK-29940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996224#comment-16996224 ] hehuiyuan commented on SPARK-29940: --- Hi , anyone ? > Whether contains schema for thi

[jira] [Created] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

chenliang created SPARK-30261: - Summary: Should not change owner of hive table for some commands like 'alter' operation Key: SPARK-30261 URL: https://issues.apache.org/jira/browse/SPARK-30261 Project: S

[jira] [Commented] (SPARK-30250) SparkQL div is undocumented

[ https://issues.apache.org/jira/browse/SPARK-30250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996209#comment-16996209 ] Michael Chirico commented on SPARK-30250: - Doubly great news! Thanks > SparkQL

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Target Version/s: 2.4.3, 2.3.0 (was: 2.4.3) > Spark-Shell throw ClassNotFoundException exception for

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Fix Version/s: 2.3.0 > Spark-Shell throw ClassNotFoundException exception for more than one > stateme

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for the

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for the

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for the

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for th

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for the

[jira] [Created] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

chenliang created SPARK-30260: - Summary: Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar Key: SPARK-30260 URL: https://issues.apache.org/jira/browse/SPARK-30260

[jira] [Updated] (SPARK-30259) CREATE TABLE throw error when session catalog specified

[ https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-30259: -- Description: Spark throw error when the session catalog is specified explicitly in "CREATE TABLE" and

[jira] [Updated] (SPARK-30259) CREATE TABLE throw error when session catalog specified

[ https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-30259: -- Description: Spark throw error when the session catalog is specified explicitly in "CREATE TABLE" and

[jira] [Updated] (SPARK-30259) CREATE TABLE throw error when session catalog specified

[ https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-30259: -- Summary: CREATE TABLE throw error when session catalog specified (was: CREATE TABLE AS SELECT throw e

[jira] [Updated] (SPARK-30259) CREATE TABLE AS SELECT throw error when session catalog specified

[ https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-30259: -- Description: Spark throw error when the session catalog is specified explicitly in the CREATE TABLE A

[jira] [Created] (SPARK-30259) CREATE TABLE AS SELECT throw error when session catalog specified

Hu Fuwang created SPARK-30259: - Summary: CREATE TABLE AS SELECT throw error when session catalog specified Key: SPARK-30259 URL: https://issues.apache.org/jira/browse/SPARK-30259 Project: Spark

[jira] [Updated] (SPARK-30190) HistoryServerDiskManager will fail on appStoreDir in s3

[ https://issues.apache.org/jira/browse/SPARK-30190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30190: -- Affects Version/s: (was: 2.4.4) 3.0.0 > HistoryServerDiskManager wi

[jira] [Commented] (SPARK-30218) Columns used in inequality conditions for joins not resolved correctly in case of common lineage

[ https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996084#comment-16996084 ] Dongjoon Hyun commented on SPARK-30218: --- Thank you for reporting with the investig

[jira] [Comment Edited] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996082#comment-16996082 ] Evgenii edited comment on SPARK-23015 at 12/14/19 2:25 AM: --- We

[jira] [Commented] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996082#comment-16996082 ] Evgenii commented on SPARK-23015: - We invoke it from Java code in parallel too. > spark

[jira] [Comment Edited] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996080#comment-16996080 ] Evgenii edited comment on SPARK-23015 at 12/14/19 2:23 AM: --- Gu

[jira] [Commented] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996080#comment-16996080 ] Evgenii commented on SPARK-23015: - Guys, why not to invoke %RANDOM% multiple times? Just

[jira] [Updated] (SPARK-30218) Columns used in inequality conditions for joins not resolved correctly in case of common lineage

[ https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30218: -- Affects Version/s: (was: 2.4.3) (was: 2.4.2)

[jira] [Updated] (SPARK-30218) Columns used in inequality conditions for joins not resolved correctly in case of common lineage

[ https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30218: -- Affects Version/s: 2.4.2 2.4.3 2.4.4 > Columns u

[jira] [Reopened] (SPARK-17398) Failed to query on external JSon Partitioned table

[ https://issues.apache.org/jira/browse/SPARK-17398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wing Yew Poon reopened SPARK-17398: --- This issue was never actually fixed. Evidently the problem still exists. I'll create a PR with a

[jira] [Resolved] (SPARK-30194) Re-enable checkstyle for Java

[ https://issues.apache.org/jira/browse/SPARK-30194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30194. --- Resolution: Won't Do > Re-enable checkstyle for Java > - > >

[jira] [Closed] (SPARK-30232) Fix the the ArthmeticException by zero when enable AQE

[ https://issues.apache.org/jira/browse/SPARK-30232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-30232. - > Fix the the ArthmeticException by zero when enable AQE > -

[jira] [Commented] (SPARK-30212) COUNT(DISTINCT) window function should be supported

[ https://issues.apache.org/jira/browse/SPARK-30212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996067#comment-16996067 ] Dongjoon Hyun commented on SPARK-30212: --- Thank you for filing a JIRA, @Kernel Forc

[jira] [Updated] (SPARK-30212) COUNT(DISTINCT) window function should be supported

[ https://issues.apache.org/jira/browse/SPARK-30212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30212: -- Affects Version/s: (was: 2.4.4) 3.0.0 > COUNT(DISTINCT) window func

[jira] [Updated] (SPARK-30212) COUNT(DISTINCT) window function should be supported

[ https://issues.apache.org/jira/browse/SPARK-30212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30212: -- Issue Type: Improvement (was: Bug) > COUNT(DISTINCT) window function should be supported > --

[jira] [Updated] (SPARK-30212) COUNT(DISTINCT) window function should be supported

[ https://issues.apache.org/jira/browse/SPARK-30212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30212: -- Labels: (was: SQL distinct window_function) > COUNT(DISTINCT) window function should be supp

[jira] [Commented] (SPARK-30181) Throws runtime exception when filter metastore partition key that's not string type or integral types

[ https://issues.apache.org/jira/browse/SPARK-30181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996065#comment-16996065 ] L. C. Hsieh commented on SPARK-30181: - This should be fixed by SPARK-30238. > Throw

[jira] [Commented] (SPARK-30257) Mapping simpleString to Spark SQL types

[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996064#comment-16996064 ] Dongjoon Hyun commented on SPARK-30257: --- Hi, [~svanhooser]. I triggered the full S

[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types

[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30257: -- Affects Version/s: (was: 2.4.4) 3.0.0 > Mapping simpleString to Spa

[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types

[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30257: -- Priority: Major (was: Critical) > Mapping simpleString to Spark SQL types > -

[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types

[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30257: -- Labels: (was: PySpark feature) > Mapping simpleString to Spark SQL types > -

[jira] [Commented] (SPARK-30242) Support reading Parquet files from Stream Buffer

[ https://issues.apache.org/jira/browse/SPARK-30242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996046#comment-16996046 ] Jelther Oliveira Gonçalves commented on SPARK-30242: Hi [~dongjoon],

[jira] [Updated] (SPARK-30239) Creating a dataframe with Pandas rather than Numpy datatypes fails

[ https://issues.apache.org/jira/browse/SPARK-30239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30239: -- Summary: Creating a dataframe with Pandas rather than Numpy datatypes fails (was: [Python] Cr

[jira] [Updated] (SPARK-30242) Support reading Parquet files from Stream Buffer

[ https://issues.apache.org/jira/browse/SPARK-30242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30242: -- Component/s: (was: SQL) PySpark > Support reading Parquet files from Stre

[jira] [Updated] (SPARK-30239) [Python] Creating a dataframe with Pandas rather than Numpy datatypes fails

[ https://issues.apache.org/jira/browse/SPARK-30239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30239: -- Labels: (was: easyfix) > [Python] Creating a dataframe with Pandas rather than Numpy datatyp

[jira] [Commented] (SPARK-30242) Support reading Parquet files from Stream Buffer

[ https://issues.apache.org/jira/browse/SPARK-30242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996045#comment-16996045 ] Dongjoon Hyun commented on SPARK-30242: --- Hi, [~jetolgon]. Thank you for suggestion

[jira] [Updated] (SPARK-30242) Support reading Parquet files from Stream Buffer

[ https://issues.apache.org/jira/browse/SPARK-30242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30242: -- Affects Version/s: (was: 2.4.4) 3.0.0 > Support reading Parquet fil

[jira] [Updated] (SPARK-30242) Support reading Parquet files from Stream Buffer

[ https://issues.apache.org/jira/browse/SPARK-30242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30242: -- Component/s: (was: Spark Core) SQL > Support reading Parquet files from S

[jira] [Commented] (SPARK-30249) Invalid Column Names in parquet tables should not be allowed

[ https://issues.apache.org/jira/browse/SPARK-30249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996044#comment-16996044 ] Dongjoon Hyun commented on SPARK-30249: --- I believe it's prevented because ORC form

[jira] [Resolved] (SPARK-30250) SparkQL div is undocumented

[ https://issues.apache.org/jira/browse/SPARK-30250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30250. --- Resolution: Duplicate Thank you for filing a JIRA, [~michaelchirico].  SPARK-16323 added at

[jira] [Updated] (SPARK-30250) SparkQL div is undocumented

[ https://issues.apache.org/jira/browse/SPARK-30250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30250: -- Affects Version/s: (was: 2.4.4) 3.0.0 > SparkQL div is undocumented

[jira] [Updated] (SPARK-28264) Revisiting Python / pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28264: Priority: Blocker (was: Critical) > Revisiting Python / pandas UDF > -- > >

[jira] [Closed] (SPARK-30251) faster way to read csv.gz?

[ https://issues.apache.org/jira/browse/SPARK-30251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-30251. - > faster way to read csv.gz? > -- > > Key: SPARK-30251 >

[jira] [Resolved] (SPARK-30251) faster way to read csv.gz?

[ https://issues.apache.org/jira/browse/SPARK-30251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30251. --- Resolution: Invalid Hi, [~toopt4] . Sorry, but Jira is not for Q&A. You had better send an e

[jira] [Resolved] (SPARK-30143) StreamingQuery.stop() should not block indefinitely

[ https://issues.apache.org/jira/browse/SPARK-30143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30143. - Fix Version/s: 3.0.0 Resolution: Done Resolved as part of [https://github.com/apache/spar

[jira] [Assigned] (SPARK-30143) StreamingQuery.stop() should not block indefinitely

[ https://issues.apache.org/jira/browse/SPARK-30143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-30143: --- Assignee: Burak Yavuz > StreamingQuery.stop() should not block indefinitely > -

[jira] [Resolved] (SPARK-30167) Log4j configuration for REPL can't override the root logger properly.

[ https://issues.apache.org/jira/browse/SPARK-30167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-30167. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull reque

[jira] [Resolved] (SPARK-30077) create TEMPORARY VIEW USING should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-30077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-30077. Resolution: Invalid > create TEMPORARY VIEW USING should look up catalog/table like v2 commands >

[jira] [Commented] (SPARK-30077) create TEMPORARY VIEW USING should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-30077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995945#comment-16995945 ] Pablo Langa Blanco commented on SPARK-30077: [~huaxingao] Can we close this

[jira] [Commented] (SPARK-29563) CREATE TABLE LIKE should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995942#comment-16995942 ] Pablo Langa Blanco commented on SPARK-29563: [~dkbiswal] Are you still worki

[jira] [Commented] (SPARK-30257) Mapping simpleString to Spark SQL types

[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995896#comment-16995896 ] Shelby Vanhooser commented on SPARK-30257: -- All tests passing!  > Mapping simp

[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types

[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shelby Vanhooser updated SPARK-30257: - Labels: PySpark feature (was: ) > Mapping simpleString to Spark SQL types > ---

[jira] [Updated] (SPARK-30258) Eliminate warnings of deprecated Spark APIs in tests

[ https://issues.apache.org/jira/browse/SPARK-30258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30258: --- Summary: Eliminate warnings of deprecated Spark APIs in tests (was: Eliminate warnings of depracted

[jira] [Created] (SPARK-30258) Eliminate warnings of depracted Spark APIs in tests

Maxim Gekk created SPARK-30258: -- Summary: Eliminate warnings of depracted Spark APIs in tests Key: SPARK-30258 URL: https://issues.apache.org/jira/browse/SPARK-30258 Project: Spark Issue Type: S

[jira] [Commented] (SPARK-6235) Address various 2G limits

[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995889#comment-16995889 ] Samuel Shepard commented on SPARK-6235: --- One use case could be fetching large resul

[jira] [Resolved] (SPARK-29449) Add tooltip to Spark WebUI

[ https://issues.apache.org/jira/browse/SPARK-29449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29449. -- Fix Version/s: 3.0.0 Resolution: Done > Add tooltip to Spark WebUI > --

[jira] [Resolved] (SPARK-29455) Improve tooltip information for Stages Tab

[ https://issues.apache.org/jira/browse/SPARK-29455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29455. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26859 [https://

[jira] [Assigned] (SPARK-29455) Improve tooltip information for Stages Tab

[ https://issues.apache.org/jira/browse/SPARK-29455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29455: - Assignee: Sharanabasappa G Keriwaddi > Improve tooltip information for Stages Tab > ---

[jira] [Resolved] (SPARK-30216) Use python3 in Docker release image

[ https://issues.apache.org/jira/browse/SPARK-30216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30216. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26848 [https://

[jira] [Commented] (SPARK-30230) Like ESCAPE syntax can not use '_' and '%'

[ https://issues.apache.org/jira/browse/SPARK-30230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995838#comment-16995838 ] Dongjoon Hyun commented on SPARK-30230: --- The commit is reverted via  https://githu

[jira] [Reopened] (SPARK-30230) Like ESCAPE syntax can not use '_' and '%'

[ https://issues.apache.org/jira/browse/SPARK-30230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-30230: --- Assignee: (was: ulysses you) > Like ESCAPE syntax can not use '_' and '%' > --

[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types

[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shelby Vanhooser updated SPARK-30257: - Component/s: (was: Input/Output) PySpark > Mapping simpleString to

[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types

[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shelby Vanhooser updated SPARK-30257: - Description: The PySpark mapping from simpleString to Spark SQL types are too manual rig

[jira] [Created] (SPARK-30257) Mapping simpleString to Spark SQL types

Shelby Vanhooser created SPARK-30257: Summary: Mapping simpleString to Spark SQL types Key: SPARK-30257 URL: https://issues.apache.org/jira/browse/SPARK-30257 Project: Spark Issue Type: I

[jira] [Comment Edited] (SPARK-28502) Error with struct conversion while using pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995815#comment-16995815 ] Nasir Ali edited comment on SPARK-28502 at 12/13/19 6:45 PM: -

[jira] [Commented] (SPARK-28502) Error with struct conversion while using pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995815#comment-16995815 ] Nasir Ali commented on SPARK-28502: --- {code:java} import numpy as np import pandas as p

[jira] [Updated] (SPARK-30256) Allow SparkLauncher to sudo before executing spark-submit

[ https://issues.apache.org/jira/browse/SPARK-30256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Evans updated SPARK-30256: --- Description: It would be useful if {{org.apache.spark.launcher.SparkLauncher}} allowed for a "sudo a

[jira] [Created] (SPARK-30256) Allow SparkLauncher to sudo before executing spark-submit

Jeff Evans created SPARK-30256: -- Summary: Allow SparkLauncher to sudo before executing spark-submit Key: SPARK-30256 URL: https://issues.apache.org/jira/browse/SPARK-30256 Project: Spark Issue T

[jira] [Commented] (SPARK-30168) Eliminate warnings in Parquet datasource

[ https://issues.apache.org/jira/browse/SPARK-30168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995754#comment-16995754 ] Maxim Gekk commented on SPARK-30168: [~Ankitraj] Go ahead. > Eliminate warnings in

[jira] [Assigned] (SPARK-30243) Upgrade K8s client dependency to 4.6.4

[ https://issues.apache.org/jira/browse/SPARK-30243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30243: - Assignee: Dongjoon Hyun > Upgrade K8s client dependency to 4.6.4 >

[jira] [Resolved] (SPARK-30243) Upgrade K8s client dependency to 4.6.4

[ https://issues.apache.org/jira/browse/SPARK-30243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30243. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26874 [https://

[jira] [Resolved] (SPARK-30248) DROP TABLE doesn't work if session catalog name is provided

[ https://issues.apache.org/jira/browse/SPARK-30248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30248. - Fix Version/s: 3.0.0 Assignee: Terry Kim Resolution: Fixed > DROP TABLE doesn't

[jira] [Commented] (SPARK-30072) Create dedicated planner for subqueries

[ https://issues.apache.org/jira/browse/SPARK-30072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995627#comment-16995627 ] Xiaoju Wu commented on SPARK-30072: --- [~cloud_fan] If the sql looks like: SELECT * FRO

[jira] [Created] (SPARK-30255) Support explain mode in SparkR df.explain

Takeshi Yamamuro created SPARK-30255: Summary: Support explain mode in SparkR df.explain Key: SPARK-30255 URL: https://issues.apache.org/jira/browse/SPARK-30255 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-30227) Add close() on DataWriter interface

[ https://issues.apache.org/jira/browse/SPARK-30227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30227. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26855 [https://gith

[jira] [Assigned] (SPARK-30227) Add close() on DataWriter interface

[ https://issues.apache.org/jira/browse/SPARK-30227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30227: --- Assignee: Jungtaek Lim > Add close() on DataWriter interface >

[jira] [Resolved] (SPARK-29741) Spark Application UI- In Environment tab add "Search" option

[ https://issues.apache.org/jira/browse/SPARK-29741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29741. -- Resolution: Won't Fix > Spark Application UI- In Environment tab add "Search" option > ---

[jira] [Resolved] (SPARK-30079) Tests fail in environments with locale different from en_US

[ https://issues.apache.org/jira/browse/SPARK-30079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30079. -- Resolution: Not A Problem > Tests fail in environments with locale different from en_US >

[jira] [Commented] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995538#comment-16995538 ] Attila Zsolt Piros commented on SPARK-27021: [~roncenzhao] # yes # I do no

[jira] [Commented] (SPARK-30208) A race condition when reading from Kafka in PySpark

[ https://issues.apache.org/jira/browse/SPARK-30208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995532#comment-16995532 ] Jungtaek Lim commented on SPARK-30208: -- I've just tested it simply with additional

[jira] [Commented] (SPARK-28825) Document EXPLAIN Statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995531#comment-16995531 ] pavithra ramachandran commented on SPARK-28825: --- [~dkbiswal] are you worki

[jira] [Created] (SPARK-30254) Fix use custom escape lead to LikeSimplification optimize failed

ulysses you created SPARK-30254: --- Summary: Fix use custom escape lead to LikeSimplification optimize failed Key: SPARK-30254 URL: https://issues.apache.org/jira/browse/SPARK-30254 Project: Spark

[jira] [Updated] (SPARK-30253) Do not add commits when releasing preview version

[ https://issues.apache.org/jira/browse/SPARK-30253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30253: Attachment: 3.0.0-preview.png > Do not add commits when releasing preview version > --

[jira] [Updated] (SPARK-30253) Do not add commits when releasing preview version

[ https://issues.apache.org/jira/browse/SPARK-30253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30253: Summary: Do not add commits when releasing preview version (was: Preview release does not add ver

[jira] [Created] (SPARK-30253) Preview release does not add version change commits to master branch

Yuming Wang created SPARK-30253: --- Summary: Preview release does not add version change commits to master branch Key: SPARK-30253 URL: https://issues.apache.org/jira/browse/SPARK-30253 Project: Spark

[jira] [Created] (SPARK-30252) Disallow negative scale of Decimal under ansi mode

wuyi created SPARK-30252: Summary: Disallow negative scale of Decimal under ansi mode Key: SPARK-30252 URL: https://issues.apache.org/jira/browse/SPARK-30252 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-30231) Support explain mode in PySpark df.explain

[ https://issues.apache.org/jira/browse/SPARK-30231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30231. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26861 [https://gi

[jira] [Assigned] (SPARK-30231) Support explain mode in PySpark df.explain

[ https://issues.apache.org/jira/browse/SPARK-30231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30231: Assignee: Takeshi Yamamuro > Support explain mode in PySpark df.explain > ---

[jira] [Updated] (SPARK-30251) faster way to read csv.gz?

[ https://issues.apache.org/jira/browse/SPARK-30251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-30251: - Description: some data providers give files in csv.gz (ie 1gb compressed which is 25gb uncompressed; or 5gb com

  1   2   >