[jira] [Assigned] (SPARK-23094) Json Readers choose wrong encoding when bad records are present and fail

[ https://issues.apache.org/jira/browse/SPARK-23094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23094: Assignee: Burak Yavuz (was: Apache Spark) > Json Readers choose wrong encoding when bad r

[jira] [Assigned] (SPARK-23094) Json Readers choose wrong encoding when bad records are present and fail

[ https://issues.apache.org/jira/browse/SPARK-23094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23094: Assignee: Apache Spark (was: Burak Yavuz) > Json Readers choose wrong encoding when bad r

[jira] [Reopened] (SPARK-23094) Json Readers choose wrong encoding when bad records are present and fail

[ https://issues.apache.org/jira/browse/SPARK-23094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-23094: - > Json Readers choose wrong encoding when bad records are present and fail >

[jira] [Updated] (SPARK-23421) Document the behavior change in SPARK-22356

[ https://issues.apache.org/jira/browse/SPARK-23421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23421: Fix Version/s: 2.3.0 > Document the behavior change in SPARK-22356 > --

[jira] [Resolved] (SPARK-23421) Document the behavior change in SPARK-22356

[ https://issues.apache.org/jira/browse/SPARK-23421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23421. - Resolution: Fixed > Document the behavior change in SPARK-22356 > ---

[jira] [Commented] (SPARK-21521) History service requires user is in any group

[ https://issues.apache.org/jira/browse/SPARK-21521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365208#comment-16365208 ] Wei Zheng commented on SPARK-21521: --- We came across the same problem recently - SHS UI

[jira] [Commented] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365194#comment-16365194 ] Igor Berman commented on SPARK-23423: - Hi [~skonto], thanks for your response! Yes y

[jira] [Updated] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Berman updated SPARK-23423: Description: Hi Mesos Version:1.1.0 I've noticed rather strange behavior of MesosCoarseGrainedSch

[jira] [Updated] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

[ https://issues.apache.org/jira/browse/SPARK-23434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23434: -- Description: When Spark reads a file path (e.g. `people.json`), it warns with a wrong error me

[jira] [Updated] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

[ https://issues.apache.org/jira/browse/SPARK-23434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23434: -- Description: When Spark reads a file path (e.g. `people.json`), it warns with a wrong error me

[jira] [Updated] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

[ https://issues.apache.org/jira/browse/SPARK-23434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23434: -- Description: When Spark reads a file path (e.g. `people.json`), it warns with a wrong error me

[jira] [Updated] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

[ https://issues.apache.org/jira/browse/SPARK-23434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23434: -- Description: When Spark reads a file path (e.g. `people.json`), it warns with a wrong error me

[jira] [Updated] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

[ https://issues.apache.org/jira/browse/SPARK-23434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23434: -- Affects Version/s: 2.0.2 > Spark should not warn `metadata directory` for a HDFS file path > --

[jira] [Commented] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

[ https://issues.apache.org/jira/browse/SPARK-23434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365150#comment-16365150 ] Apache Spark commented on SPARK-23434: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

[ https://issues.apache.org/jira/browse/SPARK-23434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23434: Assignee: (was: Apache Spark) > Spark should not warn `metadata directory` for a HDFS

[jira] [Assigned] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

[ https://issues.apache.org/jira/browse/SPARK-23434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23434: Assignee: Apache Spark > Spark should not warn `metadata directory` for a HDFS file path >

[jira] [Created] (SPARK-23434) Spark should not warn `metadata directory` for a HDFS file path

Dongjoon Hyun created SPARK-23434: - Summary: Spark should not warn `metadata directory` for a HDFS file path Key: SPARK-23434 URL: https://issues.apache.org/jira/browse/SPARK-23434 Project: Spark

[jira] [Commented] (SPARK-23427) spark.sql.autoBroadcastJoinThreshold causing OOM in the driver

[ https://issues.apache.org/jira/browse/SPARK-23427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365065#comment-16365065 ] Kazuaki Ishizaki commented on SPARK-23427: -- We would appreciate it if you could

[jira] [Created] (SPARK-23433) java.lang.IllegalStateException: more than one active taskSet for stage

Shixiong Zhu created SPARK-23433: Summary: java.lang.IllegalStateException: more than one active taskSet for stage Key: SPARK-23433 URL: https://issues.apache.org/jira/browse/SPARK-23433 Project: Spar

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 11:57 PM:

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 11:57 PM:

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 11:56 PM:

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364979#comment-16364979 ] Edwina Lu commented on SPARK-23206: --- After discussion with [~cltlfcjin] and the eBay Ha

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 11:54 PM:

[jira] [Commented] (SPARK-23430) Cannot sort "Executor ID" or "Host" columns in the task table

[ https://issues.apache.org/jira/browse/SPARK-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364976#comment-16364976 ] Apache Spark commented on SPARK-23430: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-23430) Cannot sort "Executor ID" or "Host" columns in the task table

[ https://issues.apache.org/jira/browse/SPARK-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23430: Assignee: Shixiong Zhu (was: Apache Spark) > Cannot sort "Executor ID" or "Host" columns

[jira] [Assigned] (SPARK-23430) Cannot sort "Executor ID" or "Host" columns in the task table

[ https://issues.apache.org/jira/browse/SPARK-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23430: Assignee: Apache Spark (was: Shixiong Zhu) > Cannot sort "Executor ID" or "Host" columns

[jira] [Created] (SPARK-23432) Expose executor memory metrics in the web UI for executors and stages

Edwina Lu created SPARK-23432: - Summary: Expose executor memory metrics in the web UI for executors and stages Key: SPARK-23432 URL: https://issues.apache.org/jira/browse/SPARK-23432 Project: Spark

[jira] [Created] (SPARK-23431) Expose the new executor memory metrics at the stage level

Edwina Lu created SPARK-23431: - Summary: Expose the new executor memory metrics at the stage level Key: SPARK-23431 URL: https://issues.apache.org/jira/browse/SPARK-23431 Project: Spark Issue Typ

[jira] [Updated] (SPARK-23429) Add executor memory metrics to heartbeat and expose in executors REST API

[ https://issues.apache.org/jira/browse/SPARK-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edwina Lu updated SPARK-23429: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-23206 > Add executor memory metrics to h

[jira] [Created] (SPARK-23430) Cannot sort "Executor ID" or "Host" columns in the task table

Shixiong Zhu created SPARK-23430: Summary: Cannot sort "Executor ID" or "Host" columns in the task table Key: SPARK-23430 URL: https://issues.apache.org/jira/browse/SPARK-23430 Project: Spark

[jira] [Commented] (SPARK-23429) Add executor memory metrics to heartbeat and expose in executors REST API

[ https://issues.apache.org/jira/browse/SPARK-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364967#comment-16364967 ] Edwina Lu commented on SPARK-23429: --- Subtask of SPARK-23206 > Add executor memory metr

[jira] [Created] (SPARK-23429) Add executor memory metrics to heartbeat and expose in executors REST API

Edwina Lu created SPARK-23429: - Summary: Add executor memory metrics to heartbeat and expose in executors REST API Key: SPARK-23429 URL: https://issues.apache.org/jira/browse/SPARK-23429 Project: Spark

[jira] [Updated] (SPARK-23206) Additional Memory Tuning Metrics

[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edwina Lu updated SPARK-23206: -- Issue Type: Umbrella (was: Improvement) > Additional Memory Tuning Metrics > -

[jira] [Commented] (SPARK-23094) Json Readers choose wrong encoding when bad records are present and fail

[ https://issues.apache.org/jira/browse/SPARK-23094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364956#comment-16364956 ] Apache Spark commented on SPARK-23094: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364954#comment-16364954 ] Xiao Li commented on SPARK-23410: - This is a regression we need to resolve in Spark 2.3.

[jira] [Updated] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23410: Target Version/s: 2.3.0 > Unable to read jsons in charset different from UTF-8 > --

[jira] [Updated] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23410: Priority: Blocker (was: Major) > Unable to read jsons in charset different from UTF-8 > --

[jira] [Comment Edited] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364929#comment-16364929 ] Bruce Robbins edited comment on SPARK-23410 at 2/14/18 11:17 PM: --

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364929#comment-16364929 ] Bruce Robbins commented on SPARK-23410: --- bq. I am working on a fix, just in case O

[jira] [Resolved] (SPARK-23428) Revert [SPARK-23094] Fix invalid character handling in JsonDataSource

[ https://issues.apache.org/jira/browse/SPARK-23428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23428. - Resolution: Invalid > Revert [SPARK-23094] Fix invalid character handling in JsonDataSource > --

[jira] [Updated] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23410: Component/s: (was: Input/Output) SQL > Unable to read jsons in charset different from

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364916#comment-16364916 ] Bruce Robbins commented on SPARK-23410: --- On Spark 2.2.1, I got the same result as y

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364889#comment-16364889 ] Maxim Gekk commented on SPARK-23410: I am working on a fix, just in case > Unable to

[jira] [Resolved] (SPARK-23406) Stream-stream self joins does not work

[ https://issues.apache.org/jira/browse/SPARK-23406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-23406. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20598 [https://g

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364875#comment-16364875 ] Maxim Gekk commented on SPARK-23410: I attached the file on which I tested on 2.2.1:

[jira] [Updated] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-23410: --- Attachment: utf16WithBOM.json > Unable to read jsons in charset different from UTF-8 > --

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 10:27 PM:

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 10:26 PM:

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 10:23 PM:

[jira] [Assigned] (SPARK-23368) Avoid unnecessary Exchange or Sort after projection

[ https://issues.apache.org/jira/browse/SPARK-23368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23368: Assignee: (was: Apache Spark) > Avoid unnecessary Exchange or Sort after projection >

[jira] [Commented] (SPARK-23368) Avoid unnecessary Exchange or Sort after projection

[ https://issues.apache.org/jira/browse/SPARK-23368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364867#comment-16364867 ] Apache Spark commented on SPARK-23368: -- User 'maryannxue' has created a pull request

[jira] [Comment Edited] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364866#comment-16364866 ] Bruce Robbins edited comment on SPARK-23410 at 2/14/18 10:21 PM: --

[jira] [Assigned] (SPARK-23368) Avoid unnecessary Exchange or Sort after projection

[ https://issues.apache.org/jira/browse/SPARK-23368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23368: Assignee: Apache Spark > Avoid unnecessary Exchange or Sort after projection > ---

[jira] [Comment Edited] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364849#comment-16364849 ] Maxim Gekk edited comment on SPARK-23410 at 2/14/18 10:20 PM: -

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364866#comment-16364866 ] Bruce Robbins commented on SPARK-23410: --- [~maxgekk] My simple test input of [{"fi

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 10:17 PM:

[jira] [Comment Edited] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos edited comment on SPARK-23423 at 2/14/18 10:17 PM:

[jira] [Commented] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364861#comment-16364861 ] Stavros Kontopoulos commented on SPARK-23423: - Hi [~igor.berman]. Looking at

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364849#comment-16364849 ] Maxim Gekk commented on SPARK-23410: [~bersprockets] does your json contain BOM in th

[jira] [Updated] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Berman updated SPARK-23423: Description: Hi I've noticed rather strange behavior of MesosCoarseGrainedSchedulerBackend when r

[jira] [Updated] (SPARK-20901) Feature parity for ORC with Parquet

[ https://issues.apache.org/jira/browse/SPARK-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20901: -- Affects Version/s: 2.3.0 > Feature parity for ORC with Parquet > --

[jira] [Updated] (SPARK-23428) Revert [SPARK-23094] Fix invalid character handling in JsonDataSource

[ https://issues.apache.org/jira/browse/SPARK-23428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23428: Summary: Revert [SPARK-23094] Fix invalid character handling in JsonDataSource (was: Revert ) > Revert [

[jira] [Updated] (SPARK-23428) Revert

[ https://issues.apache.org/jira/browse/SPARK-23428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23428: Description: {noformat} test("invalid json with leading nulls - from dataset") { import testImplicits

[jira] [Created] (SPARK-23428) Revert

Xiao Li created SPARK-23428: --- Summary: Revert Key: SPARK-23428 URL: https://issues.apache.org/jira/browse/SPARK-23428 Project: Spark Issue Type: Bug Components: SQL Affects Versions:

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364788#comment-16364788 ] Bruce Robbins commented on SPARK-23410: --- I am probably misunderstanding the issue,

[jira] [Commented] (SPARK-21783) Turn on ORC filter push-down by default

[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364723#comment-16364723 ] Dongjoon Hyun commented on SPARK-21783: --- Unfortunately, this is reopened by SPARK-2

[jira] [Updated] (SPARK-21783) Turn on ORC filter push-down by default

[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21783: -- Fix Version/s: (was: 2.3.0) > Turn on ORC filter push-down by default > ---

[jira] [Reopened] (SPARK-21783) Turn on ORC filter push-down by default

[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-21783: --- > Turn on ORC filter push-down by default > --- > >

[jira] [Updated] (SPARK-23427) spark.sql.autoBroadcastJoinThreshold causing OOM in the driver

[ https://issues.apache.org/jira/browse/SPARK-23427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhiraj updated SPARK-23427: --- Description: We are facing issue around value of spark.sql.autoBroadcastJoinThreshold. With spark.sql.autoBr

[jira] [Created] (SPARK-23427) spark.sql.autoBroadcastJoinThreshold causing OOM in the driver

Dhiraj created SPARK-23427: -- Summary: spark.sql.autoBroadcastJoinThreshold causing OOM in the driver Key: SPARK-23427 URL: https://issues.apache.org/jira/browse/SPARK-23427 Project: Spark Issue T

[jira] [Commented] (SPARK-23415) BufferHolderSparkSubmitSuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-23415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364686#comment-16364686 ] Dongjoon Hyun commented on SPARK-23415: --- Thank you so much, [~kiszk]! > BufferHold

[jira] [Commented] (SPARK-23415) BufferHolderSparkSubmitSuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-23415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364682#comment-16364682 ] Kazuaki Ishizaki commented on SPARK-23415: -- I am working for this. > BufferHold

[jira] [Commented] (SPARK-23234) ML python test failure due to default outputCol

[ https://issues.apache.org/jira/browse/SPARK-23234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364680#comment-16364680 ] Marco Gaido commented on SPARK-23234: - [~josephkb] maybe it is not a blocker, but sin

[jira] [Commented] (SPARK-23424) Add codegenStageId in comment

[ https://issues.apache.org/jira/browse/SPARK-23424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364653#comment-16364653 ] Apache Spark commented on SPARK-23424: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-23424) Add codegenStageId in comment

[ https://issues.apache.org/jira/browse/SPARK-23424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23424: Assignee: Apache Spark > Add codegenStageId in comment > - > >

[jira] [Assigned] (SPARK-23424) Add codegenStageId in comment

[ https://issues.apache.org/jira/browse/SPARK-23424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23424: Assignee: (was: Apache Spark) > Add codegenStageId in comment > --

[jira] [Assigned] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly

[ https://issues.apache.org/jira/browse/SPARK-23425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23425: Assignee: Apache Spark > load data for hdfs file path with wild card usage is not working

[jira] [Commented] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly

[ https://issues.apache.org/jira/browse/SPARK-23425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364605#comment-16364605 ] Apache Spark commented on SPARK-23425: -- User 'sujith71955' has created a pull reques

[jira] [Assigned] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly

[ https://issues.apache.org/jira/browse/SPARK-23425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23425: Assignee: (was: Apache Spark) > load data for hdfs file path with wild card usage is n

[jira] [Updated] (SPARK-23426) Use `hive` ORC implementation for Spark 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23426: -- Issue Type: Task (was: Bug) > Use `hive` ORC implementation for Spark 2.3.0 >

[jira] [Updated] (SPARK-23426) Use `hive` ORC impl and disable PPD for Spark 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23426: -- Summary: Use `hive` ORC impl and disable PPD for Spark 2.3.0 (was: Use `hive` ORC implementati

[jira] [Assigned] (SPARK-23426) Use `hive` ORC implementation for Spark 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23426: Assignee: Apache Spark > Use `hive` ORC implementation for Spark 2.3.0 > -

[jira] [Created] (SPARK-23426) Use `hive` ORC implementation for Spark 2.3.0

Dongjoon Hyun created SPARK-23426: - Summary: Use `hive` ORC implementation for Spark 2.3.0 Key: SPARK-23426 URL: https://issues.apache.org/jira/browse/SPARK-23426 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-23426) Use `hive` ORC implementation for Spark 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364563#comment-16364563 ] Apache Spark commented on SPARK-23426: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-23426) Use `hive` ORC implementation for Spark 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23426: Assignee: (was: Apache Spark) > Use `hive` ORC implementation for Spark 2.3.0 > --

[jira] [Commented] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly

[ https://issues.apache.org/jira/browse/SPARK-23425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364538#comment-16364538 ] Sujith commented on SPARK-23425: I am working towards resolving this bug, please let me k

[jira] [Updated] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly

[ https://issues.apache.org/jira/browse/SPARK-23425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-23425: --- Attachment: wildcard_issue.PNG > load data for hdfs file path with wild card usage is not working properly >

[jira] [Created] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly

Sujith created SPARK-23425: -- Summary: load data for hdfs file path with wild card usage is not working properly Key: SPARK-23425 URL: https://issues.apache.org/jira/browse/SPARK-23425 Project: Spark

[jira] [Created] (SPARK-23424) Add codegenStageId in comment

Kazuaki Ishizaki created SPARK-23424: Summary: Add codegenStageId in comment Key: SPARK-23424 URL: https://issues.apache.org/jira/browse/SPARK-23424 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-23234) ML python test failure due to default outputCol

[ https://issues.apache.org/jira/browse/SPARK-23234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364510#comment-16364510 ] Joseph K. Bradley commented on SPARK-23234: --- Is this still a blocker now that [

[jira] [Updated] (SPARK-23377) Bucketizer with multiple columns persistence bug

[ https://issues.apache.org/jira/browse/SPARK-23377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23377: -- Priority: Blocker (was: Critical) > Bucketizer with multiple columns persistence bug >

[jira] [Updated] (SPARK-23401) Improve test cases for all supported types and unsupported types

[ https://issues.apache.org/jira/browse/SPARK-23401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23401: - Issue Type: Sub-task (was: Test) Parent: SPARK-22216 > Improve test cases for all suppor

[jira] [Updated] (SPARK-23380) Make toPandas fallback to non-Arrow optimization if possible

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23380: - Summary: Make toPandas fallback to non-Arrow optimization if possible (was: Make toPandas fall b

[jira] [Commented] (SPARK-23420) Datasource loading not handling paths with regex chars.

[ https://issues.apache.org/jira/browse/SPARK-23420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364324#comment-16364324 ] Sean Owen commented on SPARK-23420: --- Hm. That's a different problem then. Those are URI

[jira] [Created] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

Igor Berman created SPARK-23423: --- Summary: Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors Key: SPARK-23423 URL: https://issues.apache.org/jira/browse/SPARK-234

[jira] [Commented] (SPARK-23420) Datasource loading not handling paths with regex chars.

[ https://issues.apache.org/jira/browse/SPARK-23420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364284#comment-16364284 ] Mitchell commented on SPARK-23420: -- Sean, I'm a little confused by your response. From w

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364257#comment-16364257 ] bharath kumar commented on SPARK-21302: --- I saw this issue as well with RM Webui, wh

[jira] [Updated] (SPARK-21302) history server WebUI show HTTP ERROR 500

[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar updated SPARK-21302: -- Attachment: nullpointer.PNG > history server WebUI show HTTP ERROR 500 > --

[jira] [Commented] (SPARK-23420) Datasource loading not handling paths with regex chars.

[ https://issues.apache.org/jira/browse/SPARK-23420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364251#comment-16364251 ] Sean Owen commented on SPARK-23420: --- I think that logic is mostly correct, because thos

  1   2   >