[jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark

[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701444#comment-16701444 ] Jacky Li commented on SPARK-24630: -- Beside the CREATE TABLE/STREAM to create the source and the sink,

[jira] [Commented] (SPARK-19700) Design an API for pluggable scheduler implementations

[ https://issues.apache.org/jira/browse/SPARK-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701439#comment-16701439 ] Utkarsh Maheshwari commented on SPARK-19700: [~cgbaker], have you started working on it yet?

[jira] [Assigned] (SPARK-26159) Codegen for LocalTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-26159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-26159: --- Assignee: Juliusz Sompolski > Codegen for LocalTableScanExec >

[jira] [Resolved] (SPARK-26159) Codegen for LocalTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-26159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26159. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23127

[jira] [Commented] (SPARK-26155) Spark SQL performance degradation after apply SPARK-21052 with Q19 of TPC-DS in 3TB scale

[ https://issues.apache.org/jira/browse/SPARK-26155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701401#comment-16701401 ] Wenchen Fan commented on SPARK-26155: - Can you send a PR to revert SPARK-21052 and post the

[jira] [Resolved] (SPARK-23545) [Spark-Core] port opened by the SparkDriver is vulnerable for flooding attacks

[ https://issues.apache.org/jira/browse/SPARK-23545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeep katta resolved SPARK-23545. --- Resolution: Invalid > [Spark-Core] port opened by the SparkDriver is vulnerable for

[jira] [Resolved] (SPARK-24176) The hdfs file path with wildcard can not be identified when loading data

[ https://issues.apache.org/jira/browse/SPARK-24176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA resolved SPARK-24176. -- Resolution: Duplicate closed as 23425 JIRA > The hdfs file path with

[jira] [Assigned] (SPARK-26189) Fix the doc of unionAll in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26189: Assignee: (was: Apache Spark) > Fix the doc of unionAll in SparkR >

[jira] [Commented] (SPARK-26189) Fix the doc of unionAll in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701383#comment-16701383 ] Apache Spark commented on SPARK-26189: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26189) Fix the doc of unionAll in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26189: Assignee: Apache Spark > Fix the doc of unionAll in SparkR >

[jira] [Updated] (SPARK-26196) Total tasks message in the stage is incorrect, when there are failed or killed tasks

[ https://issues.apache.org/jira/browse/SPARK-26196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26196: --- Description: Total tasks message in the stage page is incorrect when there are failed or killed tasks.  

[jira] [Updated] (SPARK-26196) Total tasks message in the stage is incorrect, when there are failed or killed tasks

[ https://issues.apache.org/jira/browse/SPARK-26196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26196: --- Summary: Total tasks message in the stage is incorrect, when there are failed or killed tasks (was: Total

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701321#comment-16701321 ] xuqianjin commented on SPARK-23410: --- hi [~maxgekk] [~hyukjin.kwon] Thank you very much. Can I just

[jira] [Commented] (SPARK-26155) Spark SQL performance degradation after apply SPARK-21052 with Q19 of TPC-DS in 3TB scale

[ https://issues.apache.org/jira/browse/SPARK-26155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701317#comment-16701317 ] Ke Jia commented on SPARK-26155: [~viirya] Thanks for your reply.  > "Q19 analysis in Spark2.3 without

[jira] [Updated] (SPARK-26182) Cost increases when optimizing scalaUDF

[ https://issues.apache.org/jira/browse/SPARK-26182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Liao updated SPARK-26182: --- Description: Let's assume that we have a udf called splitUDF which outputs a map data. The SQL

[jira] [Created] (SPARK-26197) Spark master fails to detect driver process pause

Jialin LIu created SPARK-26197: -- Summary: Spark master fails to detect driver process pause Key: SPARK-26197 URL: https://issues.apache.org/jira/browse/SPARK-26197 Project: Spark Issue Type:

[jira] [Updated] (SPARK-26155) Spark SQL performance degradation after apply SPARK-21052 with Q19 of TPC-DS in 3TB scale

[ https://issues.apache.org/jira/browse/SPARK-26155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-26155: --- Attachment: (was: Q19 analysis in Spark2.3 without L486 & 487.pdf) > Spark SQL performance degradation

[jira] [Updated] (SPARK-26155) Spark SQL performance degradation after apply SPARK-21052 with Q19 of TPC-DS in 3TB scale

[ https://issues.apache.org/jira/browse/SPARK-26155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-26155: --- Attachment: Q19 analysis in Spark2.3 without L486&487.pdf > Spark SQL performance degradation after apply

[jira] [Commented] (SPARK-26196) Total tasks message in the stage in incorrect, when there are failed or killed tasks

[ https://issues.apache.org/jira/browse/SPARK-26196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701294#comment-16701294 ] Apache Spark commented on SPARK-26196: -- User 'shahidki31' has created a pull request for this

[jira] [Assigned] (SPARK-26196) Total tasks message in the stage in incorrect, when there are failed or killed tasks

[ https://issues.apache.org/jira/browse/SPARK-26196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26196: Assignee: Apache Spark > Total tasks message in the stage in incorrect, when there are

[jira] [Assigned] (SPARK-26196) Total tasks message in the stage in incorrect, when there are failed or killed tasks

[ https://issues.apache.org/jira/browse/SPARK-26196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26196: Assignee: (was: Apache Spark) > Total tasks message in the stage in incorrect, when

[jira] [Commented] (SPARK-26195) Correct exception messages in some classes

[ https://issues.apache.org/jira/browse/SPARK-26195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701279#comment-16701279 ] Apache Spark commented on SPARK-26195: -- User 'lcqzte10192193' has created a pull request for this

[jira] [Created] (SPARK-26196) Total tasks message in the stage in incorrect, when there are failed or killed tasks

shahid created SPARK-26196: -- Summary: Total tasks message in the stage in incorrect, when there are failed or killed tasks Key: SPARK-26196 URL: https://issues.apache.org/jira/browse/SPARK-26196 Project:

[jira] [Commented] (SPARK-26196) Total tasks message in the stage in incorrect, when there are failed or killed tasks

[ https://issues.apache.org/jira/browse/SPARK-26196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701285#comment-16701285 ] shahid commented on SPARK-26196: I will raise a PR > Total tasks message in the stage in incorrect,

[jira] [Commented] (SPARK-26195) Correct exception messages in some classes

[ https://issues.apache.org/jira/browse/SPARK-26195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701281#comment-16701281 ] Apache Spark commented on SPARK-26195: -- User 'lcqzte10192193' has created a pull request for this

[jira] [Assigned] (SPARK-26195) Correct exception messages in some classes

[ https://issues.apache.org/jira/browse/SPARK-26195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26195: Assignee: (was: Apache Spark) > Correct exception messages in some classes >

[jira] [Assigned] (SPARK-26195) Correct exception messages in some classes

[ https://issues.apache.org/jira/browse/SPARK-26195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26195: Assignee: Apache Spark > Correct exception messages in some classes >

[jira] [Created] (SPARK-26195) Correct exception messages in some classes

lichaoqun created SPARK-26195: - Summary: Correct exception messages in some classes Key: SPARK-26195 URL: https://issues.apache.org/jira/browse/SPARK-26195 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701275#comment-16701275 ] Yuanjian Li commented on SPARK-10816: - Thanks for the fix and benchmark by [~ivoson],  fix commit

[jira] [Created] (SPARK-26194) Support automatic spark.authenticate secret in Kubernetes backend

Marcelo Vanzin created SPARK-26194: -- Summary: Support automatic spark.authenticate secret in Kubernetes backend Key: SPARK-26194 URL: https://issues.apache.org/jira/browse/SPARK-26194 Project: Spark

[jira] [Resolved] (SPARK-24219) Improve the docker build script to avoid copying everything in example

[ https://issues.apache.org/jira/browse/SPARK-24219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24219. Resolution: Duplicate I fixed this as part of SPARK-26025. > Improve the docker build

[jira] [Resolved] (SPARK-24383) spark on k8s: "driver-svc" are not getting deleted

[ https://issues.apache.org/jira/browse/SPARK-24383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24383. Resolution: Not A Problem This has been working reliably for me. If your k8s server is

[jira] [Resolved] (SPARK-24577) Spark submit fails with documentation example spark-pi

[ https://issues.apache.org/jira/browse/SPARK-24577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24577. Resolution: Duplicate > Spark submit fails with documentation example spark-pi >

[jira] [Resolved] (SPARK-24600) Improve support for building different types of images in dockerfile

[ https://issues.apache.org/jira/browse/SPARK-24600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24600. Resolution: Duplicate > Improve support for building different types of images in

[jira] [Resolved] (SPARK-26096) k8s integration tests should run R tests

[ https://issues.apache.org/jira/browse/SPARK-26096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26096. Resolution: Duplicate > k8s integration tests should run R tests >

[jira] [Commented] (SPARK-26125) Delegation Token seems not appropriately stored on secrets of Kubernetes/Kerberized HDFS

[ https://issues.apache.org/jira/browse/SPARK-26125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701200#comment-16701200 ] Marcelo Vanzin commented on SPARK-26125: Pretty sure this works with my patch for SPARK-25815,

[jira] [Resolved] (SPARK-25744) Allow kubernetes integration tests to be run against a real cluster.

[ https://issues.apache.org/jira/browse/SPARK-25744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25744. Resolution: Duplicate > Allow kubernetes integration tests to be run against a real

[jira] [Resolved] (SPARK-26064) Unable to fetch jar from remote repo while running spark-submit on kubernetes

[ https://issues.apache.org/jira/browse/SPARK-26064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26064. Resolution: Invalid I'm closing this for the time being. If you have a question please

[jira] [Created] (SPARK-26193) Implement shuffle write metrics in SQL

Xiao Li created SPARK-26193: --- Summary: Implement shuffle write metrics in SQL Key: SPARK-26193 URL: https://issues.apache.org/jira/browse/SPARK-26193 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-26191) Control number of truncated fields

[ https://issues.apache.org/jira/browse/SPARK-26191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26191: Assignee: Apache Spark > Control number of truncated fields >

[jira] [Resolved] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26190. Resolution: Won't Fix I'm closing this for now until I see a better use case. Seems to be

[jira] [Commented] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701140#comment-16701140 ] Marcelo Vanzin commented on SPARK-26190: bq. Can you give me one good reason that why you must

[jira] [Commented] (SPARK-26191) Control number of truncated fields

[ https://issues.apache.org/jira/browse/SPARK-26191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701139#comment-16701139 ] Apache Spark commented on SPARK-26191: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26191) Control number of truncated fields

[ https://issues.apache.org/jira/browse/SPARK-26191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26191: Assignee: (was: Apache Spark) > Control number of truncated fields >

[jira] [Created] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

Martin Loncaric created SPARK-26192: --- Summary: MesosClusterScheduler reads options from dispatcher conf instead of submission conf Key: SPARK-26192 URL: https://issues.apache.org/jira/browse/SPARK-26192

[jira] [Commented] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701136#comment-16701136 ] Gyanendra Dwivedi commented on SPARK-26190: --- [~vanzin] I am sorry I am not able to explain you

[jira] [Created] (SPARK-26191) Control number of truncated fields

Maxim Gekk created SPARK-26191: -- Summary: Control number of truncated fields Key: SPARK-26191 URL: https://issues.apache.org/jira/browse/SPARK-26191 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-26189) Fix the doc of unionAll in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26189: -- Priority: Minor (was: Major) > Fix the doc of unionAll in SparkR > -

[jira] [Commented] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700937#comment-16700937 ] Marcelo Vanzin commented on SPARK-26190: If you need to run things before spark-submit runs,

[jira] [Updated] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyanendra Dwivedi updated SPARK-26190: -- Description: The improvement request is for improvement in the SparkLauncher class

[jira] [Comment Edited] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700909#comment-16700909 ] Gyanendra Dwivedi edited comment on SPARK-26190 at 11/27/18 7:51 PM: -

[jira] [Comment Edited] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700909#comment-16700909 ] Gyanendra Dwivedi edited comment on SPARK-26190 at 11/27/18 7:44 PM: -

[jira] [Updated] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyanendra Dwivedi updated SPARK-26190: -- Description: Currently the script name is hard-coded in the 'createBuilder()' method

[jira] [Commented] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700909#comment-16700909 ] Gyanendra Dwivedi commented on SPARK-26190: --- [~vanzin] If it was so easy to run spark-submit

[jira] [Commented] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700892#comment-16700892 ] Gyanendra Dwivedi commented on SPARK-26190: --- [~vanzin] I have a wrapper custom script on top

[jira] [Commented] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700896#comment-16700896 ] Marcelo Vanzin commented on SPARK-26190: Just run your script without SparkLauncher? e.g. using

[jira] [Comment Edited] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700892#comment-16700892 ] Gyanendra Dwivedi edited comment on SPARK-26190 at 11/27/18 7:23 PM: -

[jira] [Updated] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyanendra Dwivedi updated SPARK-26190: -- Description: Currently the script name is hard-coded in the 'createBuilder()' method

[jira] [Commented] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

[ https://issues.apache.org/jira/browse/SPARK-26190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700890#comment-16700890 ] Marcelo Vanzin commented on SPARK-26190: Based solely on what you wrote here, I'm leaning

[jira] [Updated] (SPARK-26188) Spark 2.4.0 Partitioning behavior breaks backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Doucet-Girard updated SPARK-26188: - Description: My team uses spark to partition and output parquet files to amazon

[jira] [Created] (SPARK-26190) SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit

Gyanendra Dwivedi created SPARK-26190: - Summary: SparkLauncher: Allow users to set their own submitter script instead of hardcoded spark-submit Key: SPARK-26190 URL:

[jira] [Updated] (SPARK-26188) Spark 2.4.0 Partitioning behavior breaks backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Doucet-Girard updated SPARK-26188: - Summary: Spark 2.4.0 Partitioning behavior breaks backwards compatibility

[jira] [Updated] (SPARK-26188) Spark 2.4.0 behavior breaks backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Doucet-Girard updated SPARK-26188: - Description: My team uses spark to partition and output parquet files to amazon

[jira] [Updated] (SPARK-26188) Spark 2.4.0 behavior breaks backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Doucet-Girard updated SPARK-26188: - Description: My team uses spark to partition and output parquet files to amazon

[jira] [Commented] (SPARK-26189) Fix the doc of unionAll in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700880#comment-16700880 ] Xiao Li commented on SPARK-26189: - cc [~huaxingao] > Fix the doc of unionAll in SparkR >

[jira] [Updated] (SPARK-26189) Fix the doc of unionAll in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-26189: Description: We should fix the doc of unionAll in SparkR. See the discussion:

[jira] [Created] (SPARK-26189) Fix the doc of unionAll in SparkR

Xiao Li created SPARK-26189: --- Summary: Fix the doc of unionAll in SparkR Key: SPARK-26189 URL: https://issues.apache.org/jira/browse/SPARK-26189 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-26188) Spark 2.4.0 behavior breaks backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Doucet-Girard updated SPARK-26188: - Description: My team uses spark to partition and output parquet files to amazon

[jira] [Updated] (SPARK-26188) Spark 2.4.0 behavior breaks backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Doucet-Girard updated SPARK-26188: - Description: My team uses spark to partition and output parquet files to amazon

[jira] [Updated] (SPARK-26188) Spark 2.4.0 behavior breaks backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Doucet-Girard updated SPARK-26188: - Description: My team uses spark to partition and output parquet files to amazon

[jira] [Created] (SPARK-26188) Spark 2.4.0 behavior breaks backwards compatibility

Damien Doucet-Girard created SPARK-26188: Summary: Spark 2.4.0 behavior breaks backwards compatibility Key: SPARK-26188 URL: https://issues.apache.org/jira/browse/SPARK-26188 Project: Spark

[jira] [Updated] (SPARK-26187) Stream-stream left outer join returns outer nulls for already matched rows

[ https://issues.apache.org/jira/browse/SPARK-26187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Chernikov updated SPARK-26187: Description: This is basically the same issue as SPARK-26154, but with slightly easier 

[jira] [Created] (SPARK-26187) Stream-stream left outer join returns outer nulls for already matched rows

Pavel Chernikov created SPARK-26187: --- Summary: Stream-stream left outer join returns outer nulls for already matched rows Key: SPARK-26187 URL: https://issues.apache.org/jira/browse/SPARK-26187

[jira] [Commented] (SPARK-26155) Spark SQL performance degradation after apply SPARK-21052 with Q19 of TPC-DS in 3TB scale

[ https://issues.apache.org/jira/browse/SPARK-26155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700836#comment-16700836 ] Adrian Wang commented on SPARK-26155: - [~Jk_Self] can you also test this on Spark 2.4? > Spark SQL

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700829#comment-16700829 ] Huaxin Gao commented on SPARK-21291: [~felixcheung] Is it OK with you if I modify the title for this

[jira] [Commented] (SPARK-26186) In progress applications with last updated time is lesser than the cleaning interval are getting removed during cleaning logs

[ https://issues.apache.org/jira/browse/SPARK-26186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700813#comment-16700813 ] Apache Spark commented on SPARK-26186: -- User 'shahidki31' has created a pull request for this

[jira] [Commented] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700817#comment-16700817 ] Apache Spark commented on SPARK-26184: -- User 'shahidki31' has created a pull request for this

[jira] [Commented] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700815#comment-16700815 ] Apache Spark commented on SPARK-26184: -- User 'shahidki31' has created a pull request for this

[jira] [Commented] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700816#comment-16700816 ] Apache Spark commented on SPARK-26184: -- User 'shahidki31' has created a pull request for this

[jira] [Assigned] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26184: Assignee: Apache Spark > Last updated time is not getting updated in the History Server

[jira] [Assigned] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26184: Assignee: (was: Apache Spark) > Last updated time is not getting updated in the

[jira] [Assigned] (SPARK-26186) In progress applications with last updated time is lesser than the cleaning interval are getting removed during cleaning logs

[ https://issues.apache.org/jira/browse/SPARK-26186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26186: Assignee: (was: Apache Spark) > In progress applications with last updated time is

[jira] [Assigned] (SPARK-26186) In progress applications with last updated time is lesser than the cleaning interval are getting removed during cleaning logs

[ https://issues.apache.org/jira/browse/SPARK-26186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26186: Assignee: Apache Spark > In progress applications with last updated time is lesser than

[jira] [Commented] (SPARK-26186) In progress applications with last updated time is lesser than the cleaning interval are getting removed during cleaning logs

[ https://issues.apache.org/jira/browse/SPARK-26186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700814#comment-16700814 ] Apache Spark commented on SPARK-26186: -- User 'shahidki31' has created a pull request for this

[jira] [Updated] (SPARK-26185) add weightCol in python MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-26185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-26185: --- Description: https://issues.apache.org/jira/browse/SPARK-24101 added weightCol in 

[jira] [Created] (SPARK-26186) In progress applications with last updated time is lesser than the cleaning interval are getting removed during cleaning logs

shahid created SPARK-26186: -- Summary: In progress applications with last updated time is lesser than the cleaning interval are getting removed during cleaning logs Key: SPARK-26186 URL:

[jira] [Updated] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26184: --- Attachment: (was: Screenshot from 2018-11-27 13-21-34.png) > Last updated time is not getting updated

[jira] [Updated] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26184: --- Description: For inprogress application, last updated time is not getting updated. !Screenshot from

[jira] [Assigned] (SPARK-26185) add weightCol in python MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-26185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26185: Assignee: Apache Spark > add weightCol in python MulticlassClassificationEvaluator >

[jira] [Updated] (SPARK-26185) add weightCol in python MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-26185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-26185: --- Description: --https://issues.apache.org/jira/browse/SPARK-24101-- added weightCol in 

[jira] [Commented] (SPARK-26185) add weightCol in python MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-26185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700806#comment-16700806 ] Apache Spark commented on SPARK-26185: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Updated] (SPARK-26185) add weightCol in python MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-26185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-26185: --- Description: -https://issues.apache.org/jira/browse/SPARK-24101- added weightCol in 

[jira] [Assigned] (SPARK-26185) add weightCol in python MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-26185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26185: Assignee: (was: Apache Spark) > add weightCol in python

[jira] [Commented] (SPARK-26186) In progress applications with last updated time is lesser than the cleaning interval are getting removed during cleaning logs

[ https://issues.apache.org/jira/browse/SPARK-26186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700804#comment-16700804 ] shahid commented on SPARK-26186: I will raise a PR. > In progress applications with last updated time

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700799#comment-16700799 ] Maxim Gekk commented on SPARK-23410: > Even if lineSeps is set, it is still necessary to identify

[jira] [Updated] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26184: --- Attachment: Screenshot from 2018-11-27 23-22-38.png > Last updated time is not getting updated in the

[jira] [Updated] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26184: --- Description: For inprogress application, last updated time is not getting updated. !Screenshot from

[jira] [Updated] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26184: --- Attachment: (was: screenshot-1.png) > Last updated time is not getting updated in the History Server UI

[jira] [Updated] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26184: --- Attachment: Screenshot from 2018-11-27 23-20-11.png > Last updated time is not getting updated in the

[jira] [Updated] (SPARK-26184) Last updated time is not getting updated in the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-26184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26184: --- Description: For inprogress application, last updated time is not getting updated. !Screenshot from

  1   2   >