[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598284#comment-16598284 ] Evelyn Bayes commented on SPARK-25150: -- Sorry my attachment doesn't want to stick,I'll give it

[jira] [Comment Edited] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598275#comment-16598275 ] Evelyn Bayes edited comment on SPARK-25150 at 8/31/18 5:55 AM: --- I'd love

[jira] [Commented] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598277#comment-16598277 ] Hyukjin Kwon commented on SPARK-25293: -- Does this describe a question, or a bug? If it's a

[jira] [Updated] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25293: - Priority: Major (was: Critical) > Dataframe write to csv saves part files in

[jira] [Commented] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598276#comment-16598276 ] Hyukjin Kwon commented on SPARK-25293: -- Please avoid to set Critical+ which is usually reserved for

[jira] [Resolved] (SPARK-25292) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25292. -- Resolution: Duplicate > Dataframe write to csv saves part files in

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598275#comment-16598275 ] Evelyn Bayes commented on SPARK-25150: -- I'd love the chance to bug patch this. I've included a

[jira] [Resolved] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-23789. - Resolution: Duplicate > Shouldn't set hive.metastore.uris before invoking

[jira] [Reopened] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reopened SPARK-23789: - > Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider >

[jira] [Commented] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598259#comment-16598259 ] Yuming Wang commented on SPARK-23789: - Fixed by https://github.com/apache/spark/pull/20784 >

[jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25282: Description: Spark shell when run with kubernetes master, gives following errors.

[jira] [Updated] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] omkar puttagunta updated SPARK-25293: - Description:

[jira] [Created] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

omkar puttagunta created SPARK-25293: Summary: Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir Key: SPARK-25293 URL:

[jira] [Commented] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598245#comment-16598245 ] Apache Spark commented on SPARK-25021: -- User 'ifilonenko' has created a pull request for this

[jira] [Assigned] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25021: Assignee: (was: Apache Spark) > Add spark.executor.pyspark.memory support to

[jira] [Assigned] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25021: Assignee: Apache Spark > Add spark.executor.pyspark.memory support to Kubernetes >

[jira] [Created] (SPARK-25292) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

omkar puttagunta created SPARK-25292: Summary: Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir Key: SPARK-25292 URL:

[jira] [Resolved] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai resolved SPARK-25206. --- Resolution: Won't Fix Not backport to 2.3 as per [~cloud_fan]'s summary, closed. > wrong records are

[jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25282: Description: Spark shell when run with kubernetes master, gives following errors.

[jira] [Created] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

Ilan Filonenko created SPARK-25291: -- Summary: Flakiness of tests in terms of executor memory (SecretsTestSuite) Key: SPARK-25291 URL: https://issues.apache.org/jira/browse/SPARK-25291 Project: Spark

[jira] [Updated] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

[ https://issues.apache.org/jira/browse/SPARK-25291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25291: --- Description: SecretsTestSuite shows flakiness in terms of correct setting of executor

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598235#comment-16598235 ] Wenchen Fan commented on SPARK-25206: - It turns out we need to backport 3 non-trivial PRs to

[jira] [Commented] (SPARK-19809) NullPointerException on zero-size ORC file

[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598227#comment-16598227 ] Shirish Tatikonda commented on SPARK-19809: --- [~dongjoon] I am encountering the same problem

[jira] [Resolved] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12

[ https://issues.apache.org/jira/browse/SPARK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25256. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22264

[jira] [Assigned] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12

[ https://issues.apache.org/jira/browse/SPARK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25256: - Assignee: Darcy Shen > Plan mismatch errors in Hive tests in 2.12 >

[jira] [Assigned] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25290: Assignee: (was: Apache Spark) > BytesToBytesMapOnHeapSuite randomizedStressTest can

[jira] [Assigned] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25290: Assignee: Apache Spark > BytesToBytesMapOnHeapSuite randomizedStressTest can cause

[jira] [Commented] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598162#comment-16598162 ] Apache Spark commented on SPARK-25290: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

Liang-Chi Hsieh created SPARK-25290: --- Summary: BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError Key: SPARK-25290 URL: https://issues.apache.org/jira/browse/SPARK-25290

[jira] [Created] (SPARK-25289) ChiSqSelector max on empty collection

Marie Beaulieu created SPARK-25289: -- Summary: ChiSqSelector max on empty collection Key: SPARK-25289 URL: https://issues.apache.org/jira/browse/SPARK-25289 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress

[ https://issues.apache.org/jira/browse/SPARK-24748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598132#comment-16598132 ] Apache Spark commented on SPARK-24748: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-25286) Remove dangerous parmap

[ https://issues.apache.org/jira/browse/SPARK-25286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25286: Target Version/s: 2.4.0 > Remove dangerous parmap > --- > > Key:

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598115#comment-16598115 ] Saisai Shao commented on SPARK-25206: - I see, if it is not going to be merged, let's close this JIRA

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598113#comment-16598113 ] yucai commented on SPARK-25206: --- Based on our discussion in

[jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet

[ https://issues.apache.org/jira/browse/SPARK-25135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598111#comment-16598111 ] Saisai Shao commented on SPARK-25135: - What's the ETA of this issue [~yumwang]? > insert datasource

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598110#comment-16598110 ] Saisai Shao commented on SPARK-25206: - What is the status of this JIRA, are we going to backport, or

[jira] [Commented] (SPARK-25255) Add getActiveSession to SparkSession in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598089#comment-16598089 ] Apache Spark commented on SPARK-25255: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25255) Add getActiveSession to SparkSession in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25255: Assignee: Apache Spark > Add getActiveSession to SparkSession in PySpark >

[jira] [Assigned] (SPARK-25255) Add getActiveSession to SparkSession in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25255: Assignee: (was: Apache Spark) > Add getActiveSession to SparkSession in PySpark >

[jira] [Resolved] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson resolved SPARK-25287. Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22294

[jira] [Assigned] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson reassigned SPARK-25287: -- Assignee: Erik Erlandson > Check for JIRA_USERNAME and JIRA_PASSWORD up front in

[jira] [Assigned] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25287: Assignee: (was: Apache Spark) > Check for JIRA_USERNAME and JIRA_PASSWORD up front

[jira] [Commented] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597965#comment-16597965 ] Apache Spark commented on SPARK-25287: -- User 'erikerlandson' has created a pull request for this

[jira] [Assigned] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25287: Assignee: Apache Spark > Check for JIRA_USERNAME and JIRA_PASSWORD up front in

[jira] [Assigned] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25288: Assignee: Apache Spark (was: Shixiong Zhu) > Kafka transaction tests are flaky >

[jira] [Assigned] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25288: Assignee: Shixiong Zhu (was: Apache Spark) > Kafka transaction tests are flaky >

[jira] [Commented] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597958#comment-16597958 ] Apache Spark commented on SPARK-25288: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25288: - Description:

[jira] [Created] (SPARK-25288) Kafka transaction tests are flaky

Shixiong Zhu created SPARK-25288: Summary: Kafka transaction tests are flaky Key: SPARK-25288 URL: https://issues.apache.org/jira/browse/SPARK-25288 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

Erik Erlandson created SPARK-25287: -- Summary: Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py Key: SPARK-25287 URL: https://issues.apache.org/jira/browse/SPARK-25287 Project:

[jira] [Resolved] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson resolved SPARK-25275. Resolution: Fixed Fix Version/s: 2.4.0 > require memberhip in wheel to run 'su'

[jira] [Commented] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597935#comment-16597935 ] Erik Erlandson commented on SPARK-25275: {{merge_spark_pr.py}} failed to close this, closing

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597929#comment-16597929 ] Stavros Kontopoulos edited comment on SPARK-24434 at 8/30/18 9:11 PM:

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597929#comment-16597929 ] Stavros Kontopoulos commented on SPARK-24434: - Btw [~liyinan926] at some if you want to keep

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597929#comment-16597929 ] Stavros Kontopoulos edited comment on SPARK-24434 at 8/30/18 9:09 PM:

[jira] [Commented] (SPARK-25286) Remove dangerous parmap

[ https://issues.apache.org/jira/browse/SPARK-25286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597921#comment-16597921 ] Apache Spark commented on SPARK-25286: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25286) Remove dangerous parmap

[ https://issues.apache.org/jira/browse/SPARK-25286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25286: Assignee: (was: Apache Spark) > Remove dangerous parmap > --- >

[jira] [Assigned] (SPARK-25286) Remove dangerous parmap

[ https://issues.apache.org/jira/browse/SPARK-25286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25286: Assignee: Apache Spark > Remove dangerous parmap > --- > >

[jira] [Created] (SPARK-25286) Remove dangerous parmap

Maxim Gekk created SPARK-25286: -- Summary: Remove dangerous parmap Key: SPARK-25286 URL: https://issues.apache.org/jira/browse/SPARK-25286 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-24411) Adding native Java tests for `isInCollection`

[ https://issues.apache.org/jira/browse/SPARK-24411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-24411. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22253

[jira] [Assigned] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25007: Assignee: Apache Spark > Add array_intersect / array_except /array_union / array_shuffle

[jira] [Assigned] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25007: Assignee: (was: Apache Spark) > Add array_intersect / array_except /array_union /

[jira] [Commented] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597907#comment-16597907 ] Apache Spark commented on SPARK-25007: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Updated] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-25007: --- Description: Add R version of  * array_intersect -SPARK-23913- * array_except -SPARK-23915-  *

[jira] [Updated] (SPARK-25007) Add shuffle / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-25007: --- Description: Add R version of  * transform -SPARK-23928- * array_except -SPARK-23915-  *

[jira] [Assigned] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25285: Assignee: Apache Spark > Add executor task metrics to track the number of tasks started

[jira] [Assigned] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25285: Assignee: (was: Apache Spark) > Add executor task metrics to track the number of

[jira] [Commented] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597849#comment-16597849 ] Apache Spark commented on SPARK-25285: -- User 'LucaCanali' has created a pull request for this

[jira] [Updated] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-25285: Priority: Minor (was: Major) > Add executor task metrics to track the number of tasks started

[jira] [Created] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

Luca Canali created SPARK-25285: --- Summary: Add executor task metrics to track the number of tasks started and of tasks successfully completed Key: SPARK-25285 URL: https://issues.apache.org/jira/browse/SPARK-25285

[jira] [Commented] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property

[ https://issues.apache.org/jira/browse/SPARK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597808#comment-16597808 ] Apache Spark commented on SPARK-25200: -- User 'adambalogh' has created a pull request for this

[jira] [Assigned] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property

[ https://issues.apache.org/jira/browse/SPARK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25200: Assignee: Apache Spark > Allow setting HADOOP_CONF_DIR as a spark property >

[jira] [Assigned] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property

[ https://issues.apache.org/jira/browse/SPARK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25200: Assignee: (was: Apache Spark) > Allow setting HADOOP_CONF_DIR as a spark property >

[jira] [Commented] (SPARK-23435) R tests should support latest testthat

[ https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597781#comment-16597781 ] Parker Hegstrom commented on SPARK-23435: - What is the status of this? My appveyor.yml has the

[jira] [Resolved] (SPARK-25233) Give the user the option of specifying a fixed minimum message per partition per batch when using kafka direct API with backpressure

[ https://issues.apache.org/jira/browse/SPARK-25233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cody Koeninger resolved SPARK-25233. Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 3

[jira] [Assigned] (SPARK-25233) Give the user the option of specifying a fixed minimum message per partition per batch when using kafka direct API with backpressure

[ https://issues.apache.org/jira/browse/SPARK-25233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cody Koeninger reassigned SPARK-25233: -- Assignee: Reza Safi > Give the user the option of specifying a fixed minimum message

[jira] [Commented] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597750#comment-16597750 ] Apache Spark commented on SPARK-22148: -- User 'dhruve' has created a pull request for this issue:

[jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet

[ https://issues.apache.org/jira/browse/SPARK-25135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597742#comment-16597742 ] Yuming Wang commented on SPARK-25135: - [~dongjoon] orc has this issue. reproduce code: {code:scala}

[jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet

[ https://issues.apache.org/jira/browse/SPARK-25135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597741#comment-16597741 ] Apache Spark commented on SPARK-25135: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

[ https://issues.apache.org/jira/browse/SPARK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25284: Assignee: Apache Spark > Spark UI: make sure skipped stages are updated onJobEnd >

[jira] [Commented] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

[ https://issues.apache.org/jira/browse/SPARK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597661#comment-16597661 ] Apache Spark commented on SPARK-25284: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Assigned] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

[ https://issues.apache.org/jira/browse/SPARK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25284: Assignee: (was: Apache Spark) > Spark UI: make sure skipped stages are updated

[jira] [Created] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

Juliusz Sompolski created SPARK-25284: - Summary: Spark UI: make sure skipped stages are updated onJobEnd Key: SPARK-25284 URL: https://issues.apache.org/jira/browse/SPARK-25284 Project: Spark

[jira] [Assigned] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25275: Assignee: (was: Apache Spark) > require memberhip in wheel to run 'su' (in

[jira] [Commented] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597561#comment-16597561 ] Apache Spark commented on SPARK-25275: -- User 'erikerlandson' has created a pull request for this

[jira] [Assigned] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25275: Assignee: Apache Spark > require memberhip in wheel to run 'su' (in dockerfiles) >

[jira] [Assigned] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences

[ https://issues.apache.org/jira/browse/SPARK-25278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25278: Assignee: Apache Spark > Number of output rows metric of union of views is multiplied by

[jira] [Assigned] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences

[ https://issues.apache.org/jira/browse/SPARK-25278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25278: Assignee: (was: Apache Spark) > Number of output rows metric of union of views is

[jira] [Commented] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences

[ https://issues.apache.org/jira/browse/SPARK-25278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597528#comment-16597528 ] Apache Spark commented on SPARK-25278: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Updated] (SPARK-24909) Spark scheduler can hang when fetch failures, executor lost, task running on lost executor, and multiple stage attempts

[ https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-24909: -- Fix Version/s: 2.3.2 > Spark scheduler can hang when fetch failures, executor lost, task

[jira] [Updated] (SPARK-25261) Standardize the default units of spark.driver|executor.memory

[ https://issues.apache.org/jira/browse/SPARK-25261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25261: -- Target Version/s: 3.0.0 Component/s: (was: Documentation) YARN

[jira] [Assigned] (SPARK-25283) A deadlock in UnionRDD

[ https://issues.apache.org/jira/browse/SPARK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25283: Assignee: (was: Apache Spark) > A deadlock in UnionRDD > -- > >

[jira] [Assigned] (SPARK-25283) A deadlock in UnionRDD

[ https://issues.apache.org/jira/browse/SPARK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25283: Assignee: Apache Spark > A deadlock in UnionRDD > -- > >

[jira] [Commented] (SPARK-25283) A deadlock in UnionRDD

[ https://issues.apache.org/jira/browse/SPARK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597391#comment-16597391 ] Apache Spark commented on SPARK-25283: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23539) Add support for Kafka headers in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-23539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23539: Assignee: Apache Spark > Add support for Kafka headers in Structured Streaming >

[jira] [Assigned] (SPARK-23539) Add support for Kafka headers in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-23539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23539: Assignee: (was: Apache Spark) > Add support for Kafka headers in Structured

[jira] [Commented] (SPARK-23539) Add support for Kafka headers in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-23539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597380#comment-16597380 ] Apache Spark commented on SPARK-23539: -- User 'dongjinleekr' has created a pull request for this

[jira] [Updated] (SPARK-25273) How to install testthat v1.0.2

[ https://issues.apache.org/jira/browse/SPARK-25273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25273: - Fix Version/s: 2.3.2 > How to install testthat v1.0.2 > -- > >

[jira] [Created] (SPARK-25283) A deadlock in UnionRDD

Maxim Gekk created SPARK-25283: -- Summary: A deadlock in UnionRDD Key: SPARK-25283 URL: https://issues.apache.org/jira/browse/SPARK-25283 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-25273) How to install testthat v1.0.2

[ https://issues.apache.org/jira/browse/SPARK-25273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25273. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22272

  1   2   >