[jira] [Assigned] (SPARK-25183) Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise

[ https://issues.apache.org/jira/browse/SPARK-25183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-25183: --- Assignee: Steve Loughran > Spark HiveServer2 registers shutdown hook with JVM, not Shutdown

[jira] [Resolved] (SPARK-25183) Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise

[ https://issues.apache.org/jira/browse/SPARK-25183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-25183. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22186 [https://gith

[jira] [Resolved] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-25288. -- Resolution: Fixed Fix Version/s: 2.4.0 > Kafka transaction tests are flaky > --

[jira] [Assigned] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-25275: Assignee: Erik Erlandson > require memberhip in wheel to run 'su' (in dockerfiles) >

[jira] [Assigned] (SPARK-24433) Add Spark R support

[ https://issues.apache.org/jira/browse/SPARK-24433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-24433: Assignee: Ilan Filonenko > Add Spark R support > --- > >

[jira] [Updated] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown.

[ https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25295: Description: If the previous job was killed somehow, by disconnecting the client. It leave

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598300#comment-16598300 ] Felix Cheung commented on SPARK-24434: -- so [~onursatici] is there a reason you open

[jira] [Created] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown.

Prashant Sharma created SPARK-25295: --- Summary: Pod names conflicts in client mode, if previous submission was not a clean shutdown. Key: SPARK-25295 URL: https://issues.apache.org/jira/browse/SPARK-25295

[jira] [Commented] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress

[ https://issues.apache.org/jira/browse/SPARK-24748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598298#comment-16598298 ] Apache Spark commented on SPARK-24748: -- User 'arunmahadevan' has created a pull req

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598297#comment-16598297 ] Felix Cheung commented on SPARK-24434: -- [~skonto] - hi what's happening? Henry is r

[jira] [Comment Edited] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598275#comment-16598275 ] Evelyn Bayes edited comment on SPARK-25150 at 8/31/18 6:06 AM: ---

[jira] [Commented] (SPARK-25294) Add integration test for Kerberos

[ https://issues.apache.org/jira/browse/SPARK-25294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598290#comment-16598290 ] Yuming Wang commented on SPARK-25294: - cc [~srowen] What do you think? > Add integr

[jira] [Created] (SPARK-25294) Add integration test for Kerberos

Yuming Wang created SPARK-25294: --- Summary: Add integration test for Kerberos Key: SPARK-25294 URL: https://issues.apache.org/jira/browse/SPARK-25294 Project: Spark Issue Type: Test C

[jira] [Comment Edited] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598284#comment-16598284 ] Evelyn Bayes edited comment on SPARK-25150 at 8/31/18 6:00 AM: ---

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598284#comment-16598284 ] Evelyn Bayes commented on SPARK-25150: -- Sorry my attachment doesn't want to stick,I

[jira] [Comment Edited] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598275#comment-16598275 ] Evelyn Bayes edited comment on SPARK-25150 at 8/31/18 5:55 AM: ---

[jira] [Commented] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598277#comment-16598277 ] Hyukjin Kwon commented on SPARK-25293: -- Does this describe a question, or a bug? If

[jira] [Updated] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25293: - Priority: Major (was: Critical) > Dataframe write to csv saves part files in outputDireotry/tas

[jira] [Commented] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598276#comment-16598276 ] Hyukjin Kwon commented on SPARK-25293: -- Please avoid to set Critical+ which is usua

[jira] [Resolved] (SPARK-25292) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25292. -- Resolution: Duplicate > Dataframe write to csv saves part files in outputDireotry/task-xx/part

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598275#comment-16598275 ] Evelyn Bayes commented on SPARK-25150: -- I'd love the chance to bug patch this. I'v

[jira] [Resolved] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-23789. - Resolution: Duplicate > Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenPro

[jira] [Reopened] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reopened SPARK-23789: - > Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider > --

[jira] [Commented] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598259#comment-16598259 ] Yuming Wang commented on SPARK-23789: - Fixed by https://github.com/apache/spark/pull

[jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25282: Description: Spark shell when run with kubernetes master, gives following errors. {noforma

[jira] [Updated] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

[ https://issues.apache.org/jira/browse/SPARK-25293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] omkar puttagunta updated SPARK-25293: - Description: [https://stackoverflow.com/questions/52108335/why-spark-dataframe-writes-pa

[jira] [Created] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

omkar puttagunta created SPARK-25293: Summary: Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir Key: SPARK-25293 URL: https://issues.apache.org

[jira] [Commented] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598245#comment-16598245 ] Apache Spark commented on SPARK-25021: -- User 'ifilonenko' has created a pull reques

[jira] [Assigned] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25021: Assignee: Apache Spark > Add spark.executor.pyspark.memory support to Kubernetes > --

[jira] [Assigned] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25021: Assignee: (was: Apache Spark) > Add spark.executor.pyspark.memory support to Kubernet

[jira] [Created] (SPARK-25292) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir

omkar puttagunta created SPARK-25292: Summary: Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir Key: SPARK-25292 URL: https://issues.apache.org

[jira] [Resolved] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai resolved SPARK-25206. --- Resolution: Won't Fix Not backport to 2.3 as per [~cloud_fan]'s summary, closed. > wrong records are return

[jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25282: Description: Spark shell when run with kubernetes master, gives following errors. {noforma

[jira] [Created] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

Ilan Filonenko created SPARK-25291: -- Summary: Flakiness of tests in terms of executor memory (SecretsTestSuite) Key: SPARK-25291 URL: https://issues.apache.org/jira/browse/SPARK-25291 Project: Spark

[jira] [Updated] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

[ https://issues.apache.org/jira/browse/SPARK-25291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25291: --- Description: SecretsTestSuite shows flakiness in terms of correct setting of executor memor

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598235#comment-16598235 ] Wenchen Fan commented on SPARK-25206: - It turns out we need to backport 3 non-trivia

[jira] [Commented] (SPARK-19809) NullPointerException on zero-size ORC file

[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598227#comment-16598227 ] Shirish Tatikonda commented on SPARK-19809: --- [~dongjoon] I am encountering the

[jira] [Resolved] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12

[ https://issues.apache.org/jira/browse/SPARK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25256. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22264 [https://github.c

[jira] [Assigned] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12

[ https://issues.apache.org/jira/browse/SPARK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25256: - Assignee: Darcy Shen > Plan mismatch errors in Hive tests in 2.12 > ---

[jira] [Assigned] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25290: Assignee: (was: Apache Spark) > BytesToBytesMapOnHeapSuite randomizedStressTest can c

[jira] [Assigned] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25290: Assignee: Apache Spark > BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfM

[jira] [Commented] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598162#comment-16598162 ] Apache Spark commented on SPARK-25290: -- User 'viirya' has created a pull request fo

[jira] [Created] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

Liang-Chi Hsieh created SPARK-25290: --- Summary: BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError Key: SPARK-25290 URL: https://issues.apache.org/jira/browse/SPARK-25290 Proj

[jira] [Created] (SPARK-25289) ChiSqSelector max on empty collection

Marie Beaulieu created SPARK-25289: -- Summary: ChiSqSelector max on empty collection Key: SPARK-25289 URL: https://issues.apache.org/jira/browse/SPARK-25289 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress

[ https://issues.apache.org/jira/browse/SPARK-24748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598132#comment-16598132 ] Apache Spark commented on SPARK-24748: -- User 'HyukjinKwon' has created a pull reque

[jira] [Updated] (SPARK-25286) Remove dangerous parmap

[ https://issues.apache.org/jira/browse/SPARK-25286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25286: Target Version/s: 2.4.0 > Remove dangerous parmap > --- > > Key: SPARK

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598115#comment-16598115 ] Saisai Shao commented on SPARK-25206: - I see, if it is not going to be merged, let's

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598113#comment-16598113 ] yucai commented on SPARK-25206: --- Based on our discussion in [https://github.com/apache/sp

[jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet

[ https://issues.apache.org/jira/browse/SPARK-25135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598111#comment-16598111 ] Saisai Shao commented on SPARK-25135: - What's the ETA of this issue [~yumwang]? > i

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598110#comment-16598110 ] Saisai Shao commented on SPARK-25206: - What is the status of this JIRA, are we going

[jira] [Commented] (SPARK-25255) Add getActiveSession to SparkSession in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598089#comment-16598089 ] Apache Spark commented on SPARK-25255: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-25255) Add getActiveSession to SparkSession in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25255: Assignee: Apache Spark > Add getActiveSession to SparkSession in PySpark > --

[jira] [Assigned] (SPARK-25255) Add getActiveSession to SparkSession in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25255: Assignee: (was: Apache Spark) > Add getActiveSession to SparkSession in PySpark > ---

[jira] [Resolved] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson resolved SPARK-25287. Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22294 [https:

[jira] [Assigned] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson reassigned SPARK-25287: -- Assignee: Erik Erlandson > Check for JIRA_USERNAME and JIRA_PASSWORD up front in merg

[jira] [Assigned] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25287: Assignee: (was: Apache Spark) > Check for JIRA_USERNAME and JIRA_PASSWORD up front in

[jira] [Commented] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597965#comment-16597965 ] Apache Spark commented on SPARK-25287: -- User 'erikerlandson' has created a pull req

[jira] [Assigned] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

[ https://issues.apache.org/jira/browse/SPARK-25287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25287: Assignee: Apache Spark > Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spar

[jira] [Assigned] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25288: Assignee: Apache Spark (was: Shixiong Zhu) > Kafka transaction tests are flaky > ---

[jira] [Assigned] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25288: Assignee: Shixiong Zhu (was: Apache Spark) > Kafka transaction tests are flaky > ---

[jira] [Commented] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597958#comment-16597958 ] Apache Spark commented on SPARK-25288: -- User 'zsxwing' has created a pull request f

[jira] [Updated] (SPARK-25288) Kafka transaction tests are flaky

[ https://issues.apache.org/jira/browse/SPARK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25288: - Description: http://spark-tests.appspot.com/test-details?suite_name=org.apache.spark.sql.kafka01

[jira] [Created] (SPARK-25288) Kafka transaction tests are flaky

Shixiong Zhu created SPARK-25288: Summary: Kafka transaction tests are flaky Key: SPARK-25288 URL: https://issues.apache.org/jira/browse/SPARK-25288 Project: Spark Issue Type: Bug C

[jira] [Created] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py

Erik Erlandson created SPARK-25287: -- Summary: Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py Key: SPARK-25287 URL: https://issues.apache.org/jira/browse/SPARK-25287 Project:

[jira] [Resolved] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson resolved SPARK-25275. Resolution: Fixed Fix Version/s: 2.4.0 > require memberhip in wheel to run 'su' (in

[jira] [Commented] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597935#comment-16597935 ] Erik Erlandson commented on SPARK-25275: {{merge_spark_pr.py}} failed to close t

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597929#comment-16597929 ] Stavros Kontopoulos edited comment on SPARK-24434 at 8/30/18 9:11 PM:

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597929#comment-16597929 ] Stavros Kontopoulos commented on SPARK-24434: - Btw [~liyinan926] at some if

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597929#comment-16597929 ] Stavros Kontopoulos edited comment on SPARK-24434 at 8/30/18 9:09 PM:

[jira] [Commented] (SPARK-25286) Remove dangerous parmap

[ https://issues.apache.org/jira/browse/SPARK-25286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597921#comment-16597921 ] Apache Spark commented on SPARK-25286: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-25286) Remove dangerous parmap

[ https://issues.apache.org/jira/browse/SPARK-25286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25286: Assignee: (was: Apache Spark) > Remove dangerous parmap > --- > >

[jira] [Assigned] (SPARK-25286) Remove dangerous parmap

[ https://issues.apache.org/jira/browse/SPARK-25286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25286: Assignee: Apache Spark > Remove dangerous parmap > --- > >

[jira] [Created] (SPARK-25286) Remove dangerous parmap

Maxim Gekk created SPARK-25286: -- Summary: Remove dangerous parmap Key: SPARK-25286 URL: https://issues.apache.org/jira/browse/SPARK-25286 Project: Spark Issue Type: Improvement Compone

[jira] [Resolved] (SPARK-24411) Adding native Java tests for `isInCollection`

[ https://issues.apache.org/jira/browse/SPARK-24411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-24411. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22253 [https://github.com/a

[jira] [Assigned] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25007: Assignee: Apache Spark > Add array_intersect / array_except /array_union / array_shuffle

[jira] [Assigned] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25007: Assignee: (was: Apache Spark) > Add array_intersect / array_except /array_union / arr

[jira] [Commented] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597907#comment-16597907 ] Apache Spark commented on SPARK-25007: -- User 'huaxingao' has created a pull request

[jira] [Updated] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-25007: --- Description: Add R version of  * array_intersect -SPARK-23913- * array_except -SPARK-23915-  * ar

[jira] [Updated] (SPARK-25007) Add shuffle / array_except /array_union / array_shuffle to SparkR

[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-25007: --- Description: Add R version of  * transform -SPARK-23928- * array_except -SPARK-23915-  * array_un

[jira] [Assigned] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25285: Assignee: Apache Spark > Add executor task metrics to track the number of tasks started a

[jira] [Assigned] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25285: Assignee: (was: Apache Spark) > Add executor task metrics to track the number of task

[jira] [Commented] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597849#comment-16597849 ] Apache Spark commented on SPARK-25285: -- User 'LucaCanali' has created a pull reques

[jira] [Updated] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-25285: Priority: Minor (was: Major) > Add executor task metrics to track the number of tasks started and

[jira] [Created] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

Luca Canali created SPARK-25285: --- Summary: Add executor task metrics to track the number of tasks started and of tasks successfully completed Key: SPARK-25285 URL: https://issues.apache.org/jira/browse/SPARK-25285

[jira] [Commented] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property

[ https://issues.apache.org/jira/browse/SPARK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597808#comment-16597808 ] Apache Spark commented on SPARK-25200: -- User 'adambalogh' has created a pull reques

[jira] [Assigned] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property

[ https://issues.apache.org/jira/browse/SPARK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25200: Assignee: Apache Spark > Allow setting HADOOP_CONF_DIR as a spark property >

[jira] [Assigned] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property

[ https://issues.apache.org/jira/browse/SPARK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25200: Assignee: (was: Apache Spark) > Allow setting HADOOP_CONF_DIR as a spark property > -

[jira] [Commented] (SPARK-23435) R tests should support latest testthat

[ https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597781#comment-16597781 ] Parker Hegstrom commented on SPARK-23435: - What is the status of this? My appvey

[jira] [Resolved] (SPARK-25233) Give the user the option of specifying a fixed minimum message per partition per batch when using kafka direct API with backpressure

[ https://issues.apache.org/jira/browse/SPARK-25233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cody Koeninger resolved SPARK-25233. Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 3 [https:

[jira] [Assigned] (SPARK-25233) Give the user the option of specifying a fixed minimum message per partition per batch when using kafka direct API with backpressure

[ https://issues.apache.org/jira/browse/SPARK-25233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cody Koeninger reassigned SPARK-25233: -- Assignee: Reza Safi > Give the user the option of specifying a fixed minimum message

[jira] [Commented] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597750#comment-16597750 ] Apache Spark commented on SPARK-22148: -- User 'dhruve' has created a pull request fo

[jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet

[ https://issues.apache.org/jira/browse/SPARK-25135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597742#comment-16597742 ] Yuming Wang commented on SPARK-25135: - [~dongjoon] orc has this issue. reproduce cod

[jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet

[ https://issues.apache.org/jira/browse/SPARK-25135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597741#comment-16597741 ] Apache Spark commented on SPARK-25135: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

[ https://issues.apache.org/jira/browse/SPARK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25284: Assignee: Apache Spark > Spark UI: make sure skipped stages are updated onJobEnd > --

[jira] [Commented] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

[ https://issues.apache.org/jira/browse/SPARK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597661#comment-16597661 ] Apache Spark commented on SPARK-25284: -- User 'juliuszsompolski' has created a pull

[jira] [Assigned] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

[ https://issues.apache.org/jira/browse/SPARK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25284: Assignee: (was: Apache Spark) > Spark UI: make sure skipped stages are updated onJobE

[jira] [Created] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

Juliusz Sompolski created SPARK-25284: - Summary: Spark UI: make sure skipped stages are updated onJobEnd Key: SPARK-25284 URL: https://issues.apache.org/jira/browse/SPARK-25284 Project: Spark

[jira] [Assigned] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25275: Assignee: (was: Apache Spark) > require memberhip in wheel to run 'su' (in dockerfile

[jira] [Commented] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597561#comment-16597561 ] Apache Spark commented on SPARK-25275: -- User 'erikerlandson' has created a pull req

[jira] [Assigned] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25275: Assignee: Apache Spark > require memberhip in wheel to run 'su' (in dockerfiles) > --

  1   2   >