[jira] [Commented] (SPARK-24107) ChunkedByteBuffer.writeFully method has not reset the limit value

[ https://issues.apache.org/jira/browse/SPARK-24107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475274#comment-16475274 ] Apache Spark commented on SPARK-24107: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-15348) Hive ACID

[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475265#comment-16475265 ] Harleen Singh Mann commented on SPARK-15348: Agreed with Arvind. This means either I dont use

[jira] [Updated] (SPARK-24107) ChunkedByteBuffer.writeFully method has not reset the limit value

[ https://issues.apache.org/jira/browse/SPARK-24107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24107: Affects Version/s: (was: 2.2.1) (was: 2.2.0) >

[jira] [Assigned] (SPARK-24275) Revise doc comments in InputPartition

[ https://issues.apache.org/jira/browse/SPARK-24275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24275: Assignee: (was: Apache Spark) > Revise doc comments in InputPartition >

[jira] [Commented] (SPARK-24275) Revise doc comments in InputPartition

[ https://issues.apache.org/jira/browse/SPARK-24275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475228#comment-16475228 ] Apache Spark commented on SPARK-24275: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-24275) Revise doc comments in InputPartition

[ https://issues.apache.org/jira/browse/SPARK-24275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24275: Assignee: Apache Spark > Revise doc comments in InputPartition >

[jira] [Created] (SPARK-24275) Revise doc comments in InputPartition

Gengliang Wang created SPARK-24275: -- Summary: Revise doc comments in InputPartition Key: SPARK-24275 URL: https://issues.apache.org/jira/browse/SPARK-24275 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running

[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475217#comment-16475217 ] Chun Chen commented on SPARK-24266: --- It seems we rarely use

[jira] [Updated] (SPARK-24107) ChunkedByteBuffer.writeFully method has not reset the limit value

[ https://issues.apache.org/jira/browse/SPARK-24107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-24107: --- Labels: correctness (was: ) Priority: Blocker (was: Major) This bug was originally

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475202#comment-16475202 ] Felix Cheung commented on SPARK-23780: -- [~vanzin] - FYI - if we have another RC this can be pulled

[jira] [Resolved] (SPARK-23780) Failed to use googleVis library with new SparkR

[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23780. -- Resolution: Fixed Fix Version/s: (was: 2.3.1) > Failed to use googleVis library

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Fix Version/s: 2.3.2 > Failed to use googleVis library with new SparkR >

[jira] [Assigned] (SPARK-23780) Failed to use googleVis library with new SparkR

[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-23780: Assignee: Felix Cheung > Failed to use googleVis library with new SparkR >

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Fix Version/s: 2.4.0 2.3.1 > Failed to use googleVis library with new SparkR

[jira] [Commented] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475199#comment-16475199 ] Wenchen Fan commented on SPARK-23264: - For compatibility reasons, we won't add this feature until

[jira] [Resolved] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23264. - Resolution: Later Fix Version/s: (was: 2.3.1) (was: 2.4.0) >

[jira] [Reopened] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-23264: - > Support interval values without INTERVAL clauses >

[jira] [Commented] (SPARK-19995) Using real user to connect HiveMetastore in HiveClientImpl

[ https://issues.apache.org/jira/browse/SPARK-19995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475189#comment-16475189 ] Rajesh Chandramohan commented on SPARK-19995: - spark-sql localmode  to support proxy_user Do 

[jira] [Comment Edited] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475185#comment-16475185 ] Hyukjin Kwon edited comment on SPARK-24269 at 5/15/18 2:09 AM: --- BTW, don't

[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475185#comment-16475185 ] Hyukjin Kwon commented on SPARK-24269: -- BTW, don't we already force the given schema to nullable

[jira] [Commented] (SPARK-19995) Using real user to connect HiveMetastore in HiveClientImpl

[ https://issues.apache.org/jira/browse/SPARK-19995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475170#comment-16475170 ] Rajesh Chandramohan commented on SPARK-19995: - The patch was not working in the case when

[jira] [Commented] (SPARK-24234) create the bottom-of-task RDD with row buffer

[ https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474993#comment-16474993 ] Jose Torres commented on SPARK-24234: - I'll work on this. > create the bottom-of-task RDD with row

[jira] [Updated] (SPARK-24274) Job UI should make stage dependencies clear in a complex DAG

[ https://issues.apache.org/jira/browse/SPARK-24274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-24274: - Attachment: q95_job17.tgz > Job UI should make stage dependencies clear in a complex DAG >

[jira] [Created] (SPARK-24274) Job UI should make stage dependencies clear in a complex DAG

Imran Rashid created SPARK-24274: Summary: Job UI should make stage dependencies clear in a complex DAG Key: SPARK-24274 URL: https://issues.apache.org/jira/browse/SPARK-24274 Project: Spark

[jira] [Resolved] (SPARK-24262) Fix typo in UDF error message

[ https://issues.apache.org/jira/browse/SPARK-24262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24262. Resolution: Fixed > Fix typo in UDF error message > - > >

[jira] [Resolved] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23264. Resolution: Fixed > Support interval values without INTERVAL clauses >

[jira] [Updated] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22256: --- Fix Version/s: (was: 2.3.1) (was: 2.4.0) > Introduce

[jira] [Commented] (SPARK-23852) Parquet MR bug can lead to incorrect SQL results

[ https://issues.apache.org/jira/browse/SPARK-23852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474819#comment-16474819 ] Apache Spark commented on SPARK-23852: -- User 'henryr' has created a pull request for this issue:

[jira] [Updated] (SPARK-23852) Parquet MR bug can lead to incorrect SQL results

[ https://issues.apache.org/jira/browse/SPARK-23852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-23852: --- Fix Version/s: 2.3.1 > Parquet MR bug can lead to incorrect SQL results >

[jira] [Resolved] (SPARK-24027) Support MapType(StringType, DataType) as root type by from_json

[ https://issues.apache.org/jira/browse/SPARK-24027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24027. - Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 2.4.0 > Support

[jira] [Comment Edited] (SPARK-24248) [K8S] Use the Kubernetes cluster as the backing store for the state of pods

[ https://issues.apache.org/jira/browse/SPARK-24248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474774#comment-16474774 ] Anirudh Ramanathan edited comment on SPARK-24248 at 5/14/18 8:44 PM: -

[jira] [Commented] (SPARK-24248) [K8S] Use the Kubernetes cluster as the backing store for the state of pods

[ https://issues.apache.org/jira/browse/SPARK-24248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474774#comment-16474774 ] Anirudh Ramanathan commented on SPARK-24248: Somewhat related -

[jira] [Commented] (SPARK-24249) Spark on kubernetes, pods crashes with spark sql job.

[ https://issues.apache.org/jira/browse/SPARK-24249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474772#comment-16474772 ] Anirudh Ramanathan commented on SPARK-24249: cc/ [~mccheah] > Spark on kubernetes, pods

[jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running

[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474770#comment-16474770 ] Anirudh Ramanathan commented on SPARK-24266: Thanks for filing this issue and digging in. It

[jira] [Assigned] (SPARK-24155) Instrumentation improvement for clustering

[ https://issues.apache.org/jira/browse/SPARK-24155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-24155: - Assignee: Lu Wang > Instrumentation improvement for clustering >

[jira] [Resolved] (SPARK-24155) Instrumentation improvement for clustering

[ https://issues.apache.org/jira/browse/SPARK-24155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-24155. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21218

[jira] [Commented] (SPARK-24102) RegressionEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474756#comment-16474756 ] Apache Spark commented on SPARK-24102: -- User 'imatiach-msft' has created a pull request for this

[jira] [Assigned] (SPARK-24102) RegressionEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24102: Assignee: (was: Apache Spark) > RegressionEvaluator should use sample weight data >

[jira] [Assigned] (SPARK-24102) RegressionEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24102: Assignee: Apache Spark > RegressionEvaluator should use sample weight data >

[jira] [Updated] (SPARK-24195) sc.addFile for local:/ path is broken

[ https://issues.apache.org/jira/browse/SPARK-24195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-24195: Labels: starter (was: ) > sc.addFile for local:/ path is broken > - >

[jira] [Assigned] (SPARK-24103) BinaryClassificationEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24103: Assignee: (was: Apache Spark) > BinaryClassificationEvaluator should use sample

[jira] [Assigned] (SPARK-24103) BinaryClassificationEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24103: Assignee: Apache Spark > BinaryClassificationEvaluator should use sample weight data >

[jira] [Commented] (SPARK-24103) BinaryClassificationEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474755#comment-16474755 ] Apache Spark commented on SPARK-24103: -- User 'imatiach-msft' has created a pull request for this

[jira] [Updated] (SPARK-23940) High-order function: transform_values(map<K, V1>, function<K, V1, V2>) → map<K, V2>

[ https://issues.apache.org/jira/browse/SPARK-23940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-23940: Labels: starter (was: ) > High-order function: transform_values(map, function) → >

[jira] [Commented] (SPARK-24103) BinaryClassificationEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474754#comment-16474754 ] Ilya Matiach commented on SPARK-24103: -- This issue is fixed by this PR:

[jira] [Updated] (SPARK-24005) Remove usage of Scala’s parallel collection

[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-24005: Labels: starter (was: ) > Remove usage of Scala’s parallel collection >

[jira] [Updated] (SPARK-24102) RegressionEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-24102: Labels: starter (was: ) > RegressionEvaluator should use sample weight data >

[jira] [Updated] (SPARK-24103) BinaryClassificationEvaluator should use sample weight data

[ https://issues.apache.org/jira/browse/SPARK-24103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-24103: Labels: starter (was: ) > BinaryClassificationEvaluator should use sample weight data >

[jira] [Commented] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474664#comment-16474664 ] Bryan Cutler commented on SPARK-21187: -- Hi [~ewohlstadter], thanks for the interest!  The Map type

[jira] [Commented] (SPARK-24035) SQL syntax for Pivot

[ https://issues.apache.org/jira/browse/SPARK-24035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474653#comment-16474653 ] Apache Spark commented on SPARK-24035: -- User 'maryannxue' has created a pull request for this issue:

[jira] [Commented] (SPARK-24067) Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction))

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474628#comment-16474628 ] Shixiong Zhu commented on SPARK-24067: -- Okey. Since this is turned off by default, I'm okey to

[jira] [Updated] (SPARK-23874) Upgrade apache/arrow to 0.10.0

[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-23874: - Description: Version 0.10.0 will allow for the following improvements and bug fixes: * Allow

[jira] [Resolved] (SPARK-24246) Improve AnalysisException by setting the cause when it's available

[ https://issues.apache.org/jira/browse/SPARK-24246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24246. - Resolution: Fixed Fix Version/s: 2.4.0 2.3.1 > Improve AnalysisException by

[jira] [Commented] (SPARK-24255) Require Java 8 in SparkR description

[ https://issues.apache.org/jira/browse/SPARK-24255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474593#comment-16474593 ] Xiao Li commented on SPARK-24255: - Thanks! [~shivaram] > Require Java 8 in SparkR description >

[jira] [Resolved] (SPARK-24272) Require Java 8 for SparkR

[ https://issues.apache.org/jira/browse/SPARK-24272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24272. Resolution: Duplicate > Require Java 8 for SparkR > - > >

[jira] [Commented] (SPARK-24270) How to submit spark jobs with kinit sessions without keytab onto a Kerberized cluster managed by Cloudera

[ https://issues.apache.org/jira/browse/SPARK-24270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474564#comment-16474564 ] Ankita commented on SPARK-24270: thanks! > How to submit spark jobs with kinit sessions without keytab

[jira] [Commented] (SPARK-24067) Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction))

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474549#comment-16474549 ] Cody Koeninger commented on SPARK-24067: [~zsxwing] even in situations where users weren't

[jira] [Commented] (SPARK-24272) Require Java 8 for SparkR

[ https://issues.apache.org/jira/browse/SPARK-24272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474546#comment-16474546 ] Shivaram Venkataraman commented on SPARK-24272: --- [~smilegator] - I opened

[jira] [Commented] (SPARK-24067) Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction))

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474532#comment-16474532 ] Shixiong Zhu commented on SPARK-24067: -- [~srowen] this sounds more like a new feature to me. The PR

[jira] [Commented] (SPARK-23582) Add interpreted execution to StaticInvoke expression

[ https://issues.apache.org/jira/browse/SPARK-23582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474531#comment-16474531 ] Apache Spark commented on SPARK-23582: -- User 'henryr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24263) SparkR java check breaks on openjdk

[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24263: -- Assignee: Felix Cheung > SparkR java check breaks on openjdk >

[jira] [Resolved] (SPARK-24263) SparkR java check breaks on openjdk

[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24263. Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by

[jira] [Created] (SPARK-24273) Failure while using .checkpoint method

Jami Malikzade created SPARK-24273: -- Summary: Failure while using .checkpoint method Key: SPARK-24273 URL: https://issues.apache.org/jira/browse/SPARK-24273 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-24272) Require Java 8 for SparkR

Xiao Li created SPARK-24272: --- Summary: Require Java 8 for SparkR Key: SPARK-24272 URL: https://issues.apache.org/jira/browse/SPARK-24272 Project: Spark Issue Type: Bug Components: SparkR

[jira] [Commented] (SPARK-24271) sc.hadoopConfigurations can not be overwritten in the same spark context

[ https://issues.apache.org/jira/browse/SPARK-24271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474513#comment-16474513 ] Jami Malikzade commented on SPARK-24271: [~vanzin] 

[jira] [Comment Edited] (SPARK-24271) sc.hadoopConfigurations can not be overwritten in the same spark context

[ https://issues.apache.org/jira/browse/SPARK-24271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474495#comment-16474495 ] Marcelo Vanzin edited comment on SPARK-24271 at 5/14/18 5:25 PM: - Damn. I

[jira] [Comment Edited] (SPARK-24271) sc.hadoopConfigurations can not be overwritten in the same spark context

[ https://issues.apache.org/jira/browse/SPARK-24271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474495#comment-16474495 ] Marcelo Vanzin edited comment on SPARK-24271 at 5/14/18 5:24 PM: -

[jira] [Comment Edited] (SPARK-24271) sc.hadoopConfigurations can not be overwritten in the same spark context

[ https://issues.apache.org/jira/browse/SPARK-24271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474495#comment-16474495 ] Marcelo Vanzin edited comment on SPARK-24271 at 5/14/18 5:24 PM: -

[jira] [Commented] (SPARK-24271) sc.hadoopConfigurations can not be overwritten in the same spark context

[ https://issues.apache.org/jira/browse/SPARK-24271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474495#comment-16474495 ] Marcelo Vanzin commented on SPARK-24271:

[jira] [Commented] (SPARK-24271) sc.hadoopConfigurations can not be overwritten in the same spark context

[ https://issues.apache.org/jira/browse/SPARK-24271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474490#comment-16474490 ] Jami Malikzade commented on SPARK-24271: [~vanzin] can you please tell me how to disable  caching

[jira] [Commented] (SPARK-24270) How to submit spark jobs with kinit sessions without keytab onto a Kerberized cluster managed by Cloudera

[ https://issues.apache.org/jira/browse/SPARK-24270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474489#comment-16474489 ] Marcelo Vanzin commented on SPARK-24270: http://spark.apache.org/community.html > How to submit

[jira] [Comment Edited] (SPARK-24270) How to submit spark jobs with kinit sessions without keytab onto a Kerberized cluster managed by Cloudera

[ https://issues.apache.org/jira/browse/SPARK-24270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474486#comment-16474486 ] Ankita edited comment on SPARK-24270 at 5/14/18 5:17 PM: - Yeah I am asking them

[jira] [Commented] (SPARK-24270) How to submit spark jobs with kinit sessions without keytab onto a Kerberized cluster managed by Cloudera

[ https://issues.apache.org/jira/browse/SPARK-24270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474486#comment-16474486 ] Ankita commented on SPARK-24270: Yeah I am asking them as well. I wonder if anyone here has run into this

[jira] [Comment Edited] (SPARK-21823) ALTER TABLE table statements such as RENAME and CHANGE columns should raise error if there are any dependent constraints.

[ https://issues.apache.org/jira/browse/SPARK-21823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474474#comment-16474474 ] Sunitha Kambhampati edited comment on SPARK-21823 at 5/14/18 5:01 PM:

[jira] [Commented] (SPARK-21823) ALTER TABLE table statements such as RENAME and CHANGE columns should raise error if there are any dependent constraints.

[ https://issues.apache.org/jira/browse/SPARK-21823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474474#comment-16474474 ] Sunitha Kambhampati commented on SPARK-21823: - I have the changes for this.  Once the

[jira] [Resolved] (SPARK-24271) sc.hadoopConfigurations can not be overwritten in the same spark context

[ https://issues.apache.org/jira/browse/SPARK-24271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24271. Resolution: Not A Problem FileSystem objects are cached. Unless you disable caching in the

[jira] [Resolved] (SPARK-24270) How to submit spark jobs with kinit sessions without keytab onto a Kerberized cluster managed by Cloudera

[ https://issues.apache.org/jira/browse/SPARK-24270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24270. Resolution: Information Provided Please use the project's mailing lists for questions.

[jira] [Commented] (SPARK-24225) Support closing AutoClosable objects in MemoryStore so Broadcast Variables can be released properly

[ https://issues.apache.org/jira/browse/SPARK-24225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474439#comment-16474439 ] Apache Spark commented on SPARK-24225: -- User 'JeetKunDoug' has created a pull request for this

[jira] [Assigned] (SPARK-24225) Support closing AutoClosable objects in MemoryStore so Broadcast Variables can be released properly

[ https://issues.apache.org/jira/browse/SPARK-24225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24225: Assignee: Apache Spark (was: Doug Rohrer) > Support closing AutoClosable objects in

[jira] [Assigned] (SPARK-24225) Support closing AutoClosable objects in MemoryStore so Broadcast Variables can be released properly

[ https://issues.apache.org/jira/browse/SPARK-24225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24225: Assignee: Doug Rohrer (was: Apache Spark) > Support closing AutoClosable objects in

[jira] [Created] (SPARK-24271) sc.hadoopConfigurations can not be overwritten in the same spark context

Jami Malikzade created SPARK-24271: -- Summary: sc.hadoopConfigurations can not be overwritten in the same spark context Key: SPARK-24271 URL: https://issues.apache.org/jira/browse/SPARK-24271

[jira] [Reopened] (SPARK-23709) BaggedPoint.convertToBaggedRDDSamplingWithReplacement does not guarantee the sum of weights

[ https://issues.apache.org/jira/browse/SPARK-23709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Sannier reopened SPARK-23709: - I'm sorry, but I already did ask the question on the mailing list, and did not receive any

[jira] [Updated] (SPARK-23771) Uneven Rowgroup size after repartition

[ https://issues.apache.org/jira/browse/SPARK-23771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johannes Mayer updated SPARK-23771: --- Affects Version/s: 2.2.0 > Uneven Rowgroup size after repartition >

[jira] [Commented] (SPARK-23771) Uneven Rowgroup size after repartition

[ https://issues.apache.org/jira/browse/SPARK-23771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474326#comment-16474326 ] Johannes Mayer commented on SPARK-23771: I have tested it in Spark 2.2.0 and the issue still

[jira] [Created] (SPARK-24270) How to submit spark jobs with kinit sessions without keytab onto a Kerberized cluster managed by Cloudera

Ankita created SPARK-24270: -- Summary: How to submit spark jobs with kinit sessions without keytab onto a Kerberized cluster managed by Cloudera Key: SPARK-24270 URL: https://issues.apache.org/jira/browse/SPARK-24270

[jira] [Comment Edited] (SPARK-24122) Allow automatic driver restarts on K8s

[ https://issues.apache.org/jira/browse/SPARK-24122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474121#comment-16474121 ] Stavros Kontopoulos edited comment on SPARK-24122 at 5/14/18 12:40 PM:

[jira] [Comment Edited] (SPARK-24122) Allow automatic driver restarts on K8s

[ https://issues.apache.org/jira/browse/SPARK-24122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474121#comment-16474121 ] Stavros Kontopoulos edited comment on SPARK-24122 at 5/14/18 12:39 PM:

[jira] [Assigned] (SPARK-24268) DataType in error messages are not coherent

[ https://issues.apache.org/jira/browse/SPARK-24268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24268: Assignee: Apache Spark > DataType in error messages are not coherent >

[jira] [Commented] (SPARK-24268) DataType in error messages are not coherent

[ https://issues.apache.org/jira/browse/SPARK-24268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474117#comment-16474117 ] Apache Spark commented on SPARK-24268: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-24122) Allow automatic driver restarts on K8s

[ https://issues.apache.org/jira/browse/SPARK-24122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474121#comment-16474121 ] Stavros Kontopoulos commented on SPARK-24122: - Maybe this can be covered with Spark Operator

[jira] [Assigned] (SPARK-24268) DataType in error messages are not coherent

[ https://issues.apache.org/jira/browse/SPARK-24268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24268: Assignee: (was: Apache Spark) > DataType in error messages are not coherent >

[jira] [Created] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

Maxim Gekk created SPARK-24269: -- Summary: Infer nullability rather than declaring all columns as nullable Key: SPARK-24269 URL: https://issues.apache.org/jira/browse/SPARK-24269 Project: Spark

[jira] [Commented] (SPARK-23771) Uneven Rowgroup size after repartition

[ https://issues.apache.org/jira/browse/SPARK-23771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474061#comment-16474061 ] Takeshi Yamamuro commented on SPARK-23771: -- I think this has been already fixed in newer Sparks,

[jira] [Created] (SPARK-24268) DataType in error messages are not coherent

Marco Gaido created SPARK-24268: --- Summary: DataType in error messages are not coherent Key: SPARK-24268 URL: https://issues.apache.org/jira/browse/SPARK-24268 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet

[ https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473994#comment-16473994 ] Apache Spark commented on SPARK-4502: - User 'mallman' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24267) explicitly keep DataSourceReader in DataSourceV2Relation

[ https://issues.apache.org/jira/browse/SPARK-24267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24267: Assignee: Apache Spark (was: Wenchen Fan) > explicitly keep DataSourceReader in

[jira] [Commented] (SPARK-24267) explicitly keep DataSourceReader in DataSourceV2Relation

[ https://issues.apache.org/jira/browse/SPARK-24267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473932#comment-16473932 ] Apache Spark commented on SPARK-24267: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24267) explicitly keep DataSourceReader in DataSourceV2Relation

[ https://issues.apache.org/jira/browse/SPARK-24267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24267: Assignee: Wenchen Fan (was: Apache Spark) > explicitly keep DataSourceReader in

[jira] [Commented] (SPARK-20922) Unsafe deserialization in Spark LauncherConnection

[ https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473889#comment-16473889 ] Ruslan Fialkovsky commented on SPARK-20922: --- Thanks for clarification. > Unsafe

[jira] [Created] (SPARK-24267) explicitly keep DataSourceReader in DataSourceV2Relation

Wenchen Fan created SPARK-24267: --- Summary: explicitly keep DataSourceReader in DataSourceV2Relation Key: SPARK-24267 URL: https://issues.apache.org/jira/browse/SPARK-24267 Project: Spark Issue

  1   2   >