[jira] [Closed] (SPARK-8966) Design a mechanism to ensure that temporary files created in tasks are cleaned up after failures

[ https://issues.apache.org/jira/browse/SPARK-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-8966. -- Resolution: Later > Design a mechanism to ensure that temporary files created in tasks are > cleaned

[jira] [Commented] (SPARK-18519) map type can not be used in EqualTo

[ https://issues.apache.org/jira/browse/SPARK-18519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15689184#comment-15689184 ] Apache Spark commented on SPARK-18519: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-18556) Suboptimal number of tasks when writing partitioned data with desired number of files per directory

Damian Momot created SPARK-18556: Summary: Suboptimal number of tasks when writing partitioned data with desired number of files per directory Key: SPARK-18556 URL:

[jira] [Resolved] (SPARK-18179) Throws analysis exception with a proper message for unsupported argument types in reflect/java_method function

[ https://issues.apache.org/jira/browse/SPARK-18179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18179. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.1.0 > Throws analysis

[jira] [Commented] (SPARK-18525) Kafka DirectInputStream cannot be aware of new partition

[ https://issues.apache.org/jira/browse/SPARK-18525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15689015#comment-15689015 ] Zhiwen Sun commented on SPARK-18525: Hi Cody: Thanks for your reply. We are still use kafka 0.8.2 ,

[jira] [Commented] (SPARK-18515) AlterTableDropPartitions fails for non-string columns

[ https://issues.apache.org/jira/browse/SPARK-18515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688851#comment-15688851 ] Apache Spark commented on SPARK-18515: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-18515) AlterTableDropPartitions fails for non-string columns

[ https://issues.apache.org/jira/browse/SPARK-18515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18515: Assignee: Dongjoon Hyun (was: Apache Spark) > AlterTableDropPartitions fails for

[jira] [Assigned] (SPARK-18515) AlterTableDropPartitions fails for non-string columns

[ https://issues.apache.org/jira/browse/SPARK-18515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18515: Assignee: Apache Spark (was: Dongjoon Hyun) > AlterTableDropPartitions fails for

[jira] [Updated] (SPARK-18555) na.fill miss up original values in long integers

[ https://issues.apache.org/jira/browse/SPARK-18555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahmoud Rawas updated SPARK-18555: -- Description: Manly the issue is clarified in the following example: Given a Dataset: scala>

[jira] [Created] (SPARK-18555) na.fill miss up original values in long integers

Mahmoud Rawas created SPARK-18555: - Summary: na.fill miss up original values in long integers Key: SPARK-18555 URL: https://issues.apache.org/jira/browse/SPARK-18555 Project: Spark Issue

[jira] [Created] (SPARK-18554) leader master lost the leadership, when the slave become master, the perivious app's state display as waitting

liujianhui created SPARK-18554: -- Summary: leader master lost the leadership, when the slave become master, the perivious app's state display as waitting Key: SPARK-18554 URL:

[jira] [Commented] (SPARK-18553) Executor loss may cause TaskSetManager to be leaked

[ https://issues.apache.org/jira/browse/SPARK-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688759#comment-15688759 ] Apache Spark commented on SPARK-18553: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18553) Executor loss may cause TaskSetManager to be leaked

[ https://issues.apache.org/jira/browse/SPARK-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18553: Assignee: Apache Spark (was: Josh Rosen) > Executor loss may cause TaskSetManager to be

[jira] [Assigned] (SPARK-18553) Executor loss may cause TaskSetManager to be leaked

[ https://issues.apache.org/jira/browse/SPARK-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18553: Assignee: Josh Rosen (was: Apache Spark) > Executor loss may cause TaskSetManager to be

[jira] [Resolved] (SPARK-18501) SparkR spark.glm error on collinear data

[ https://issues.apache.org/jira/browse/SPARK-18501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18501. - Resolution: Fixed Fix Version/s: 2.1.0 > SparkR spark.glm error on collinear data >

[jira] [Created] (SPARK-18553) Executor loss may cause TaskSetManager to be leaked

Josh Rosen created SPARK-18553: -- Summary: Executor loss may cause TaskSetManager to be leaked Key: SPARK-18553 URL: https://issues.apache.org/jira/browse/SPARK-18553 Project: Spark Issue Type:

[jira] [Created] (SPARK-18552) Watermark should not rely on sinks to proceed

Liwei Lin created SPARK-18552: - Summary: Watermark should not rely on sinks to proceed Key: SPARK-18552 URL: https://issues.apache.org/jira/browse/SPARK-18552 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-18545) Verify number of hive client RPCs in PartitionedTablePerfStatsSuite

[ https://issues.apache.org/jira/browse/SPARK-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18545: Assignee: (was: Apache Spark) > Verify number of hive client RPCs in

[jira] [Commented] (SPARK-18545) Verify number of hive client RPCs in PartitionedTablePerfStatsSuite

[ https://issues.apache.org/jira/browse/SPARK-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688674#comment-15688674 ] Apache Spark commented on SPARK-18545: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18545) Verify number of hive client RPCs in PartitionedTablePerfStatsSuite

[ https://issues.apache.org/jira/browse/SPARK-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18545: Assignee: Apache Spark > Verify number of hive client RPCs in

[jira] [Assigned] (SPARK-18551) Add functionality to delete event logs from the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-18551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18551: Assignee: Apache Spark > Add functionality to delete event logs from the History Server

[jira] [Commented] (SPARK-18551) Add functionality to delete event logs from the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-18551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688516#comment-15688516 ] Apache Spark commented on SPARK-18551: -- User 'ajbozarth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18551) Add functionality to delete event logs from the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-18551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18551: Assignee: (was: Apache Spark) > Add functionality to delete event logs from the

[jira] [Commented] (SPARK-1677) Allow users to avoid Hadoop output checks if desired

[ https://issues.apache.org/jira/browse/SPARK-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688509#comment-15688509 ] Apache Spark commented on SPARK-1677: - User 'CodingCat' has created a pull request for this issue:

[jira] [Commented] (SPARK-1677) Allow users to avoid Hadoop output checks if desired

[ https://issues.apache.org/jira/browse/SPARK-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688502#comment-15688502 ] Yang Li commented on SPARK-1677: Hi Spark Community, I'm curious on the behavior of this

[jira] [Commented] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

[ https://issues.apache.org/jira/browse/SPARK-18544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688471#comment-15688471 ] Apache Spark commented on SPARK-18544: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

[ https://issues.apache.org/jira/browse/SPARK-18544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18544: Assignee: Apache Spark > Append with df.saveAsTable writes data to wrong location >

[jira] [Assigned] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

[ https://issues.apache.org/jira/browse/SPARK-18544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18544: Assignee: (was: Apache Spark) > Append with df.saveAsTable writes data to wrong

[jira] [Resolved] (SPARK-18530) Kafka timestamp should be TimestampType

[ https://issues.apache.org/jira/browse/SPARK-18530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-18530. -- Resolution: Fixed Fix Version/s: 2.1.0 > Kafka timestamp should be TimestampType >

[jira] [Updated] (SPARK-15380) Generate code that stores a float/double value in each column from ColumnarBatch when DataFrame.cache() is used

[ https://issues.apache.org/jira/browse/SPARK-15380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-15380: -- Target Version/s: 2.2.0 (was: 2.1.0) > Generate code that stores a float/double value

[jira] [Updated] (SPARK-15117) Generate code that get a value in each compressed column from CachedBatch when DataFrame.cache() is called

[ https://issues.apache.org/jira/browse/SPARK-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-15117: -- Target Version/s: 2.2.0 (was: 2.1.0) > Generate code that get a value in each

[jira] [Commented] (SPARK-18551) Add functionality to delete event logs from the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-18551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688393#comment-15688393 ] Alex Bozarth commented on SPARK-18551: -- I will have a wip pr open for this shortly > Add

[jira] [Created] (SPARK-18551) Add functionality to delete event logs from the History Server UI

Alex Bozarth created SPARK-18551: Summary: Add functionality to delete event logs from the History Server UI Key: SPARK-18551 URL: https://issues.apache.org/jira/browse/SPARK-18551 Project: Spark

[jira] [Closed] (SPARK-18550) Make the queue capacity of LiveListenerBus configurable.

[ https://issues.apache.org/jira/browse/SPARK-18550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-18550. - Resolution: Duplicate > Make the queue capacity of LiveListenerBus configurable. >

[jira] [Commented] (SPARK-18550) Make the queue capacity of LiveListenerBus configurable.

[ https://issues.apache.org/jira/browse/SPARK-18550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688361#comment-15688361 ] Zhan Zhang commented on SPARK-18550: I was not aware it has been fixed already. Please help to close

[jira] [Commented] (SPARK-18513) Record and recover watermark

[ https://issues.apache.org/jira/browse/SPARK-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688357#comment-15688357 ] Apache Spark commented on SPARK-18513: -- User 'tcondie' has created a pull request for this issue:

[jira] [Updated] (SPARK-18533) Raise correct error upon specification of schema for datasource tables created through CTAS

[ https://issues.apache.org/jira/browse/SPARK-18533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18533: Assignee: Dilip Biswal > Raise correct error upon specification of schema for datasource tables > created

[jira] [Resolved] (SPARK-18533) Raise correct error upon specification of schema for datasource tables created through CTAS

[ https://issues.apache.org/jira/browse/SPARK-18533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-18533. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15968

[jira] [Commented] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688345#comment-15688345 ] Herman van Hovell commented on SPARK-18394: --- Great! Ping me if you need any assistance. >

[jira] [Commented] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688333#comment-15688333 ] Jonny Serencsa commented on SPARK-18394: Yes I would. > Executing the same query twice in a row

[jira] [Commented] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688330#comment-15688330 ] Herman van Hovell commented on SPARK-18394: --- Nice, this is a good find. I think we either need

[jira] [Commented] (SPARK-18550) Make the queue capacity of LiveListenerBus configurable.

[ https://issues.apache.org/jira/browse/SPARK-18550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688323#comment-15688323 ] Marcelo Vanzin commented on SPARK-18550: SPARK-15703? > Make the queue capacity of

[jira] [Created] (SPARK-18550) Make the queue capacity of LiveListenerBus configurable.

Zhan Zhang created SPARK-18550: -- Summary: Make the queue capacity of LiveListenerBus configurable. Key: SPARK-18550 URL: https://issues.apache.org/jira/browse/SPARK-18550 Project: Spark Issue

[jira] [Commented] (SPARK-18169) Suppress warnings when dropping views on a dropped table

[ https://issues.apache.org/jira/browse/SPARK-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688303#comment-15688303 ] Dongjoon Hyun commented on SPARK-18169: --- This issue is superceded by SPARK-18549 . > Suppress

[jira] [Updated] (SPARK-18169) Suppress warnings when dropping views on a dropped table

[ https://issues.apache.org/jira/browse/SPARK-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18169: -- Target Version/s: (was: 2.1.0) > Suppress warnings when dropping views on a dropped table >

[jira] [Closed] (SPARK-18169) Suppress warnings when dropping views on a dropped table

[ https://issues.apache.org/jira/browse/SPARK-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-18169. - Resolution: Fixed > Suppress warnings when dropping views on a dropped table >

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688286#comment-15688286 ] Dongjoon Hyun commented on SPARK-18549: --- `InMemoryRelation` of `CachedData` has `tableName:

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688274#comment-15688274 ] Xiao Li commented on SPARK-18549: - cc [~hvanhovell] [~dongjoon] [~rxin] [~marmbrus] [~cloud_fan] Any

[jira] [Updated] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18549: Priority: Critical (was: Major) > Failed to Uncache a View that References a Dropped Table. >

[jira] [Updated] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18549: Description: {code} spark.range(1, 10).toDF("id1").write.format("json").saveAsTable("jt1")

[jira] [Updated] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18549: Description: {code} spark.range(1, 10).toDF("id1").write.format("json").saveAsTable("jt1")

[jira] [Created] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

Xiao Li created SPARK-18549: --- Summary: Failed to Uncache a View that References a Dropped Table. Key: SPARK-18549 URL: https://issues.apache.org/jira/browse/SPARK-18549 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18549: Affects Version/s: 2.0.2 Target Version/s: 2.1.0 Description: {code} spark.range(1,

[jira] [Assigned] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

[ https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-16803: --- Assignee: Xiao Li > SaveAsTable does not work when source DataFrame is built on a Hive Table >

[jira] [Commented] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688244#comment-15688244 ] Jonny Serencsa commented on SPARK-18394: Already did that. The problem happens with both

[jira] [Commented] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688246#comment-15688246 ] Ofir Manor commented on SPARK-18475: Cody, for me your are the main gatekeeper for everything Kafka

[jira] [Updated] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18394: -- Shepherd: Herman van Hovell Target Version/s: 2.2.0 > Executing the same

[jira] [Resolved] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

[ https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-16803. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15926

[jira] [Updated] (SPARK-18169) Suppress warnings when dropping views on a dropped table

[ https://issues.apache.org/jira/browse/SPARK-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18169: -- Target Version/s: 2.1.0 > Suppress warnings when dropping views on a dropped table >

[jira] [Updated] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18394: -- Priority: Major (was: Minor) > Executing the same query twice in a row results in

[jira] [Commented] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688225#comment-15688225 ] Herman van Hovell commented on SPARK-18394: --- Ok, that is fair. What strikes me as odd is that

[jira] [Created] (SPARK-18548) OnlineLDAOptimizer reads the same broadcast data after deletion

Xiaoye Sun created SPARK-18548: -- Summary: OnlineLDAOptimizer reads the same broadcast data after deletion Key: SPARK-18548 URL: https://issues.apache.org/jira/browse/SPARK-18548 Project: Spark

[jira] [Commented] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688135#comment-15688135 ] Jonny Serencsa commented on SPARK-18394: This problem was discovered during high concurrency

[jira] [Resolved] (SPARK-18529) Timeouts shouldn't be AssertionErrors

[ https://issues.apache.org/jira/browse/SPARK-18529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-18529. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15820

[jira] [Resolved] (SPARK-18373) Make KafkaSource's failOnDataLoss=false work with Spark jobs

[ https://issues.apache.org/jira/browse/SPARK-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-18373. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15820

[jira] [Commented] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688059#comment-15688059 ] Herman van Hovell commented on SPARK-18394: --- I am not able to reproduce this. Could you also

[jira] [Updated] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18394: -- Priority: Minor (was: Major) > Executing the same query twice in a row results in

[jira] [Updated] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18394: -- Target Version/s: (was: 2.1.0) > Executing the same query twice in a row results in

[jira] [Updated] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

[ https://issues.apache.org/jira/browse/SPARK-18544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-18544: --- Description: When using saveAsTable in append mode, data will be written to the wrong location for

[jira] [Commented] (SPARK-18531) Apache Spark FPGrowth algorithm implementation fails with java.lang.StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-18531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687998#comment-15687998 ] yuhao yang commented on SPARK-18531: I think you should use spark.driver.extraJavaOptions > Apache

[jira] [Updated] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

[ https://issues.apache.org/jira/browse/SPARK-18544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18544: - Priority: Blocker (was: Major) > Append with df.saveAsTable writes data to wrong location >

[jira] [Assigned] (SPARK-18546) UnsafeShuffleWriter corrupts encrypted shuffle files when merging

[ https://issues.apache.org/jira/browse/SPARK-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18546: Assignee: Apache Spark (was: Marcelo Vanzin) > UnsafeShuffleWriter corrupts encrypted

[jira] [Assigned] (SPARK-18546) UnsafeShuffleWriter corrupts encrypted shuffle files when merging

[ https://issues.apache.org/jira/browse/SPARK-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18546: Assignee: Marcelo Vanzin (was: Apache Spark) > UnsafeShuffleWriter corrupts encrypted

[jira] [Commented] (SPARK-18546) UnsafeShuffleWriter corrupts encrypted shuffle files when merging

[ https://issues.apache.org/jira/browse/SPARK-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687952#comment-15687952 ] Apache Spark commented on SPARK-18546: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-18547) Decouple I/O encryption key propagation from UserGroupInformation

[ https://issues.apache.org/jira/browse/SPARK-18547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687937#comment-15687937 ] Apache Spark commented on SPARK-18547: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18547) Decouple I/O encryption key propagation from UserGroupInformation

[ https://issues.apache.org/jira/browse/SPARK-18547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18547: Assignee: Marcelo Vanzin (was: Apache Spark) > Decouple I/O encryption key propagation

[jira] [Assigned] (SPARK-18547) Decouple I/O encryption key propagation from UserGroupInformation

[ https://issues.apache.org/jira/browse/SPARK-18547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18547: Assignee: Apache Spark (was: Marcelo Vanzin) > Decouple I/O encryption key propagation

[jira] [Commented] (SPARK-18546) UnsafeShuffleWriter corrupts encrypted shuffle files when merging

[ https://issues.apache.org/jira/browse/SPARK-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687930#comment-15687930 ] Marcelo Vanzin commented on SPARK-18546: I'm marking this as blocked by SPARK-18547 because that

[jira] [Created] (SPARK-18547) Decouple I/O encryption key propagation from UserGroupInformation

Marcelo Vanzin created SPARK-18547: -- Summary: Decouple I/O encryption key propagation from UserGroupInformation Key: SPARK-18547 URL: https://issues.apache.org/jira/browse/SPARK-18547 Project: Spark

[jira] [Created] (SPARK-18546) UnsafeShuffleWriter corrupts encrypted shuffle files when merging

Marcelo Vanzin created SPARK-18546: -- Summary: UnsafeShuffleWriter corrupts encrypted shuffle files when merging Key: SPARK-18546 URL: https://issues.apache.org/jira/browse/SPARK-18546 Project: Spark

[jira] [Closed] (SPARK-13649) Move CalendarInterval out of unsafe package

[ https://issues.apache.org/jira/browse/SPARK-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-13649. --- Resolution: Won't Fix Target Version/s: (was: 2.1.0) > Move CalendarInterval out of

[jira] [Commented] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

[ https://issues.apache.org/jira/browse/SPARK-18544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687884#comment-15687884 ] Eric Liang commented on SPARK-18544: cc [~yhuai] [~cloud_fan] I'll try to look at this today but

[jira] [Created] (SPARK-18545) Verify number of hive client RPCs in PartitionedTablePerfStatsSuite

Eric Liang created SPARK-18545: -- Summary: Verify number of hive client RPCs in PartitionedTablePerfStatsSuite Key: SPARK-18545 URL: https://issues.apache.org/jira/browse/SPARK-18545 Project: Spark

[jira] [Resolved] (SPARK-18465) Uncache Table shouldn't throw an exception when table doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-18465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18465. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.1.0 >

[jira] [Created] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

Eric Liang created SPARK-18544: -- Summary: Append with df.saveAsTable writes data to wrong location Key: SPARK-18544 URL: https://issues.apache.org/jira/browse/SPARK-18544 Project: Spark Issue

[jira] [Commented] (SPARK-13649) Move CalendarInterval out of unsafe package

[ https://issues.apache.org/jira/browse/SPARK-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687878#comment-15687878 ] Herman van Hovell commented on SPARK-13649: --- I have to agree with reynold. We return

[jira] [Resolved] (SPARK-18507) Major performance regression in SHOW PARTITIONS on partitioned Hive tables

[ https://issues.apache.org/jira/browse/SPARK-18507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-18507. --- Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.1.0 Target

[jira] [Resolved] (SPARK-18504) Scalar subquery with extra group by columns returning incorrect result

[ https://issues.apache.org/jira/browse/SPARK-18504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18504. --- Resolution: Fixed Assignee: Nattavut Sutyanyong Fix Version/s: 2.1.0

[jira] [Updated] (SPARK-18513) Record and recover watermark

[ https://issues.apache.org/jira/browse/SPARK-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-18513: - Assignee: Tyson Condie > Record and recover watermark > > >

[jira] [Commented] (SPARK-12469) Data Property Accumulators for Spark (formerly Consistent Accumulators)

[ https://issues.apache.org/jira/browse/SPARK-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687763#comment-15687763 ] holdenk commented on SPARK-12469: - Cool - I'll bug y'all after the 2.1 release is out so hopefully we can

[jira] [Assigned] (SPARK-18528) limit + groupBy leads to java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-18528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18528: Assignee: Apache Spark > limit + groupBy leads to java.lang.NullPointerException >

[jira] [Assigned] (SPARK-18528) limit + groupBy leads to java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-18528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18528: Assignee: (was: Apache Spark) > limit + groupBy leads to

[jira] [Commented] (SPARK-18528) limit + groupBy leads to java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-18528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687690#comment-15687690 ] Apache Spark commented on SPARK-18528: -- User 'maropu' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-12469) Data Property Accumulators for Spark (formerly Consistent Accumulators)

[ https://issues.apache.org/jira/browse/SPARK-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687668#comment-15687668 ] Reynold Xin edited comment on SPARK-12469 at 11/22/16 7:36 PM: --- Sorry there

[jira] [Commented] (SPARK-12469) Data Property Accumulators for Spark (formerly Consistent Accumulators)

[ https://issues.apache.org/jira/browse/SPARK-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687668#comment-15687668 ] Reynold Xin commented on SPARK-12469: - Sorry there is no way to get this in 2.1, given the size of

[jira] [Commented] (SPARK-12469) Data Property Accumulators for Spark (formerly Consistent Accumulators)

[ https://issues.apache.org/jira/browse/SPARK-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687604#comment-15687604 ] holdenk commented on SPARK-12469: - In some ways I agree, on the other hand its slipped 2.0 already (as a

[jira] [Comment Edited] (SPARK-14146) Imported implicits can't be found in Spark REPL in some cases

[ https://issues.apache.org/jira/browse/SPARK-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687597#comment-15687597 ] Shixiong Zhu edited comment on SPARK-14146 at 11/22/16 7:10 PM: Hm...,

[jira] [Commented] (SPARK-14146) Imported implicits can't be found in Spark REPL in some cases

[ https://issues.apache.org/jira/browse/SPARK-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687597#comment-15687597 ] Shixiong Zhu commented on SPARK-14146: -- Hm..., this issue seems worse than I thought. It will ignore

[jira] [Commented] (SPARK-12469) Data Property Accumulators for Spark (formerly Consistent Accumulators)

[ https://issues.apache.org/jira/browse/SPARK-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687587#comment-15687587 ] Herman van Hovell commented on SPARK-12469: --- [~holdenk] We are really close to RC. I does not

[jira] [Updated] (SPARK-17772) Add helper testing methods for instance weighting

[ https://issues.apache.org/jira/browse/SPARK-17772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17772: -- Target Version/s: 2.2.0 (was: 2.1.0) > Add helper testing methods for instance

  1   2   >