[jira] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails

[ https://issues.apache.org/jira/browse/SPARK-43106 ] jeanlyn deleted comment on SPARK-43106: - was (Author: jeanlyn): I think we also encountered similar problems, we circumvent this problem by using parameters

[jira] [Commented] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails

[ https://issues.apache.org/jira/browse/SPARK-43106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790135#comment-17790135 ] jeanlyn commented on SPARK-43106: - I think we also encountered similar problems, we circumvent this

[jira] [Commented] (SPARK-35635) concurrent insert statements from multiple beeline fail with job aborted exception

[ https://issues.apache.org/jira/browse/SPARK-35635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741309#comment-17741309 ] jeanlyn commented on SPARK-35635: - When the tasks are running concurrently, the "_temporary" will be

[jira] [Commented] (SPARK-35635) concurrent insert statements from multiple beeline fail with job aborted exception

[ https://issues.apache.org/jira/browse/SPARK-35635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741296#comment-17741296 ] jeanlyn commented on SPARK-35635: - We encounter the same issue when concurrent writing in deference

[jira] [Commented] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735519#comment-17735519 ] jeanlyn commented on SPARK-38230: - We found Hive metastore crash frequently after upgrade Spark from

[jira] [Commented] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216229#comment-15216229 ] jeanlyn commented on SPARK-14243: - [~andrewor14] Let me know if the descriptions does not detail enough.

[jira] [Updated] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-14243: Summary: updatedBlockStatuses does not update correctly when removing blocks (was: updatedBlockStatuses

[jira] [Created] (SPARK-14243) updatedBlockStatuses does not update correctly

jeanlyn created SPARK-14243: --- Summary: updatedBlockStatuses does not update correctly Key: SPARK-14243 URL: https://issues.apache.org/jira/browse/SPARK-14243 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13845) BlockStatus and StreamBlockId keep on growing result driver OOM

[ https://issues.apache.org/jira/browse/SPARK-13845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-13845: Summary: BlockStatus and StreamBlockId keep on growing result driver OOM (was: Driver OOM after few days

[jira] [Created] (SPARK-13845) Driver OOM after few days when running streaming

jeanlyn created SPARK-13845: --- Summary: Driver OOM after few days when running streaming Key: SPARK-13845 URL: https://issues.apache.org/jira/browse/SPARK-13845 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-13586) add config to skip generate down time batch when restart StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn closed SPARK-13586. --- Resolution: Invalid > add config to skip generate down time batch when restart StreamingContext >

[jira] [Updated] (SPARK-13586) add config to skip generate down time batch when restart StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-13586: Priority: Minor (was: Major) > add config to skip generate down time batch when restart StreamingContext

[jira] [Created] (SPARK-13586) add config to skip generate down time batch when restart StreamingContext

jeanlyn created SPARK-13586: --- Summary: add config to skip generate down time batch when restart StreamingContext Key: SPARK-13586 URL: https://issues.apache.org/jira/browse/SPARK-13586 Project: Spark

[jira] [Created] (SPARK-13356) WebUI missing input informations when recovering from dirver failure

jeanlyn created SPARK-13356: --- Summary: WebUI missing input informations when recovering from dirver failure Key: SPARK-13356 URL: https://issues.apache.org/jira/browse/SPARK-13356 Project: Spark

[jira] [Updated] (SPARK-13356) WebUI missing input informations when recovering from dirver failure

[ https://issues.apache.org/jira/browse/SPARK-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-13356: Attachment: DirectKafkaScreenshot.jpg > WebUI missing input informations when recovering from dirver

[jira] [Commented] (SPARK-8513) _temporary may be left undeleted when a write job committed with FileOutputCommitter fails due to a race condition

[ https://issues.apache.org/jira/browse/SPARK-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699117#comment-14699117 ] jeanlyn commented on SPARK-8513: I think i encountered the problem these day. Our job

[jira] [Comment Edited] (SPARK-8513) _temporary may be left undeleted when a write job committed with FileOutputCommitter fails due to a race condition

[ https://issues.apache.org/jira/browse/SPARK-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699117#comment-14699117 ] jeanlyn edited comment on SPARK-8513 at 8/17/15 7:30 AM: - I think

[jira] [Commented] (SPARK-6392) [SQL]class not found exception thows when `add jar` use spark cli

[ https://issues.apache.org/jira/browse/SPARK-6392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14663264#comment-14663264 ] jeanlyn commented on SPARK-6392: I thought it fixed in my case, do you have more

[jira] [Created] (SPARK-9591) Job failed for exception during getting Broadcast variable

jeanlyn created SPARK-9591: -- Summary: Job failed for exception during getting Broadcast variable Key: SPARK-9591 URL: https://issues.apache.org/jira/browse/SPARK-9591 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-6392) [SQL]class not found exception thows when `add jar` use spark cli

[ https://issues.apache.org/jira/browse/SPARK-6392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn closed SPARK-6392. -- Resolution: Fixed [SQL]class not found exception thows when `add jar` use spark cli

[jira] [Commented] (SPARK-6392) [SQL]class not found exception thows when `add jar` use spark cli

[ https://issues.apache.org/jira/browse/SPARK-6392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14633033#comment-14633033 ] jeanlyn commented on SPARK-6392: I think this issue is fixed by

[jira] [Created] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

jeanlyn created SPARK-8379: -- Summary: LeaseExpiredException when using dynamic partition with speculative execution Key: SPARK-8379 URL: https://issues.apache.org/jira/browse/SPARK-8379 Project: Spark

[jira] [Commented] (SPARK-8020) Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early

[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570303#comment-14570303 ] jeanlyn commented on SPARK-8020: I had tried to put the settings back to

[jira] [Comment Edited] (SPARK-8020) Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early

[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570303#comment-14570303 ] jeanlyn edited comment on SPARK-8020 at 6/3/15 5:38 AM: I had

[jira] [Commented] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568427#comment-14568427 ] jeanlyn commented on SPARK-8020: [~yhuai],I set *spark.sql.hive.metastore.jars* in

[jira] [Comment Edited] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568427#comment-14568427 ] jeanlyn edited comment on SPARK-8020 at 6/2/15 3:16 AM: [~yhuai],I

[jira] [Comment Edited] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568427#comment-14568427 ] jeanlyn edited comment on SPARK-8020 at 6/2/15 2:48 AM: [~yhuai],I

[jira] [Created] (SPARK-7885) add config to control map aggregation in spark sql

jeanlyn created SPARK-7885: -- Summary: add config to control map aggregation in spark sql Key: SPARK-7885 URL: https://issues.apache.org/jira/browse/SPARK-7885 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-6392) [SQL]class not found exception thows when `add jar` use spark cli

jeanlyn created SPARK-6392: -- Summary: [SQL]class not found exception thows when `add jar` use spark cli Key: SPARK-6392 URL: https://issues.apache.org/jira/browse/SPARK-6392 Project: Spark Issue

[jira] [Created] (SPARK-5498) [SPARK-SQL]when the partition schema does not match table schema,it throws java.lang.ClassCastException and so on

jeanlyn created SPARK-5498: -- Summary: [SPARK-SQL]when the partition schema does not match table schema,it throws java.lang.ClassCastException and so on Key: SPARK-5498 URL:

[jira] [Updated] (SPARK-5068) When the path not found in the hdfs,we can't get the result

[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-5068: --- Fix Version/s: (was: 1.2.1) When the path not found in the hdfs,we can't get the result

[jira] [Updated] (SPARK-5068) When the path not found in the hdfs,we can't get the result

[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-5068: --- Fix Version/s: 1.2.1 When the path not found in the hdfs,we can't get the result

[jira] [Commented] (SPARK-5084) when mysql is used as the metadata storage for spark-sql, Exception occurs when HiveQuerySuite is excute

[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264183#comment-14264183 ] jeanlyn commented on SPARK-5084: more description? when mysql is used as the metadata

[jira] [Created] (SPARK-5068) When the path not found in the hdfs,we can't get the result

jeanlyn created SPARK-5068: -- Summary: When the path not found in the hdfs,we can't get the result Key: SPARK-5068 URL: https://issues.apache.org/jira/browse/SPARK-5068 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5068) When the path not found in the hdfs,we can't get the result

[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-5068: --- Description: when the partion path was found in the metastore but not found in the hdfs,it will casue some

[jira] [Updated] (SPARK-5068) When the path not found in the hdfs,we can't get the result

[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-5068: --- Description: when the partion path was found in the metastore but not found in the hdfs,it will casue some

[jira] [Issue Comment Deleted] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-3967: --- Comment: was deleted (was: dsa dsa) Spark applications fail in yarn-cluster mode when the

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181057#comment-14181057 ] jeanlyn commented on SPARK-3967: dsa dsa Spark applications fail in yarn-cluster

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178221#comment-14178221 ] jeanlyn commented on SPARK-3967: This issue also hapens to me.but i want to know why this

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178291#comment-14178291 ] jeanlyn commented on SPARK-3967: I think you this pull request also can be referenced: