[jira] [Updated] (CARBONDATA-4084) Error when loading string field with high cardinary
[ https://issues.apache.org/jira/browse/CARBONDATA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Dinh Huynh updated CARBONDATA-4084: -- Description: When i am try load string field with more than 1M distinct value, some rows show strange value. !image_2020_12_13T09_29_38_891Z.png! I'm trying with this setting: carbon.local.dictionary.enable=false then it works as expect. So seems like have some bugs on decoder fallback. was: When i am try load string field with more than 1M distinct value, some rows show strange value. !image_2020_12_13T09_29_38_891Z.png! I'm trying with below setting then it works as expect. So seems like have some bugs on decoder fallback. !image-2020-12-14-22-40-45-539.png! > Error when loading string field with high cardinary > > > Key: CARBONDATA-4084 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 2.0.0, 2.1.0, 2.0.1 >Reporter: Nguyen Dinh Huynh >Priority: Major > Labels: patch > Attachments: image-2020-12-14-22-40-45-539.png, > image_2020_12_13T09_29_38_891Z.png > > > When i am try load string field with more than 1M distinct value, some rows > show strange value. > !image_2020_12_13T09_29_38_891Z.png! > I'm trying with this setting: carbon.local.dictionary.enable=false then it > works as expect. So seems like have some bugs on decoder fallback. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4084) Error when loading string field with high cardinary
[ https://issues.apache.org/jira/browse/CARBONDATA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Dinh Huynh updated CARBONDATA-4084: -- Labels: patch (was: ) > Error when loading string field with high cardinary > > > Key: CARBONDATA-4084 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 2.0.0, 2.1.0, 2.0.1 >Reporter: Nguyen Dinh Huynh >Priority: Major > Labels: patch > Attachments: image-2020-12-14-22-40-45-539.png, > image_2020_12_13T09_29_38_891Z.png > > > When i am try load string field with more than 1M distinct value, some rows > show strange value. > !image_2020_12_13T09_29_38_891Z.png! > I'm trying with below setting then it works as expect. So seems like have > some bugs on decoder fallback. > > !image-2020-12-14-22-40-45-539.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4084) Error when loading string field with high cardinary
[ https://issues.apache.org/jira/browse/CARBONDATA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Dinh Huynh updated CARBONDATA-4084: -- Description: When i am try load string field with more than 1M distinct value, some rows show strange value. !image_2020_12_13T09_29_38_891Z.png! I'm trying with below setting then it works as expect. So seems like have some bugs on decoder fallback. !image-2020-12-14-22-40-45-539.png! was: When i am try load string field with more than 1M distinct value, some rows show strange value. I'm trying with below setting then it works as expect. So seems like have some bugs on decoder fallback. !image-2020-12-14-22-40-45-539.png! > Error when loading string field with high cardinary > > > Key: CARBONDATA-4084 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 2.0.0, 2.1.0, 2.0.1 >Reporter: Nguyen Dinh Huynh >Priority: Major > Attachments: image-2020-12-14-22-40-45-539.png, > image_2020_12_13T09_29_38_891Z.png > > > When i am try load string field with more than 1M distinct value, some rows > show strange value. > !image_2020_12_13T09_29_38_891Z.png! > I'm trying with below setting then it works as expect. So seems like have > some bugs on decoder fallback. > > !image-2020-12-14-22-40-45-539.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4084) Error when loading string field with high cardinary
[ https://issues.apache.org/jira/browse/CARBONDATA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Dinh Huynh updated CARBONDATA-4084: -- Attachment: (was: image_2020_12_13T09_29_38_891Z.png) > Error when loading string field with high cardinary > > > Key: CARBONDATA-4084 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 2.0.0, 2.1.0, 2.0.1 >Reporter: Nguyen Dinh Huynh >Priority: Major > Attachments: image-2020-12-14-22-40-45-539.png, > image_2020_12_13T09_29_38_891Z.png > > > When i am try load string field with more than 1M distinct value, some rows > show strange value. > > I'm trying with below setting then it works as expect. So seems like have > some bugs on decoder fallback. > > !image-2020-12-14-22-40-45-539.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4084) Error when loading string field with high cardinary
[ https://issues.apache.org/jira/browse/CARBONDATA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Dinh Huynh updated CARBONDATA-4084: -- Attachment: image_2020_12_13T09_29_38_891Z.png > Error when loading string field with high cardinary > > > Key: CARBONDATA-4084 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 2.0.0, 2.1.0, 2.0.1 >Reporter: Nguyen Dinh Huynh >Priority: Major > Attachments: image-2020-12-14-22-40-45-539.png, > image_2020_12_13T09_29_38_891Z.png > > > When i am try load string field with more than 1M distinct value, some rows > show strange value. > > I'm trying with below setting then it works as expect. So seems like have > some bugs on decoder fallback. > > !image-2020-12-14-22-40-45-539.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4084) Error when loading string field with high cardinary
[ https://issues.apache.org/jira/browse/CARBONDATA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Dinh Huynh updated CARBONDATA-4084: -- Attachment: image_2020_12_13T09_29_38_891Z.png > Error when loading string field with high cardinary > > > Key: CARBONDATA-4084 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 2.0.0, 2.1.0, 2.0.1 >Reporter: Nguyen Dinh Huynh >Priority: Major > Attachments: image-2020-12-14-22-40-45-539.png, > image_2020_12_13T09_29_38_891Z.png > > > When i am try load string field with more than 1M distinct value, some rows > show strange value. > > I'm trying with below setting then it works as expect. So seems like have > some bugs on decoder fallback. > > !image-2020-12-14-22-40-45-539.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4084) Error when loading string field with high cardinary
[ https://issues.apache.org/jira/browse/CARBONDATA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Dinh Huynh updated CARBONDATA-4084: -- Description: When i am try load string field with more than 1M distinct value, some rows show strange value. I'm trying with below setting then it works as expect. So seems like have some bugs on decoder fallback. !image-2020-12-14-22-40-45-539.png! > Error when loading string field with high cardinary > > > Key: CARBONDATA-4084 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 2.0.0, 2.1.0, 2.0.1 >Reporter: Nguyen Dinh Huynh >Priority: Major > Attachments: image-2020-12-14-22-40-45-539.png, > image_2020_12_13T09_29_38_891Z.png > > > When i am try load string field with more than 1M distinct value, some rows > show strange value. > > I'm trying with below setting then it works as expect. So seems like have > some bugs on decoder fallback. > > !image-2020-12-14-22-40-45-539.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4084) Error when loading string field with high cardinary
[ https://issues.apache.org/jira/browse/CARBONDATA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Dinh Huynh updated CARBONDATA-4084: -- Attachment: image-2020-12-14-22-40-45-539.png > Error when loading string field with high cardinary > > > Key: CARBONDATA-4084 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 2.0.0, 2.1.0, 2.0.1 >Reporter: Nguyen Dinh Huynh >Priority: Major > Attachments: image-2020-12-14-22-40-45-539.png > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4084) Error when loading string field with high cardinary
Nguyen Dinh Huynh created CARBONDATA-4084: - Summary: Error when loading string field with high cardinary Key: CARBONDATA-4084 URL: https://issues.apache.org/jira/browse/CARBONDATA-4084 Project: CarbonData Issue Type: Bug Components: spark-integration Affects Versions: 2.1.0, 2.0.0, 2.0.1 Reporter: Nguyen Dinh Huynh -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4033) Error when using merge API with hive table
[
https://issues.apache.org/jira/browse/CARBONDATA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nguyen Dinh Huynh updated CARBONDATA-4033:
--
Labels: easyfix features newbie (was: newbie patch)
> Error when using merge API with hive table
> --
>
> Key: CARBONDATA-4033
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4033
> Project: CarbonData
> Issue Type: Bug
>Affects Versions: 2.0.0, 2.0.1
>Reporter: Nguyen Dinh Huynh
>Priority: Major
> Labels: easyfix, features, newbie
>
> I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
> with spark 2.4.3. Is this a bug ?
> {code:java}
> 2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due
> to exception java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
> 2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be
> removed as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR
> Executor:91 - Exception in task 1.0 in stage 0.0 (TID 1)
> java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
> {code}
> My code is:
> {code:java}
> val map = Map(
> col("_external_op") -> col("A._external_op"),
> col("_external_ts_sec") -> col("A._external_ts_sec"),
> col("_external_row") -> col("A._external_row"),
> col("_external_pos") -> col("A._external_pos"),
> col("id") -> col("A.id"),
> col("order") -> col("A.order"),
> col("shop_code") -> col("A.shop_code"),
> col("customer_tel") -> col("A.customer_tel"),
> col("channel") -> col("A.channel"),
> col("batch_session_id") -> col("A.batch_session_id"),
> col("deleted_at") -> col("A.deleted_at"),
> col("created") -> col("A.created"))
> .asInstanceOf[Map[Any, Any]]
> val testDf =
> spark.sqlContext.read.format("carbondata")
> .option("tableName", "package_drafts")
> .option("schemaName", "db")
> .option("dbName", "db")
> .option("databaseName", "d")b
> .load()
> .as("B")
> testDf.printSchema()
> testDf.merge(package_draft_view, col("A.id").equalTo(col("B.id")))
> .whenMatched(col("A._external_op") === "u")
> .updateExpr(map)
> .whenMatched(col("A._external_op") === "c")
> .insertExpr(map)
> .whenMatched(col("A._external_op") === "d")
> .delete()
> .execute()
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4033) Error when using merge API with hive table
[
https://issues.apache.org/jira/browse/CARBONDATA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nguyen Dinh Huynh updated CARBONDATA-4033:
--
Flags: Important
Labels: newbie patch (was: )
> Error when using merge API with hive table
> --
>
> Key: CARBONDATA-4033
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4033
> Project: CarbonData
> Issue Type: Bug
>Affects Versions: 2.0.0, 2.0.1
>Reporter: Nguyen Dinh Huynh
>Priority: Major
> Labels: newbie, patch
>
> I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
> with spark 2.4.3. Is this a bug ?
> {code:java}
> 2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due
> to exception java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
> 2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be
> removed as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR
> Executor:91 - Exception in task 1.0 in stage 0.0 (TID 1)
> java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
> {code}
> My code is:
> {code:java}
> val map = Map(
> col("_external_op") -> col("A._external_op"),
> col("_external_ts_sec") -> col("A._external_ts_sec"),
> col("_external_row") -> col("A._external_row"),
> col("_external_pos") -> col("A._external_pos"),
> col("id") -> col("A.id"),
> col("order") -> col("A.order"),
> col("shop_code") -> col("A.shop_code"),
> col("customer_tel") -> col("A.customer_tel"),
> col("channel") -> col("A.channel"),
> col("batch_session_id") -> col("A.batch_session_id"),
> col("deleted_at") -> col("A.deleted_at"),
> col("created") -> col("A.created"))
> .asInstanceOf[Map[Any, Any]]
> val testDf =
> spark.sqlContext.read.format("carbondata")
> .option("tableName", "package_drafts")
> .option("schemaName", "db")
> .option("dbName", "db")
> .option("databaseName", "d")b
> .load()
> .as("B")
> testDf.printSchema()
> testDf.merge(package_draft_view, col("A.id").equalTo(col("B.id")))
> .whenMatched(col("A._external_op") === "u")
> .updateExpr(map)
> .whenMatched(col("A._external_op") === "c")
> .insertExpr(map)
> .whenMatched(col("A._external_op") === "d")
> .delete()
> .execute()
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4033) Error when using merge API with hive table
[
https://issues.apache.org/jira/browse/CARBONDATA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nguyen Dinh Huynh updated CARBONDATA-4033:
--
Affects Version/s: 2.0.1
2.0.0
> Error when using merge API with hive table
> --
>
> Key: CARBONDATA-4033
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4033
> Project: CarbonData
> Issue Type: Bug
>Affects Versions: 2.0.0, 2.0.1
>Reporter: Nguyen Dinh Huynh
>Priority: Major
>
> I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
> with spark 2.4.3. Is this a bug ?
> {code:java}
> 2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due
> to exception java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
> 2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be
> removed as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR
> Executor:91 - Exception in task 1.0 in stage 0.0 (TID 1)
> java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
> {code}
> My code is:
> {code:java}
> val map = Map(
> col("_external_op") -> col("A._external_op"),
> col("_external_ts_sec") -> col("A._external_ts_sec"),
> col("_external_row") -> col("A._external_row"),
> col("_external_pos") -> col("A._external_pos"),
> col("id") -> col("A.id"),
> col("order") -> col("A.order"),
> col("shop_code") -> col("A.shop_code"),
> col("customer_tel") -> col("A.customer_tel"),
> col("channel") -> col("A.channel"),
> col("batch_session_id") -> col("A.batch_session_id"),
> col("deleted_at") -> col("A.deleted_at"),
> col("created") -> col("A.created"))
> .asInstanceOf[Map[Any, Any]]
> val testDf =
> spark.sqlContext.read.format("carbondata")
> .option("tableName", "package_drafts")
> .option("schemaName", "db")
> .option("dbName", "db")
> .option("databaseName", "d")b
> .load()
> .as("B")
> testDf.printSchema()
> testDf.merge(package_draft_view, col("A.id").equalTo(col("B.id")))
> .whenMatched(col("A._external_op") === "u")
> .updateExpr(map)
> .whenMatched(col("A._external_op") === "c")
> .insertExpr(map)
> .whenMatched(col("A._external_op") === "d")
> .delete()
> .execute()
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4033) Error when using merge API with hive table
[
https://issues.apache.org/jira/browse/CARBONDATA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nguyen Dinh Huynh updated CARBONDATA-4033:
--
Description:
I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
with spark 2.4.3. Is this a bug ?
{code:java}
2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due to
exception java.lang.RuntimeException: Store location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be removed
as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR Executor:91
- Exception in task 1.0 in stage 0.0 (TID 1) java.lang.RuntimeException: Store
location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
{code}
My code is:
{code:java}
val map = Map(
col("_external_op") -> col("A._external_op"),
col("_external_ts_sec") -> col("A._external_ts_sec"),
col("_external_row") -> col("A._external_row"),
col("_external_pos") -> col("A._external_pos"),
col("id") -> col("A.id"),
col("order") -> col("A.order"),
col("shop_code") -> col("A.shop_code"),
col("customer_tel") -> col("A.customer_tel"),
col("channel") -> col("A.channel"),
col("batch_session_id") -> col("A.batch_session_id"),
col("deleted_at") -> col("A.deleted_at"),
col("created") -> col("A.created"))
.asInstanceOf[Map[Any, Any]]
val testDf =
spark.sqlContext.read.format("carbondata")
.option("tableName", "package_drafts")
.option("schemaName", "db")
.option("dbName", "db")
.option("databaseName", "d")b
.load()
.as("B")
testDf.printSchema()
testDf.merge(package_draft_view, col("A.id").equalTo(col("B.id")))
.whenMatched(col("A._external_op") === "u")
.updateExpr(map)
.whenMatched(col("A._external_op") === "c")
.insertExpr(map)
.whenMatched(col("A._external_op") === "d")
.delete()
.execute()
{code}
was:
I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
with spark 2.4.3. Is this a bug ?
{code:java}
2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due to
exception java.lang.RuntimeException: Store location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be removed
as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR Executor:91
- Exception in task 1.0 in stage 0.0 (TID 1) java.lang.RuntimeException: Store
location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
{code}
> Error when using merge API with hive table
> --
>
> Key: CARBONDATA-4033
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4033
> Project: CarbonData
> Issue Type: Bug
>Reporter: Nguyen Dinh Huynh
>Priority: Major
>
> I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
> with spark 2.4.3. Is this a bug ?
> {code:java}
> 2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due
> to exception java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
> 2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be
> removed as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR
> Executor:91 - Exception in task 1.0 in stage 0.0 (TID 1)
> java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
> {code}
> My code is:
> {code:java}
> val map = Map(
> col("_external_op") -> col("A._external_op"),
> col("_external_ts_sec") -> col("A._external_ts_sec"),
> col("_external_row") -> col("A._external_row"),
> col("_external_pos") -> col("A._external_pos"),
> col("id") -> col("A.id"),
> col("order") -> col("A.order"),
> col("shop_code") -> col("A.shop_code"),
> col("customer_tel") -> col("A.customer_tel"),
> col("channel") -> col("A.channel"),
> col("batch_session_id") -> col("A.batch_session_id"),
> col("deleted_at") -> col("A.deleted_at"),
> col("created") -> col("A.created"))
> .asInstanceOf[Map[Any, Any]]
> val testDf =
> spark.sqlContext.read.format("carbondata")
> .option("tableName", "package_drafts")
> .option("schemaName", "db")
> .option("dbName", "db")
> .option("databaseName", "d")b
> .load()
> .as("B")
> testDf.printSchema()
> testDf.merge(package_draft_view, c
[jira] [Updated] (CARBONDATA-4033) Error when using merge API with hive table
[
https://issues.apache.org/jira/browse/CARBONDATA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nguyen Dinh Huynh updated CARBONDATA-4033:
--
Description:
I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
with spark 2.4.3. Is this a bug ?
{code:java}
2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due to
exception java.lang.RuntimeException: Store location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be removed
as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR Executor:91
- Exception in task 1.0 in stage 0.0 (TID 1) java.lang.RuntimeException: Store
location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
{code}
was:
I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
with spark 2.4.3
{code:java}
2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due to
exception java.lang.RuntimeException: Store location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be removed
as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR Executor:91
- Exception in task 1.0 in stage 0.0 (TID 1) java.lang.RuntimeException: Store
location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
{code}
> Error when using merge API with hive table
> --
>
> Key: CARBONDATA-4033
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4033
> Project: CarbonData
> Issue Type: Bug
>Reporter: Nguyen Dinh Huynh
>Priority: Major
>
> I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
> with spark 2.4.3. Is this a bug ?
> {code:java}
> 2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due
> to exception java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
> 2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be
> removed as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR
> Executor:91 - Exception in task 1.0 in stage 0.0 (TID 1)
> java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4033) Error when using merge API with hive table
[
https://issues.apache.org/jira/browse/CARBONDATA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nguyen Dinh Huynh updated CARBONDATA-4033:
--
Description:
I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
with spark 2.4.3
{code:java}
2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due to
exception java.lang.RuntimeException: Store location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be removed
as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR Executor:91
- Exception in task 1.0 in stage 0.0 (TID 1) java.lang.RuntimeException: Store
location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
{code}
was:
2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due to
exception java.lang.RuntimeException: Store location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be removed
as it was not found on disk or in memory
2020-10-14 14:59:25 ERROR Executor:91 - Exception in task 1.0 in stage 0.0 (TID
1)
java.lang.RuntimeException: Store location not set for the key
__temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
> Error when using merge API with hive table
> --
>
> Key: CARBONDATA-4033
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4033
> Project: CarbonData
> Issue Type: Bug
>Reporter: Nguyen Dinh Huynh
>Priority: Major
>
> I always get this error when trying to upsert hive table. I'm using CDH 6.3.1
> with spark 2.4.3
>
> {code:java}
> 2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due
> to exception java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0.
> 2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be
> removed as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR
> Executor:91 - Exception in task 1.0 in stage 0.0 (TID 1)
> java.lang.RuntimeException: Store location not set for the key
> __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (CARBONDATA-4033) Error when using merge API with hive table
Nguyen Dinh Huynh created CARBONDATA-4033: - Summary: Error when using merge API with hive table Key: CARBONDATA-4033 URL: https://issues.apache.org/jira/browse/CARBONDATA-4033 Project: CarbonData Issue Type: Bug Reporter: Nguyen Dinh Huynh 2020-10-14 14:59:25 WARN BlockManager:66 - Putting block rdd_21_1 failed due to exception java.lang.RuntimeException: Store location not set for the key __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0. 2020-10-14 14:59:25 WARN BlockManager:66 - Block rdd_21_1 could not be removed as it was not found on disk or in memory 2020-10-14 14:59:25 ERROR Executor:91 - Exception in task 1.0 in stage 0.0 (TID 1) java.lang.RuntimeException: Store location not set for the key __temptable-7bdfc88b-e5b7-46d5-8492-dfbb98b9a1b0_1602662359786_null_389ec940-ed27-41d1-9038-72ed1cd162e90x0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (CARBONDATA-3561) After delete/update the data, the query results become incorrect
[
https://issues.apache.org/jira/browse/CARBONDATA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040688#comment-17040688
]
Nguyen Dinh Huynh commented on CARBONDATA-3561:
---
[~zzcclp] whether Carbondata 1.6.1 is effected ?
> After delete/update the data, the query results become incorrect
>
>
> Key: CARBONDATA-3561
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3561
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
>Affects Versions: 1.6.0, 1.5.4
> Environment: SUSE12 CDH5
>Reporter: Xigua
>Assignee: Zhichao Zhang
>Priority: Blocker
> Fix For: 2.0.0
>
> Attachments: image-2019-10-30-14-42-49-871.png,
> image-2019-10-30-14-43-21-972.png
>
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
>
> {quote}CREATE TABLE `workqueue_zyy02` (`queuecode` STRING, `channelflag`
> STRING, `dt` STRING)
> USING org.apache.spark.sql.CarbonSource
> PARTITIONED BY (dt);
>
> delete from workqueue_zyy02 m where m.queuecode ='1';
> {quote}
> *before*
> * !image-2019-10-30-14-42-49-871.png!
> *
> * *after*
> * !image-2019-10-30-14-43-21-972.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
