[jira] [Updated] (HUDI-4584) SQLConf is not propagated correctly into RDDs
[ https://issues.apache.org/jira/browse/HUDI-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4584: -- Story Points: 6 (was: 8) > SQLConf is not propagated correctly into RDDs > - > > Key: HUDI-4584 > URL: https://issues.apache.org/jira/browse/HUDI-4584 > Project: Apache Hudi > Issue Type: Bug >Reporter: Alexey Kudinkin >Assignee: Alexey Kudinkin >Priority: Blocker > Labels: pull-request-available > Fix For: 0.12.1 > > > There were a few reports and slack as well as in GI, related to Spark SQL > configs not being respected by DeltaStreamer while working perfectly fine > when leveraging DataSource API: > [https://github.com/apache/hudi/issues/6278] > > I was able to trace these down to > # `HoodieSparkUtils.createRDD` instantiating `AvroSerializer` which uses > SQLConf that isn't propagated by Spark properly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HUDI-4584) SQLConf is not propagated correctly into RDDs
[ https://issues.apache.org/jira/browse/HUDI-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4584: -- Story Points: 8 (was: 4) > SQLConf is not propagated correctly into RDDs > - > > Key: HUDI-4584 > URL: https://issues.apache.org/jira/browse/HUDI-4584 > Project: Apache Hudi > Issue Type: Bug >Reporter: Alexey Kudinkin >Assignee: Alexey Kudinkin >Priority: Blocker > Labels: pull-request-available > Fix For: 0.12.1 > > > There were a few reports and slack as well as in GI, related to Spark SQL > configs not being respected by DeltaStreamer while working perfectly fine > when leveraging DataSource API: > [https://github.com/apache/hudi/issues/6278] > > I was able to trace these down to > # `HoodieSparkUtils.createRDD` instantiating `AvroSerializer` which uses > SQLConf that isn't propagated by Spark properly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HUDI-4584) SQLConf is not propagated correctly into RDDs
[ https://issues.apache.org/jira/browse/HUDI-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4584: -- Sprint: 2022/08/22 > SQLConf is not propagated correctly into RDDs > - > > Key: HUDI-4584 > URL: https://issues.apache.org/jira/browse/HUDI-4584 > Project: Apache Hudi > Issue Type: Bug >Reporter: Alexey Kudinkin >Assignee: Alexey Kudinkin >Priority: Blocker > Labels: pull-request-available > Fix For: 0.12.1 > > > There were a few reports and slack as well as in GI, related to Spark SQL > configs not being respected by DeltaStreamer while working perfectly fine > when leveraging DataSource API: > [https://github.com/apache/hudi/issues/6278] > > I was able to trace these down to > # `HoodieSparkUtils.createRDD` instantiating `AvroSerializer` which uses > SQLConf that isn't propagated by Spark properly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HUDI-4584) SQLConf is not propagated correctly into RDDs
[ https://issues.apache.org/jira/browse/HUDI-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4584: -- Status: Patch Available (was: In Progress) > SQLConf is not propagated correctly into RDDs > - > > Key: HUDI-4584 > URL: https://issues.apache.org/jira/browse/HUDI-4584 > Project: Apache Hudi > Issue Type: Bug >Reporter: Alexey Kudinkin >Assignee: Alexey Kudinkin >Priority: Blocker > Labels: pull-request-available > Fix For: 0.12.1 > > > There were a few reports and slack as well as in GI, related to Spark SQL > configs not being respected by DeltaStreamer while working perfectly fine > when leveraging DataSource API: > [https://github.com/apache/hudi/issues/6278] > > I was able to trace these down to > # `HoodieSparkUtils.createRDD` instantiating `AvroSerializer` which uses > SQLConf that isn't propagated by Spark properly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HUDI-4584) SQLConf is not propagated correctly into RDDs
[ https://issues.apache.org/jira/browse/HUDI-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4584: -- Status: In Progress (was: Open) > SQLConf is not propagated correctly into RDDs > - > > Key: HUDI-4584 > URL: https://issues.apache.org/jira/browse/HUDI-4584 > Project: Apache Hudi > Issue Type: Bug >Reporter: Alexey Kudinkin >Assignee: Alexey Kudinkin >Priority: Blocker > Labels: pull-request-available > Fix For: 0.12.1 > > > There were a few reports and slack as well as in GI, related to Spark SQL > configs not being respected by DeltaStreamer while working perfectly fine > when leveraging DataSource API: > [https://github.com/apache/hudi/issues/6278] > > I was able to trace these down to > # `HoodieSparkUtils.createRDD` instantiating `AvroSerializer` which uses > SQLConf that isn't propagated by Spark properly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HUDI-4584) SQLConf is not propagated correctly into RDDs
[ https://issues.apache.org/jira/browse/HUDI-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4584: - Labels: pull-request-available (was: ) > SQLConf is not propagated correctly into RDDs > - > > Key: HUDI-4584 > URL: https://issues.apache.org/jira/browse/HUDI-4584 > Project: Apache Hudi > Issue Type: Bug >Reporter: Alexey Kudinkin >Assignee: Alexey Kudinkin >Priority: Blocker > Labels: pull-request-available > Fix For: 0.12.1 > > > There were a few reports and slack as well as in GI, related to Spark SQL > configs not being respected by DeltaStreamer while working perfectly fine > when leveraging DataSource API: > [https://github.com/apache/hudi/issues/6278] > > I was able to trace these down to > # `HoodieSparkUtils.createRDD` instantiating `AvroSerializer` which uses > SQLConf that isn't propagated by Spark properly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
