[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-2598: -- Fix Version/s: 0.13.0 (was: 0.12.0) > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Task > Components: code-quality >Reporter: Ethan Guo >Assignee: Alexey Kudinkin >Priority: Blocker > Fix For: 0.13.0 > > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2598: - Fix Version/s: 0.12.0 > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Task > Components: code-quality >Reporter: Ethan Guo >Assignee: Alexey Kudinkin >Priority: Blocker > Fix For: 0.12.0 > > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2598: - Epic Link: HUDI-3217 (was: HUDI-538) > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Task > Components: code-quality >Reporter: Ethan Guo >Assignee: Alexey Kudinkin >Priority: Blocker > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2598: - Fix Version/s: (was: 0.12.0) > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Task > Components: code-quality >Reporter: Ethan Guo >Assignee: Alexey Kudinkin >Priority: Blocker > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2598: - Fix Version/s: 0.12.0 > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Task > Components: Code Cleanup >Reporter: Ethan Guo >Assignee: Alexey Kudinkin >Priority: Blocker > Fix For: 0.12.0 > > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2598: - Fix Version/s: (was: 0.11.0) > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Task > Components: Code Cleanup >Reporter: Ethan Guo >Assignee: Alexey Kudinkin >Priority: Blocker > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2598: Priority: Blocker (was: Critical) > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Task > Components: Code Cleanup >Reporter: Ethan Guo >Assignee: Ethan Guo >Priority: Blocker > Fix For: 0.11.0 > > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2598: - Summary: Redesign record payload class to decouple HoodieRecordPayload from Avro (was: Resign record payload class to decouple HoodieRecordPayload from Avro) > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Sub-task > Components: Code Cleanup >Reporter: Ethan Guo >Assignee: Ethan Guo >Priority: Major > Fix For: 0.11.0 > > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro
[ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2598: - Priority: Critical (was: Major) > Redesign record payload class to decouple HoodieRecordPayload from Avro > --- > > Key: HUDI-2598 > URL: https://issues.apache.org/jira/browse/HUDI-2598 > Project: Apache Hudi > Issue Type: Sub-task > Components: Code Cleanup >Reporter: Ethan Guo >Assignee: Ethan Guo >Priority: Critical > Fix For: 0.11.0 > > > We need to redesign the HoodieRecordPayload interface, which should not > depend on avro, to pave the road for Spark Row writer work. Ideally, the new > abstraction should have the individual implementation of avro-based record > and spark-based Row, and the abstraction itself has more high-level > operations like preCombine, getValue, etc., which are not tied to > IndexedRecord. This should also make the write client easier to extend for > Spark Dataset of Rows. -- This message was sent by Atlassian Jira (v8.20.1#820001)
