[ https://issues.apache.org/jira/browse/HUDI-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Udit Mehrotra updated HUDI-1765: -------------------------------- Fix Version/s: (was: 0.9.0) 0.10.0 > disabling auto commit does not work with spark ds > ------------------------------------------------- > > Key: HUDI-1765 > URL: https://issues.apache.org/jira/browse/HUDI-1765 > Project: Apache Hudi > Issue Type: Bug > Components: Spark Integration > Reporter: sivabalan narayanan > Priority: Major > Labels: sev:high > Fix For: 0.10.0 > > > commitAndPerformPostOperations in HoodieSparkSqlWriter commits all operations > w/o checking for autoCommitProp. So, this prop is not being honored at spark > ds layer. > > Added below test to TestCOWDataSource and it fails. > [https://gist.github.com/nsivabalan/479320351bec95ba3e0c0dfa5abb2b06] > -- This message was sent by Atlassian Jira (v8.3.4#803005)