nmukerje edited a comment on issue #3321: URL: https://github.com/apache/hudi/issues/3321#issuecomment-886012008
I am not using bulk insert for the upsert/delete. I am just bulk insert for Step 1 to stage some records. The notebook (https://github.com/nmukerje/misc/blob/master/Hudi/Hudi_Pyspark_Delete_Upsert_Test.ipynb) is public so you can run the cells/oode. The schema is below and yes, I am re-Inserting the initial records with _hoodie_is_deleted set to "false" as well in Step 4. ``` +------------------+---+-----+---+---+----+ |_hoodie_is_deleted| id|month| sk|txt|year| +------------------+---+-----+---+---+----+ | false| 0| 1| 0| A|2019| | false| 1| 10| 1| B|2019| | false| 2| 10| 2| C|2019| | false| 3| 6| 3| D|2019| | false| 4| 3| 4| E|2019| +------------------+---+-----+---+---+----+ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
