Hi, Mang Atomicity is very important for CTAS, especially for batch jobs. This FLIP is a continuation of FLIP-218, which is valuable for CTAS. I just have one question, in the Motivation part of FLIP-218, we mentioned three levels of atomicity semantics, can this current design do the same as Spark's DataSource V2, which can guarantee both atomicity and isolation, for example, can it be done by writing to Hive tables using CTAS?
Best, Ron Mang Zhang <zhangma...@163.com> 于2023年4月10日周一 11:03写道： > Hi, everyone > > > > > I'd like to start a discussion about FLIP-305: Support atomic for CREATE > TABLE AS SELECT(CTAS) statement [1]. > > > > > CREATE TABLE AS SELECT(CTAS) statement has been support, but it's not > atomic. It will create the table first before job running. If the job > execution fails, or is cancelled, the table will not be dropped. > > > > > So I want Flink to support atomic CTAS, where only the table is created > when the Job succeeds. Improve user experience. > > > > > Looking forward to your feedback. > > > > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-305%3A+Support+atomic+for+CREATE+TABLE+AS+SELECT%28CTAS%29+statement > > > > > > > > > > > -- > > Best regards, > Mang Zhang
