WenDing-Y commented on code in PR #9467:
URL: https://github.com/apache/seatunnel/pull/9467#discussion_r2160632917
##########
seatunnel-e2e/seatunnel-connector-v2-e2e/connector-paimon-e2e/src/test/java/org/apache/seatunnel/e2e/connector/paimon/PaimonIT.java:
##########
@@ -34,9 +35,21 @@
import java.nio.file.Path;
@DisabledOnContainer(
- value = TestContainerId.FLINK_1_13,
- disabledReason = "Paimon does not support flink 1.13")
-public class PaimonIT extends TestSuiteBase {
+ value = {},
+ type = {EngineType.SPARK, EngineType.FLINK},
+ disabledReason =
+ "Spark and Flink engine can not auto create paimon table on
worker node in local file(e.g flink tm) by savemode feature which can lead
error")
Review Comment:
The fundamental reason is the lack of distributed storage. Why is the
retrieved data empty? Because the data was written to the local node. The data
write operation happens on the TaskManager node, while the JobManager is
responsible for reading the split information. However, the JobManager cannot
access the metadata of the data since there is no distributed storage system in
place.
Another issue is why the assertion passes even though no data was read. This
is because the assert statement was implemented incorrectly, allowing it to
pass even when no data was actually retrieved.
##########
seatunnel-e2e/seatunnel-connector-v2-e2e/connector-paimon-e2e/src/test/java/org/apache/seatunnel/e2e/connector/paimon/PaimonIT.java:
##########
@@ -34,9 +35,21 @@
import java.nio.file.Path;
@DisabledOnContainer(
- value = TestContainerId.FLINK_1_13,
- disabledReason = "Paimon does not support flink 1.13")
-public class PaimonIT extends TestSuiteBase {
+ value = {},
+ type = {EngineType.SPARK, EngineType.FLINK},
+ disabledReason =
+ "Spark and Flink engine can not auto create paimon table on
worker node in local file(e.g flink tm) by savemode feature which can lead
error")
Review Comment:
@corgy-w
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
