HeartSaVioR commented on code in PR #42940: URL: https://github.com/apache/spark/pull/42940#discussion_r1329418792
########## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/AvailableNowDataStreamWrapper.scala: ########## @@ -28,6 +28,12 @@ import org.apache.spark.sql.connector.read.streaming class AvailableNowDataStreamWrapper(val delegate: SparkDataStream) extends SparkDataStream with SupportsTriggerAvailableNow with Logging { + // See SPARK-45178 for more details. + logWarning(s"Activating the wrapper implementation of Trigger.AvailableNow for source " + + s"[$delegate]. Note that this might introduce possibility of deduplication, dataloss, " + + s"correctness issue. Enable the config with extreme care. We strongly recommend to contact " + + "with data source developer to support Trigger.AvailableNow.") Review Comment: maybe I'd remove Spark here - they need to contact 3rd party data source developer, not Spark community. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org