HeartSaVioR commented on code in PR #42940:
URL: https://github.com/apache/spark/pull/42940#discussion_r1329418792
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/AvailableNowDataStreamWrapper.scala:
##########
@@ -28,6 +28,12 @@ import org.apache.spark.sql.connector.read.streaming
class AvailableNowDataStreamWrapper(val delegate: SparkDataStream)
extends SparkDataStream with SupportsTriggerAvailableNow with Logging {
+ // See SPARK-45178 for more details.
+ logWarning(s"Activating the wrapper implementation of Trigger.AvailableNow
for source " +
+ s"[$delegate]. Note that this might introduce possibility of
deduplication, dataloss, " +
+ s"correctness issue. Enable the config with extreme care. We strongly
recommend to contact " +
+ "with data source developer to support Trigger.AvailableNow.")
Review Comment:
maybe I'd remove Spark here - they need to contact 3rd party data source
developer, not Spark community.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
