Hyukjin Kwon created SPARK-60724:
------------------------------------
Summary: Document the order of the calls of native data sources
and add is_log_enabled
Key: SPARK-60724
URL: https://issues.apache.org/jira/browse/SPARK-60724
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 5.0.0
Reporter: Hyukjin Kwon
A follow-up to SPARK-60101 (https://github.com/apache/spark/pull/59424), from
the review in
https://github.com/apache/spark/pull/59424#issuecomment-6480975990:
- Document in spark_datasource.h the order in which Spark calls the functions
on a handle, so that SDKs need not guard against other orders.
- Append is_log_enabled to SparkDsHost, so that a library can skip formatting
the messages that Spark does not log, and follow the log level of Spark.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
