Hello Everyone,
We have setup spark and setup Iceberg-Glue connectors as mentioned at
https://iceberg.apache.org/docs/latest/aws/ to integrate Spark, Iceberg, and
AWS Glue Catalog. We are able to read tables through this but we are unable to
read data through views. PFB, the error:
pyspark.err
Hello,
What would be the right way, if any, to inject a runtime variable into Spark
logs. So that, for example, if Spark (driver/worker) logs some
info/warning/error message, the variable will be output there (in order to help
filtering logs for the sake of monitoring and troubleshooting).
Re
