Tanel Kiis created SPARK-35695: ---------------------------------- Summary: QueryExecutionListener does not see any observed metrics fired before persist/cache Key: SPARK-35695 URL: https://issues.apache.org/jira/browse/SPARK-35695 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.2.0 Reporter: Tanel Kiis
This example properly fires the event {code} spark.range(100) .observe( name = "other_event", avg($"id").cast("int").as("avg_val")) .collect() {code} But when I add persist, then no event is fired: {code} spark.range(100) .observe( name = "other_event", avg($"id").cast("int").as("avg_val")) .persist() .collect() {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org