Jose Torres created SPARK-24237: ----------------------------------- Summary: continuous shuffle dependency Key: SPARK-24237 URL: https://issues.apache.org/jira/browse/SPARK-24237 Project: Spark Issue Type: Sub-task Components: Structured Streaming Affects Versions: 2.4.0 Reporter: Jose Torres
[https://docs.google.com/document/d/1IL4kJoKrZWeyIhklKUJqsW-yEN7V7aL05MmM65AYOfE/edit#heading=h.8t3ci57f7uii] We might not need this to be an actual org.apache.spark.Dependency. We need to somehow register with MapOutputTracker, or write our own custom tracker if this ends up being infeasible. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org