Peter Toth created SPARK-50356:
----------------------------------
Summary: Skipped stages are inconsitent on UI
Key: SPARK-50356
URL: https://issues.apache.org/jira/browse/SPARK-50356
Project: Spark
Issue Type: Bug
Components: Spark Core, UI
Affects Versions: 4.0.0
Reporter: Peter Toth
The following snipett produces inconsitent UI state:
{noformat}
import scala.collection.mutable
import scala.concurrent.{ExecutionContext, Future, Await}
import scala.concurrent.duration.Duration
val rdd = sc.parallelize(1 to 1000, 100).repartition(10)
rdd.count
val futures = mutable.ListBuffer.empty[Future[Unit]]
implicit val xc =
ExecutionContext.fromExecutorService(java.util.concurrent.Executors.newFixedThreadPool(5))
futures += Future { rdd.count }
futures += Future { rdd.count }
futures += Future { rdd.count }
Await.result(Future.sequence(futures), Duration.Inf)
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
