That starts to smell...
When analyzing SparkSubmit.scala, we can see than one of the firsts thing it
does is to parse arguments. This uses Utils object and triggers
initialization of member variables. One such variable is
ShutdownHookManager (which didn't exists in spark 1.3) with the later
Hello,
When enabling speculation, my first job is to launch a partitioned JDBC
dataframe query, in which some partitions take longer than others to respond.
This causes speculation and creates new nodes to launch the query. When one of
those nodes finish the query, the speculative one remains
101 - 102 of 102 matches
Mail list logo