Has anyone seen a way of updating the Spark streaming job configuration while retaining the existing data in the write ahead log?
e.g. if you've launched a job without enough executors and a backlog has built up in the WAL, can you increase the number of executors without losing the WAL data? Thanks, Ewan