Hi, I'm thinking of using Structured Streaming instead of old streaming, but I need to be able to save results to Hive table. Documentation for file sink says( http://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#output-sinks): "Supports writes to partitioned tables. ". But being able to write to partitioned directories is not enough to write to the table: someone needs to write to Hive metastore. How can I use Structured Streaming and write to Hive table?
-- *Sincerely yoursEgor Pakhomov*