You can create a custom data source following this blog <http://roizaig.blogspot.com/2021/04/create-custom-data-source-with-spark-3x.html> . It shows how to read a java log file using spark v3 api as an example.
-- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org