Unsubscribe
I don't know if java serialization is slow in that case; that shows
blocking on a class load, which may or may not be directly due to
deserialization.
Indeed I don't think (some) things are serialized in local mode within one
JVM, so not sure that's actually what's going on.
On Thu, Sep 2, 2021
[You are receiving this email because you are subscribed to the user
list of one or more Apache project.]
Dear Apache enthusiast,
ApacheCon is our annual convention, featuring content related to our
many software projects. This year, it will be held on September 21-23.
Registration is free
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
val lines = spark.readStream
.format("socket")
// .schema(StructType(schemas))
.option("host", "10.3.87.23")
.option("port", )
.load()
.selectExpr("CAST(value AS STRING)").as[(String)]DF = lines.map(x => {
val obj = JSON.parseObject(x)
val ls = new util.ArrayList()
