laglangyue commented on code in PR #43526: URL: https://github.com/apache/spark/pull/43526#discussion_r1401554599
########## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala: ########## @@ -47,16 +46,16 @@ import org.apache.spark.util.ArrayImplicits._ * Note: [[HDFSMetadataLog]] doesn't support S3-like file systems as they don't guarantee listing * files in a directory always shows the latest files. */ -class HDFSMetadataLog[T <: AnyRef : ClassTag](sparkSession: SparkSession, path: String) - extends MetadataLog[T] with Logging { - - private implicit val formats = Serialization.formats(NoTypeHints) +class HDFSMetadataLog[T <: AnyRef: ClassTag](sparkSession: SparkSession, path: String)( + private final implicit val manifest: Manifest[T]) Review Comment: talk is cheap, show code : ![image](https://github.com/apache/spark/assets/35491928/9bdb9595-a97f-4db1-96bc-ce48305aa33c) ![image](https://github.com/apache/spark/assets/35491928/36faf445-3731-4bb1-90d3-3571cdc167e7) ![image](https://github.com/apache/spark/assets/35491928/72870aa8-6a6f-4c76-9a3e-f2cc6412602c) manifest is used to deserialize for Json4s -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org