jonvex commented on code in PR #8303:
URL: https://github.com/apache/hudi/pull/8303#discussion_r1202649672
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBootstrapRelation.scala:
##########
@@ -188,11 +188,23 @@ case class HoodieBootstrapRelation(override val
sqlContext: SQLContext,
override def updatePrunedDataSchema(prunedSchema: StructType):
HoodieBootstrapRelation =
this.copy(prunedDataSchema = Some(prunedSchema))
+
+ def toHadoopFsRelation: HadoopFsRelation = {
+ HadoopFsRelation(
+ location = fileIndex,
+ partitionSchema = fileIndex.partitionSchema,
+ dataSchema = fileIndex.dataSchema,
+ bucketSpec = None,
+ fileFormat = fileFormat,
+ optParams)(sparkSession)
+ }
}
object HoodieBootstrapRelation {
+ val USE_FAST_BOOTSTRAP_READ =
"hoodie.bootstrap.relation.use.fast.bootstrap.read"
Review Comment:
Ok. I was able to reuse the config. The reason I introduced the config was
because I was worried about the case where the config is enabled but we decide
to use the regular bootstrap read. I tested and made sure the config was
correct in all places where it is used.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
