juripetersen commented on code in PR #646:
URL: https://github.com/apache/incubator-wayang/pull/646#discussion_r2622052047
##########
wayang-api/wayang-api-scala-java/src/main/scala/org/apache/wayang/api/JavaPlanBuilder.scala:
##########
@@ -72,6 +72,16 @@ class JavaPlanBuilder(wayangCtx: WayangContext, jobName:
String) {
def readParquet(url: String, projection: Array[String] = null):
UnarySourceDataQuantaBuilder[UnarySourceDataQuantaBuilder[_, Record], Record] =
createSourceBuilder(ParquetSource.create(url,
projection))(ClassTag(classOf[Record]))
+ /**
+ * Read a parquet file and provide it as a dataset of [[Record]]s backed by
Spark Datasets.
+ *
+ * @param url the URL of the Parquet file
+ * @param projection the projection, if any
+ * @return [[DataQuantaBuilder]] for the file
+ */
+ def readParquetAsDataset(url: String, projection: Array[String] = null):
UnarySourceDataQuantaBuilder[UnarySourceDataQuantaBuilder[_, Record], Record] =
Review Comment:
The same thought goes for this.
We could use `readParquet` with the flag here as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
