JingsongLi commented on code in PR #6296:
URL: https://github.com/apache/paimon/pull/6296#discussion_r2373914106
##########
paimon-spark/paimon-spark-common/src/main/java/org/apache/paimon/spark/SparkCatalog.java:
##########
@@ -651,15 +652,45 @@ protected org.apache.spark.sql.connector.catalog.Table
loadSparkTable(
}
}
- private static FileTable convertToFileTable(Identifier ident, FormatTable
formatTable) {
+ private static FileTable toSparkFormatTable(Identifier ident, FormatTable
formatTable) {
SparkSession spark = PaimonSparkSession$.MODULE$.active();
StructType schema =
SparkTypeUtils.fromPaimonRowType(formatTable.rowType());
StructType partitionSchema =
SparkTypeUtils.fromPaimonRowType(
TypeUtils.project(formatTable.rowType(),
formatTable.partitionKeys()));
List<String> pathList = new ArrayList<>();
pathList.add(formatTable.location());
+ Map<String, String> optionsMap = formatTable.options();
+ CoreOptions coreOptions = new CoreOptions(optionsMap);
+ if (coreOptions.formatTableImplementationIsPaimon()) {
+ if (optionsMap.containsKey("seq")) {
+ optionsMap.put("csv.field-delimiter", optionsMap.get("seq"));
Review Comment:
just put these into `CsvOptions` fallbacks?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
