Hi, I want to create subdirectories named after values of a nested column, location.transId.
This is my first attempt: > CREATE TABLE output > PARTITIONED BY (`location.transId`) > WITH ( > 'connector' = 'filesystem', > 'path' = 'east-out', > 'format' = 'json' > ) LIKE navi (EXCLUDING ALL) > It fails with the following errors: > Exception in thread "main" org.apache.flink.table.api.ValidationException: > Partition column 'location.transId' not defined in the table schema. > Available columns: ['type', 'location'] > at > org.apache.flink.table.planner.operations.SqlCreateTableConverter.verifyPartitioningColumnsExist(SqlCreateTableConverter.java:164) > at > org.apache.flink.table.planner.operations.SqlCreateTableConverter.createCatalogTable(SqlCreateTableConverter.java:130) > at > org.apache.flink.table.planner.operations.SqlCreateTableConverter.convertCreateTable(SqlCreateTableConverter.java:76) > at > org.apache.flink.table.planner.operations.SqlToOperationConverter.convert(SqlToOperationConverter.java:190) > at > org.apache.flink.table.planner.delegation.ParserImpl.parse(ParserImpl.java:78) > at > org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:678) > at com.kakaomobility.SQLExecutor.main(SQLExecutor.java:28) > As It seems like nested columns are not recognized as a eligible column for PARTITIONED BY, I tried the following: > CREATE TABLE output ( > `partition` AS location.transId > ) PARTITIONED BY (`partition`) > WITH ( > 'connector' = 'filesystem', > 'path' = 'east-out', > 'format' = 'json' > ) LIKE navi (EXCLUDING ALL) > It also fails: > Exception in thread "main" > org.apache.flink.table.api.ValidationException: The field count of logical > schema of the table does not match with the field count of physical schema . The logical schema: [STRING,ROW<`lastUpdateTime` BIGINT, `transId` STRING>] The physical schema: [STRING,ROW<`lastUpdateTime` BIGINT, `transId` STRING>,STRING]. Thanks in advance, Dongwon
