Xianghu Wang created HUDI-1946: ---------------------------------- Summary: Enhance SqlQueryBasedTransformer to allow user use wildcard to represent all the columns Key: HUDI-1946 URL: https://issues.apache.org/jira/browse/HUDI-1946 Project: Apache Hudi Issue Type: New Feature Reporter: Xianghu Wang Assignee: Xianghu Wang Fix For: 0.9.0
When the user wants to derive one or more columns from the existing columns and the existing columns are all needed, the user needs to spell all the columns they need in the SQL. This will be very troublesome and time-consuming when we have dozens or hundreds of columns. we can save trouble by using a wildcard in the SQL to represent all the columns. that means if we have "id", "name", "age", "ts" these four columns already and we want to add a new column driver from ts, we can use "select *, FROM_UNIXTIME(ts / 1000, 'yyyyMMdd') as dt from table_name" to represent "select id, name, age, ts, FROM_UNIXTIME(ts / 1000, 'yyyyMMdd') as dt from table_name" -- This message was sent by Atlassian Jira (v8.3.4#803005)