Xianghu Wang created HUDI-1946:
----------------------------------

             Summary: Enhance SqlQueryBasedTransformer to allow user use 
wildcard to represent all the columns
                 Key: HUDI-1946
                 URL: https://issues.apache.org/jira/browse/HUDI-1946
             Project: Apache Hudi
          Issue Type: New Feature
            Reporter: Xianghu Wang
            Assignee: Xianghu Wang
             Fix For: 0.9.0


When the user wants to derive one or more columns from the existing columns and 
the
existing columns are all needed, the user needs to spell all the columns they 
need in the SQL.

This will be very troublesome and time-consuming when we have dozens or 
hundreds of columns. we can save trouble by using a wildcard in the SQL to 
represent all the columns.

that means if we have "id", "name", "age", "ts" these four columns already and 
we want to add a new column driver from ts, we can use

"select *, FROM_UNIXTIME(ts / 1000, 'yyyyMMdd') as dt from table_name"

to represent

"select id, name, age, ts, FROM_UNIXTIME(ts / 1000, 'yyyyMMdd') as dt from 
table_name"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to