[ https://issues.apache.org/jira/browse/SPARK-32667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
angerszhu updated SPARK-32667: ------------------------------ Description: Scrip transform no-serde mode should pad null value to filling column {code:java} hive> SELECT TRANSFORM(a, b) > ROW FORMAT DELIMITED > FIELDS TERMINATED BY '|' > LINES TERMINATED BY '\n' > NULL DEFINED AS 'NULL' > USING 'cat' as (a string, b string, c string, d string) > ROW FORMAT DELIMITED > FIELDS TERMINATED BY '|' > LINES TERMINATED BY '\n' > NULL DEFINED AS 'NULL' > FROM ( > select 1 as a, 2 as b > ) tmp ; OK 1 2 NULL NULL Time taken: 24.626 seconds, Fetched: 1 row(s) {code} > Scrip transformation no-serde mode when column less then output length , Use > null fill > --------------------------------------------------------------------------------------- > > Key: SPARK-32667 > URL: https://issues.apache.org/jira/browse/SPARK-32667 > Project: Spark > Issue Type: Sub-task > Components: SQL > Affects Versions: 3.0.0 > Reporter: angerszhu > Priority: Major > > Scrip transform no-serde mode should pad null value to filling column > {code:java} > hive> SELECT TRANSFORM(a, b) > > ROW FORMAT DELIMITED > > FIELDS TERMINATED BY '|' > > LINES TERMINATED BY '\n' > > NULL DEFINED AS 'NULL' > > USING 'cat' as (a string, b string, c string, d string) > > ROW FORMAT DELIMITED > > FIELDS TERMINATED BY '|' > > LINES TERMINATED BY '\n' > > NULL DEFINED AS 'NULL' > > FROM ( > > select 1 as a, 2 as b > > ) tmp ; > OK > 1 2 NULL NULL > Time taken: 24.626 seconds, Fetched: 1 row(s) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org