cxzl25 commented on PR #1722: URL: https://github.com/apache/orc/pull/1722#issuecomment-1878077115
> It seems that you are using `HiveFileFormat`. It follows Hive's behavior whose file extension is determined by `hive.output.file.extension` Thanks for the reminder, because spark will convert the ctas statement, so I corrected the command slightly.(`.orc`) ```bash ./bin/spark-sql -c spark.hive.output.file.extension=.orc -c spark.sql.hive.convertMetastoreCtas=false ``` ```sql create table tmp_orc stored as orcfile as select id from range(1); ``` ```bash ls -al spark-warehouse/tmp_orc ``` ``` -rwxr-xr-x@ 1 csy staff 8 1 5 11:28 .part-00000-d2fb8ac6-e34b-4b1b-9a08-6c3580e4afc6-c000.orc.crc -rwxr-xr-x@ 1 csy staff 12 1 5 11:28 .part-00011-d2fb8ac6-e34b-4b1b-9a08-6c3580e4afc6-c000.orc.crc -rwxr-xr-x@ 1 csy staff 0 1 5 11:28 part-00000-d2fb8ac6-e34b-4b1b-9a08-6c3580e4afc6-c000.orc -rwxr-xr-x@ 1 csy staff 202 1 5 11:28 part-00011-d2fb8ac6-e34b-4b1b-9a08-6c3580e4afc6-c000.orc ``` > could you try to add a new additional configuration to ignore the extension while keeping the existing default behavior Thanks, let me do it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
