wfxxh commented on issue #4129:
URL: https://github.com/apache/iceberg/issues/4129#issuecomment-1791842127
I use pa
> If anyone is confused about this error on AWS Athena, unlike with
hive-style file partitioning in S3 like
`{table-s3-location}/year={}/month={}/day={}/`
>
> The equivalent in iceberg, e.g.
>
> ```sql
> CREATE TABLE documents (
> id string,
> created_at timestamp
> ...
> )
> PARTITIONED BY (
> day(created_at)
> );
> LOCATION 's3://{table-s3-location}/'
> TBLPROPERTIES ('table_type' = 'ICEBERG');
> ```
>
> This will create separate partitions for each day exactly like hive
But I use hdfs set partition like yours,the data folder is {date_time
column}_day=$YEAR-$MONTH-$DAY. One year it will be 365 numbers of dirs in the
data folder,several years it will be too many dirs ,whether it will have a bad
impact on performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
