Cqz666 commented on issue #827:
URL:
https://github.com/apache/incubator-paimon/issues/827#issuecomment-1498798591
When I use the time partition field to filter the partitions of the current
day,the data can be completely retrieved, but if the query involves historical
partitions(Partitions before today), the complete data cannot be retrieved. For
example, I use the following sql:
`SELECT window_start, window_end, MAX(receive_timestamp) as max_time FROM
TABLE(
TUMBLE(TABLE log_wk, DESCRIPTOR(event_time), INTERVAL '1' MINUTES)
)
where dt>='20230405'
GROUP BY window_start, window_end;`
Today is 20230406, the data of today’s partition can output complete
results, but the historical partition '20230405' cannot.In fact, only the data
after the latest compressed snapshot of that historical partition is detected.
For example, the most recent compressed snapshot was at '2023-04-05 23:41',
then data in this interval of '2023-04-05 23:41 ~ 2023-04-05 23:59' is output.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
