I have a question on how hidden partitioning works in Iceberg using Java
API.
The code is something like the following.
```
// records is the list of records with a time column
// table is created using partition spec hour(time)
// records have different rows with different hours
Table table = loadTable();
Path path = new Path(...);
FileAppender<Record> appender = Avro.write(fromPath(path, conf)).build();
appender.addAll(records);
appender.close();
DataFile dataFile = DataFiles.builder(table.spec())
.withInputFile(HadoopInputFile.fromPath(path, conf))
.build();
table.newAppend().appendFile(dataFile).commit();
```
However, once committed, I still see only one partition count updated and
one data file persisted, even though the underlying records
spread different hours.
I think I use the API in the wrong way but appreciate if someone can help
me on the right way to write partitioned data.
Thanks,
--
Chen Song