zbs commented on issue #45638: URL: https://github.com/apache/arrow/issues/45638#issuecomment-2688484841
I'll post updates here as I run diagnostics. The valgrind/massif run was not
able to complete with the full input, so I ran it on a subset of the original
input, and found this:
```
->16.25% (524,906,816B) 0x80EF7A3: std::vector<parquet::format::ColumnChunk,
std::allocator<parquet::format::ColumnChunk>
>::operator=(std::vector<parquet::format::ColumnChunk,
std::allocator<parquet::format::ColumnChunk> > const&) [clone .isra.0]
| ->16.25% (524,906,816B) 0x80F341D:
parquet::format::RowGroup::RowGroup(parquet::format::RowGroup const&)
| | ->16.25% (524,887,216B) 0x80D36BA: void
std::vector<parquet::format::RowGroup,
std::allocator<parquet::format::RowGroup>
>::_M_realloc_insert<>(__gnu_cxx::__normal_iterator<parquet::format::RowGroup*,
std::vector<parquet::format::RowGroup,
std::allocator<parquet::format::RowGroup> > >)
| | | ->16.25% (524,887,216B) 0x80CC3B3:
parquet::FileMetaDataBuilder::AppendRowGroup()
| | | ->16.25% (524,887,216B) 0x80BF59C:
parquet::FileSerializer::AppendRowGroup(bool)
| | | ->16.24% (524,797,056B) 0x7FEC1A7:
parquet::arrow::FileWriterImpl::WriteTable(arrow::Table const&, long)
| | | | ->16.24% (524,797,056B) 0x46F829F:
Namespace::ParquetFileWriter::writeBatch(arrow::RecordBatch const&)
(ArrowWriter.cpp:269)
<----------------------------snip----------------------------------->
| | | | ->00.00% (0B) in 1+ places, all below ms_print's
threshold (01.00%)
| | | |
| | | ->00.00% (90,160B) in 1+ places, all below ms_print's threshold
(01.00%)
| | |
| | ->00.00% (19,600B) in 1+ places, all below ms_print's threshold (01.00%)
| |
| ->00.00% (0B) in 1+ places, all below ms_print's threshold (01.00%)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
