[ https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Antoine Pitrou updated ARROW-5410: ---------------------------------- Component/s: C++ > [C++] Crash at arrow::internal::FileWrite > ----------------------------------------- > > Key: ARROW-5410 > URL: https://issues.apache.org/jira/browse/ARROW-5410 > Project: Apache Arrow > Issue Type: Bug > Components: C++ > Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616) > Reporter: Tham > Priority: Major > Labels: parquet > > My applicationĀ is writing a bunch of parquet files and it often crashes. Most > of the time it crashes when writing the first file, sometimes it can write > the first file and crashing at the 2nd file. The file can always be opened. > It only crashes at writeTable. > As I tested, my application crashes when build with release mode, but don't > crash with debug mode. It crashed only on one Windows machine, not others. > Here is stack trace from dump file: > {code:java} > STACK_TEXT: > 0000001e`10efd840 00007ffc`0333d53f : 00000000`00000000 0000001e`10efe230 > 00000000`00000033 00007ffc`032dbe21 : > CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0 > 0000001e`10efe170 00007ffc`0333d559 : 00000000`ffffff02 00007ffc`032da63d > 00000000`00000033 00000000`00000033 : ucrtbase!invalid_parameter+0x13f > 0000001e`10efe1b0 00007ffc`03318664 : 00007ff7`7f7c8489 00000000`ffffff02 > 0000001e`10efe230 00000000`00000033 : ucrtbase!invalid_parameter_noinfo+0x9 > 0000001e`10efe1f0 00007ffc`032d926d : 00000000`ffffffff 00000000`00000140 > 00000000`00000005 00000122`bbe61e30 : > ucrtbase!_acrt_uninitialize_command_line+0x6fd4 > 0000001e`10efe250 00007ff7`7f66585e : 00000010`00000005 00000000`00000000 > 0000001e`10efe560 00000122`b2337b88 : ucrtbase!write+0x8d > 0000001e`10efe2a0 00007ff7`7f632785 : 00007ff7`00000000 00007ff7`7f7bb153 > 00000122`bbe890e0 0000001e`10efe634 : > CortexSync!arrow::internal::FileWrite+0x5e > 0000001e`10efe360 00007ff7`7f632442 : 00000000`0000348a 00000000`00000004 > 0000733f`5e86f38c 00000122`bbe14c40 : > CortexSync!arrow::io::OSFile::Write+0x1d5 > 0000001e`10efe510 00007ff7`7f71c1b9 : 0000001e`10efe738 00007ff7`7f665522 > 00000122`bbffe6e0 00000000`ffffffff : > CortexSync!arrow::io::FileOutputStream::Write+0x12 > 0000001e`10efe540 00007ff7`7f79cb2f : 00000122`bbe61e30 00000122`bbffe6e0 > 00000000`00000013 0000001e`10efe730 : > CortexSync!parquet::ArrowOutputStream::Write+0x39 > 0000001e`10efe6e0 00007ff7`7f7abbaf : 00007ff7`7fd75b78 00007ff7`7fd75b78 > 0000001e`10efe9c0 00000000`00000000 : > CortexSync!parquet::ThriftSerializer::Serialize<parquet::format::PageHeader>+0x11f > 0000001e`10efe8c0 00007ff7`7f7aaf93 : 00000000`00000000 00000122`bbe3f450 > 00000000`00000002 00000122`bc0218d0 : > CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f > 0000001e`10efee20 00007ff7`7f7a3707 : 00000122`bbe3f450 0000001e`10eff250 > 00000000`00000000 00000122`b1680000 : > CortexSync!parquet::TypedColumnWriterImpl<parquet::DataType<5> > >::WriteDictionaryPage+0x143 > 0000001e`10efeed0 00007ff7`7f710480 : 0000001e`10eff1c0 00000000`00000000 > 00000122`bbe3f540 00000122`b2439998 : > CortexSync!parquet::ColumnWriterImpl::Close+0x47 > 0000001e`10efef60 00007ff7`7f7154da : 00000122`bbec3cd0 0000001e`10eff1c0 > 00000122`bbec4bb0 00000122`b2439998 : > CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting > destructor'+0x100 > 0000001e`10efefa0 00007ff7`7f71619c : 00000000`00000000 0000001e`10eff1c0 > 00000122`bbe89390 00000000`00000000 : > CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa > 0000001e`10eff150 00007ff7`7f202de9 : 00000000`00000001 0000001e`10eff430 > 00000000`0000000f 00000000`00000000 : > CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc > 0000001e`10eff410 00007ff7`7f18baf3 : 00000122`bbec39b0 00000122`b24c53f8 > 00000000`3f800000 00000000`00000000 : > CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code} > I tried a lot of ways to find out the root cause, but failed. Can anyone here > give me some information/advice please, so that I can investigate more? > Thanks! -- This message was sent by Atlassian JIRA (v7.6.3#76005)