[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847399#comment-16847399
]
Antoine Pitrou commented on ARROW-5410:
---------------------------------------
Also, how is the file object created? Do you instantiate a {{FileOutputStream}}
yourself? Something else? Do you close it at some point?
> Crash at arrow::internal::FileWrite
> -----------------------------------
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
> Reporter: Tham
> Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 0000001e`10efd840 00007ffc`0333d53f : 00000000`00000000 0000001e`10efe230
> 00000000`00000033 00007ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 0000001e`10efe170 00007ffc`0333d559 : 00000000`ffffff02 00007ffc`032da63d
> 00000000`00000033 00000000`00000033 : ucrtbase!invalid_parameter+0x13f
> 0000001e`10efe1b0 00007ffc`03318664 : 00007ff7`7f7c8489 00000000`ffffff02
> 0000001e`10efe230 00000000`00000033 : ucrtbase!invalid_parameter_noinfo+0x9
> 0000001e`10efe1f0 00007ffc`032d926d : 00000000`ffffffff 00000000`00000140
> 00000000`00000005 00000122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 0000001e`10efe250 00007ff7`7f66585e : 00000010`00000005 00000000`00000000
> 0000001e`10efe560 00000122`b2337b88 : ucrtbase!write+0x8d
> 0000001e`10efe2a0 00007ff7`7f632785 : 00007ff7`00000000 00007ff7`7f7bb153
> 00000122`bbe890e0 0000001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 0000001e`10efe360 00007ff7`7f632442 : 00000000`0000348a 00000000`00000004
> 0000733f`5e86f38c 00000122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 0000001e`10efe510 00007ff7`7f71c1b9 : 0000001e`10efe738 00007ff7`7f665522
> 00000122`bbffe6e0 00000000`ffffffff :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 0000001e`10efe540 00007ff7`7f79cb2f : 00000122`bbe61e30 00000122`bbffe6e0
> 00000000`00000013 0000001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 0000001e`10efe6e0 00007ff7`7f7abbaf : 00007ff7`7fd75b78 00007ff7`7fd75b78
> 0000001e`10efe9c0 00000000`00000000 :
> CortexSync!parquet::ThriftSerializer::Serialize<parquet::format::PageHeader>+0x11f
> 0000001e`10efe8c0 00007ff7`7f7aaf93 : 00000000`00000000 00000122`bbe3f450
> 00000000`00000002 00000122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 0000001e`10efee20 00007ff7`7f7a3707 : 00000122`bbe3f450 0000001e`10eff250
> 00000000`00000000 00000122`b1680000 :
> CortexSync!parquet::TypedColumnWriterImpl<parquet::DataType<5>
> >::WriteDictionaryPage+0x143
> 0000001e`10efeed0 00007ff7`7f710480 : 0000001e`10eff1c0 00000000`00000000
> 00000122`bbe3f540 00000122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 0000001e`10efef60 00007ff7`7f7154da : 00000122`bbec3cd0 0000001e`10eff1c0
> 00000122`bbec4bb0 00000122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 0000001e`10efefa0 00007ff7`7f71619c : 00000000`00000000 0000001e`10eff1c0
> 00000122`bbe89390 00000000`00000000 :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 0000001e`10eff150 00007ff7`7f202de9 : 00000000`00000001 0000001e`10eff430
> 00000000`0000000f 00000000`00000000 :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 0000001e`10eff410 00007ff7`7f18baf3 : 00000122`bbec39b0 00000122`b24c53f8
> 00000000`3f800000 00000000`00000000 :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
