[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031272#comment-17031272
]
Tham commented on ARROW-5381:
-
> So you confirm that the machine that had this issue doesn't support POPCNT?
[~apitrou] Yes, absolutely.
> Did you encounter many such cases?
Like 12 machines until I fixed this issue using .
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Assignee: Wes McKinney
>Priority: Major
> Labels: pull-request-available
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
>
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030400#comment-17030400
]
Tham commented on ARROW-5381:
-
I have used CpuInfo::IsSupported(POPCNT) to see if this computer supports
POPCNT, then use to count bit. What is your idea about this approach?
I'll try your suggestion as well.
(Sorry that I don't receive any notification about your comment, so I have to
check it by opening this page directly and sometimes reply late).
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Assignee: Wes McKinney
>Priority: Major
> Labels: pull-request-available
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
>
[jira] [Comment Edited] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893307#comment-16893307
]
Tham edited comment on ARROW-5381 at 7/26/19 4:13 AM:
--
[~wesmckinn] I agree that if the machine is too old that we may not need to
support.
I will check again to confirm if POPCNT is supported on the machine running
Windows 7 that I received crash report.
> You may have to submit some patches to provide compatibility for very old
> processors if you need to support these machines.
In case we want to support, I'm not sure how to do it. Can you share any guide
or suggestion? I'll try to implement.
Update: I found this discussion
[http://www.cplusplus.com/forum/general/185927/]. Using may be a
candidate?
was (Author: thamha):
[~wesmckinn] I agree that if the machine is too old that we may not need to
support.
I will check again to confirm if POPCNT is supported on the machine running
Windows 7 that I received crash report.
> You may have to submit some patches to provide compatibility for very old
> processors if you need to support these machines.
In case we want to support, I'm not sure how to do it. Can you share any guide
or suggestion? I'll try to implement.
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 :
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893307#comment-16893307
]
Tham commented on ARROW-5381:
-
[~wesmckinn] I agree that if the machine is too old that we may not need to
support.
I will check again to confirm if POPCNT is supported on the machine running
Windows 7 that I received crash report.
> You may have to submit some patches to provide compatibility for very old
> processors if you need to support these machines.
In case we want to support, I'm not sure how to do it. Can you share any guide
or suggestion? I'll try to implement.
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
>
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892619#comment-16892619
]
Tham commented on ARROW-5381:
-
After checking with Customer Support team, I found a mistake that we've got
coreinfo from wrong customer. We haven't been able to contact the customer that
has this issue on Windows 7 yet. So please ignore the images I sent until I can
find more information. Sorry!
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
>
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892587#comment-16892587
]
Tham commented on ARROW-5381:
-
> Could you try this patch on Windows?
Ok, let me contact our customer. This will take time again :(
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
>
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892550#comment-16892550
]
Tham commented on ARROW-5381:
-
Or at least, we can try/catch then arrow won't crash but return an error?
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d
[jira] [Comment Edited] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892526#comment-16892526
]
Tham edited comment on ARROW-5381 at 7/25/19 8:27 AM:
--
on the MacOS, I run this command:
{code:java}
$ sysctl -n machdep.cpu.features
FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH
DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 DTES64 MON DSCPL VMX EST TM2 SSSE3
CX16 TPR PDCM SSE4.1 XSAVE
{code}
We don't see POPCNT, then it seems that this machine doesn't support POPCNT
instruction :( Is there any way to avoid this situation?
!iMac-late2009.png!
was (Author: thamha):
on the MacOS, I run this command:
{code:java}
$ sysctl -n machdep.cpu.features
FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH
DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 DTES64 MON DSCPL VMX EST TM2 SSSE3
CX16 TPR PDCM SSE4.1 XSAVE
{code}
We don't see POPCNT, then it seems that this machine doesn't support POPCNT
instruction :( Is there any way to avoid this situation?
[^iMac-late2009]
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
>
[jira] [Updated] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-5381:
Attachment: iMac-late2009.png
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FAULTING_SOURCE_LINE:
>
[jira] [Updated] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-5381:
Attachment: (was: iMac-late2009)
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009.png, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FAULTING_SOURCE_LINE:
>
[jira] [Comment Edited] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892526#comment-16892526
]
Tham edited comment on ARROW-5381 at 7/25/19 8:26 AM:
--
on the MacOS, I run this command:
{code:java}
$ sysctl -n machdep.cpu.features
FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH
DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 DTES64 MON DSCPL VMX EST TM2 SSSE3
CX16 TPR PDCM SSE4.1 XSAVE
{code}
We don't see POPCNT, then it seems that this machine doesn't support POPCNT
instruction :( Is there any way to avoid this situation?
[^iMac-late2009]
was (Author: thamha):
on the MacOS, I run this command:
{code:java}
$ sysctl -n machdep.cpu.features
FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH
DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 DTES64 MON DSCPL VMX EST TM2 SSSE3
CX16 TPR PDCM SSE4.1 XSAVE
{code}
We don't see POPCNT, then it seems that this machine doesn't support POPCNT
instruction :( Is there any way to avoid this situation?
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 :
[jira] [Updated] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-5381:
Attachment: iMac-late2009
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, iMac-late2009, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FAULTING_SOURCE_LINE:
>
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892526#comment-16892526
]
Tham commented on ARROW-5381:
-
on the MacOS, I run this command:
{code:java}
$ sysctl -n machdep.cpu.features
FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH
DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 DTES64 MON DSCPL VMX EST TM2 SSSE3
CX16 TPR PDCM SSE4.1 XSAVE
{code}
We don't see POPCNT, then it seems that this machine doesn't support POPCNT
instruction :( Is there any way to avoid this situation?
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
>
[jira] [Closed] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham closed ARROW-5700.
---
Resolution: Fixed
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Commented] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892502#comment-16892502
]
Tham commented on ARROW-5700:
-
This issue has the same root cause as ARROW-5410 (`oflag` has unexpected value
because of optimization) then we can close this ticket as well.
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892489#comment-16892489
]
Tham commented on ARROW-5381:
-
[^bit-util.asm] is assembly for bit-util.cc on Windows. Can you take a look?
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt
[jira] [Updated] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-5381:
Attachment: bit-util.asm
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: bit-util.asm, popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FAULTING_SOURCE_LINE:
>
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892454#comment-16892454
]
Tham commented on ARROW-5381:
-
> I don't think Windows 7 is an issue
Yes, you're right. I set up a Windows 7 and I don't meet this issue. We've just
got a customer who got this issue on MacOS as well.
> By the way do all your users use the same binary? Is it possible for you to
> disassemble the CountSetBits function?
Ok. Attach it in a while.
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879051#comment-16879051
]
Tham commented on ARROW-5410:
-
[~pitrou] after disable optimization on arrow build, I don't meet this issue
anymore. It seems there is something wrong with optimizer. I'll tell you if I
can sure about that.
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876852#comment-16876852
]
Tham commented on ARROW-5410:
-
Ok. I will.
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876847#comment-16876847
]
Tham commented on ARROW-5410:
-
Yes, I think it's highly something with our project build. Thanks so much for
your support.
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876841#comment-16876841
]
Tham commented on ARROW-5410:
-
> can you try passing {{-DARROW_USE_STATIC_CRT=on}} when building the Arrow and
>Parquet static libraries?
I've tried this.
-DARROW_USE_STATIC_CRT=on, it always crash.
-DARROW_USE_STATIC_CRT=off, it crashes on some Windows version.
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876837#comment-16876837
]
Tham commented on ARROW-5410:
-
> That's weird. Are you using the same compiler version for Arrow and your Qt
>project?
Yes, they are the same. I've checked compiling log, the same cl.exe at path:
C:/Program Files (x86)/Microsoft Visual
Studio/2017/BuildTools/VC/Tools/MSVC/14.13.26128/bin/HostX64/x64/cl.exe.
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876818#comment-16876818
]
Tham commented on ARROW-5410:
-
> Is it easy for you to try using Arrow shared libraries and see what happens?
I've still got the same error. Any idea?
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876791#comment-16876791
]
Tham commented on ARROW-5410:
-
> Is it easy for you to try using Arrow shared libraries and see what happens?
Ok, let me try.
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876783#comment-16876783
]
Tham commented on ARROW-5410:
-
Sure. [^io-util-no-printf.asm] here it is.
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-5410:
Attachment: io-util-no-printf.asm
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util-no-printf.asm,
> io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876696#comment-16876696
]
Tham commented on ARROW-5410:
-
[~pitrou] I uploaded 2 assembly files:
[^io-util.asm] is the one I get the issue with oflag.
I don't understand why "shl" is here:
{code:java}
mov eax, ebx
shl eax, 9
add eax, 33152 ; 8180H
mov ebx, eax
{code}
[^io-util-add-more-log.asm]is the one I added more logs, which I didn't get
issue with oflag.
Since I'm not familiar with assembly language, can you help?
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-5410:
Attachment: io-util.asm
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm, io-util.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-5410:
Attachment: io-util-add-more-log.asm
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
> Attachments: io-util-add-more-log.asm
>
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-4821) [C++] compiling issue on Windows
[
https://issues.apache.org/jira/browse/ARROW-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876691#comment-16876691
]
Tham commented on ARROW-4821:
-
[~pitrou] we don't get this issue anymore. We fixed it by using forward
declaration and let arrow header files be private in .cc file.
> [C++] compiling issue on Windows
> -
>
> Key: ARROW-4821
> URL: https://issues.apache.org/jira/browse/ARROW-4821
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows 10 x64
>Reporter: Tham
>Priority: Major
>
> I'm using arrow/cpp into my cpp project and got this compiling issue. I'm not
> sure where this issue comes from. I don't have it on MacOS. Can anyone help
> to point out the problem?
> {code:java}
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> warning C4003: not enough actual parameters for macro 'min'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2144: syntax error: 'unknown-type' should be preceded by '('
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2143: syntax error: missing ';' before '{'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(459):
> error C2181: illegal else without matching if
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(462):
> warning C4003: not enough actual parameters for macro 'min'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> error C2062: type 'unknown-type' unexpected
>
[jira] [Closed] (ARROW-4821) [C++] compiling issue on Windows
[
https://issues.apache.org/jira/browse/ARROW-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham closed ARROW-4821.
---
Resolution: Won't Fix
> [C++] compiling issue on Windows
> -
>
> Key: ARROW-4821
> URL: https://issues.apache.org/jira/browse/ARROW-4821
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows 10 x64
>Reporter: Tham
>Priority: Major
>
> I'm using arrow/cpp into my cpp project and got this compiling issue. I'm not
> sure where this issue comes from. I don't have it on MacOS. Can anyone help
> to point out the problem?
> {code:java}
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> warning C4003: not enough actual parameters for macro 'min'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2144: syntax error: 'unknown-type' should be preceded by '('
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2143: syntax error: missing ';' before '{'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(459):
> error C2181: illegal else without matching if
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(462):
> warning C4003: not enough actual parameters for macro 'min'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> error C2144: syntax error: 'unknown-type' should be preceded by '('
>
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876625#comment-16876625
]
Tham commented on ARROW-5410:
-
> Do you use a "normal" toolchain for compiling? i.e. Visual Studio? Or do you
> use custom proprietary tools or libraries?
I use visual studio 2017 c++ build tools to build arrow, parquet libraries.
Then I link these static libraries from my qt project.
> You could try to disassemble the {{FileOpenWritable}} function.
Let me try, I didn't disassemble a function before.
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876085#comment-16876085
]
Tham commented on ARROW-5410:
-
[~pitrou] Maybe the problem come earlier when opening file, not when writing
table data into file. As I add a log before _wsopen_s:
{code:java}
std::cout << "before _wsopen_s() --> oflag:" << oflag << std::endl;
errno_actual = _wsopen_s(fd, file_name.ToNative().c_str(), oflag, _SH_DENYNO,
pmode);{code}
The output of oflag is not the same (I'm sure that I have the same config on my
code):
{code:java}
before _wsopen_s() --> oflag:99209
before _wsopen_s() --> oflag:103305
before _wsopen_s() --> oflag:107401
before _wsopen_s() --> oflag:111497
before _wsopen_s() --> oflag:115593
before _wsopen_s() --> oflag:119689
...
before _wsopen_s() --> oflag:131977 --> write into file will crash after that
{code}
There numbers have step of 4096???
I wanted to know which steps make oflag is like this, then I added more logs,
then oflag is always the same and is exactly below:
{code:java}
after truncate --> oflag:33664
after append --> oflag:33672
after write_only --> oflag:33673
before _wsopen_s() --> oflag:33673
{code}
It seems add more logs affects to results. I has still been investigating, but
do you have any idea why?
> [C++] Crash at arrow::internal::FileWrite
> -
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
>
[jira] [Comment Edited] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874773#comment-16874773
]
Tham edited comment on ARROW-5700 at 6/28/19 8:38 AM:
--
> Can you double-check by calling SetLastError(0) before _wsopen_s?
SetLastError(0) has been set before _wsopen_s():
{code:java}
GetLastError() before _wsopen_s():0
_wsopen_s: fd:01F5DA662558 (*fd):-1
file_name.ToNative().c_str():01F5DA58E4B0 oflag:163721 pmode:384
errno_actual:9
GetLastError():80{code}
There is no file before I run application. The file had been created before
application crashed. It's a empty file.
was (Author: thamha):
> Can you double-check by calling SetLastError(0) before _wsopen_s?
SetLastError(0) has been set before _wsopen_s():
{code:java}
GetLastError() before _wsopen_s():0
_wsopen_s: fd:01F5DA662558 (*fd):-1
file_name.ToNative().c_str():01F5DA58E4B0 oflag:163721 pmode:384
errno_actual:9
GetLastError():80{code}
The file had been created before application crashed. It's a empty file.
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874773#comment-16874773
]
Tham edited comment on ARROW-5700 at 6/28/19 8:35 AM:
--
> Can you double-check by calling SetLastError(0) before _wsopen_s?
SetLastError(0) has been set before _wsopen_s():
{code:java}
GetLastError() before _wsopen_s():0
_wsopen_s: fd:01F5DA662558 (*fd):-1
file_name.ToNative().c_str():01F5DA58E4B0 oflag:163721 pmode:384
errno_actual:9
GetLastError():80{code}
The file has been created before application crashed. It's a empty file.
was (Author: thamha):
> Can you double-check by calling SetLastError(0) before _wsopen_s?
SetLastError(0) has been set before _wsopen_s():
{code:java}
GetLastError() before _wsopen_s():0
_wsopen_s: fd:01F5DA662558 (*fd):-1
file_name.ToNative().c_str():01F5DA58E4B0 oflag:163721 pmode:384
errno_actual:9
GetLastError():80{code}
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874773#comment-16874773
]
Tham edited comment on ARROW-5700 at 6/28/19 8:35 AM:
--
> Can you double-check by calling SetLastError(0) before _wsopen_s?
SetLastError(0) has been set before _wsopen_s():
{code:java}
GetLastError() before _wsopen_s():0
_wsopen_s: fd:01F5DA662558 (*fd):-1
file_name.ToNative().c_str():01F5DA58E4B0 oflag:163721 pmode:384
errno_actual:9
GetLastError():80{code}
The file had been created before application crashed. It's a empty file.
was (Author: thamha):
> Can you double-check by calling SetLastError(0) before _wsopen_s?
SetLastError(0) has been set before _wsopen_s():
{code:java}
GetLastError() before _wsopen_s():0
_wsopen_s: fd:01F5DA662558 (*fd):-1
file_name.ToNative().c_str():01F5DA58E4B0 oflag:163721 pmode:384
errno_actual:9
GetLastError():80{code}
The file has been created before application crashed. It's a empty file.
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874773#comment-16874773
]
Tham commented on ARROW-5700:
-
> Can you double-check by calling SetLastError(0) before _wsopen_s?
SetLastError(0) has been set before _wsopen_s():
{code:java}
GetLastError() before _wsopen_s():0
_wsopen_s: fd:01F5DA662558 (*fd):-1
file_name.ToNative().c_str():01F5DA58E4B0 oflag:163721 pmode:384
errno_actual:9
GetLastError():80{code}
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874697#comment-16874697
]
Tham commented on ARROW-5700:
-
Otherwise, I've tried to build arrow with
|ARROW_USE_STATIC_CRT_OPTION=ON|
This issue happened on all Windows platforms. I think that there might be some
problem with our build config and Windows Kits. Can you please give any hint?
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874694#comment-16874694
]
Tham commented on ARROW-5700:
-
> Have you checked the value of {{file_name.ToNative().c_str()}} ?
> Another question still: what does {{GetLastError()}} return?
{code:java}
_wsopen_s: fd:01ADAF819D88 (*fd):-1
file_name.ToNative().c_str():01ADA8E7A100 oflag:163721
pmode:384errno_actual:9
GetLastError():80
{code}
> what happens if you replace {{_wsopen_s}} with the less secure {{_wsopen}} ?
Same result.
{code:java}
_wsopen: fd:01DF24EA9DD8 (*fd):-1
file_name.ToNative().c_str():01DF24D911B0 oflag:163721
pmode:384errno_actual:9
GetLastError():80
{code}
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873826#comment-16873826
]
Tham edited comment on ARROW-5700 at 6/27/19 6:43 AM:
--
[~pitrou] I can reproduce this issue on this Windows version.
> Does it happen with any output file?
Yes, I'm sure now it happens with any output file on this Windows.
Here is the output after _wsopen_s() is called.
{code:java}
_wsopen_s: fd:024308936AE8 (*fd): -1 oflag:163721 pmode:384 errno_actual:9
{code}
Can you take a look?
was (Author: thamha):
[~pitrou] I can reproduce this issue on this Windows version.
Here is the output after _wsopen_s() is called.
{code:java}
_wsopen_s: fd:024308936AE8 (*fd): -1 oflag:163721 pmode:384 errno_actual:9
{code}
Can you take a look?
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873826#comment-16873826
]
Tham edited comment on ARROW-5700 at 6/27/19 5:47 AM:
--
[~pitrou] I can reproduce this issue on this Windows version.
Here is the output after _wsopen_s() is called.
{code:java}
_wsopen_s: fd:024308936AE8 (*fd): -1 oflag:163721 pmode:384 errno_actual:9
{code}
Can you take a look?
was (Author: thamha):
[~pitrou] I can reproduce this issue on this Windows version.
Here is the output after _wsopen_s() is called.
{code:java}
_wsopen_s: oflag:163721 pmode:384 errno_actual:9
{code}
Can you take a look?
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873826#comment-16873826
]
Tham commented on ARROW-5700:
-
[~pitrou] I can reproduce this issue on this Windows version.
Here is the output after _wsopen_s() is called.
{code:java}
_wsopen_s: oflag:163721 pmode:384 errno_actual:9
{code}
Can you take a look?
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873212#comment-16873212
]
Tham commented on ARROW-5381:
-
Our application is a Windows service, running with admin permission. Mostly
users don't work directly with our service, but some GUI application that
connects with our service. We got this issue only on Windows 7.
I think it's better to have this issue reproduced and can be debugged, but our
resource is limited for Windows 7. If you find out something, please let know.
I'll try to reproduce it as soon as possible :)
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
>
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873181#comment-16873181
]
Tham commented on ARROW-5381:
-
[~pitrou] Finally I can get core info from this customer. It seems his machine
support POPCNT.
!popcnt_support.png!
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
>
[jira] [Updated] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-5381:
Attachment: popcnt_support.png
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
> Attachments: popcnt_support.png
>
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FAULTING_SOURCE_LINE:
>
[jira] [Commented] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872194#comment-16872194
]
Tham commented on ARROW-5700:
-
bq. I took a look at the CRT source code, and it's mysterious how EBADF
"Invalid file descriptor" could be returned by [_wsopen_s]
Is there any chances that open() is called instead of _wsopen_s(), meaning
_WIN32 is not defined?
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872189#comment-16872189
]
Tham commented on ARROW-5700:
-
{quote}Does it happen with any output file?
{quote}
I'm not sure. We receive this crash from customer. After this issue makes our
application crashed, every time our application is started again, it fails
immediately with another message (on same file):
{code:java}
Failed to open local file: , error: File exists{code}
So we don't know if it fails with another files.
I will try to install some Windows version (or at least this Windows version)
on our office and try to debug as you suggested.
{quote}(you could also try to upgrade to a more recent version, as I think the
code changed slightly){quote}
I will try with current version first, then upgrade later to see if this issue
remains.
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
[
https://issues.apache.org/jira/browse/ARROW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871962#comment-16871962
]
Tham commented on ARROW-5700:
-
[~pitrou] Yes, I build arrow from source myself at this commit:
[https://github.com/apache/arrow/commit/3eb07b7ed173e2ecf41d689b0780dd103df63a00]
> [C++] Failed to open local file: Bad file descriptor
>
>
> Key: ARROW-5700
> URL: https://issues.apache.org/jira/browse/ARROW-5700
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
>Reporter: Tham
>Priority: Major
>
> I open an output stream to write a parquet file. Here is the code:
> {code:java}
> std::shared_ptr outStream;
> arrow::Status err;
> err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
> );
> if (err.code() != arrow::StatusCode::OK) {
> std::cout << err.message() << std::endl;
> }
> {code}
> Here is the error message I got:
> {code:java}
> Failed to open local file: , error: Bad file
> descriptor"
> {code}
> I've got this error only when running on Windows version 10.0.10586.1106
> (th2_release.170904-1742).
> Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5381) [C++] Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870795#comment-16870795
]
Tham commented on ARROW-5381:
-
Sorry for the late reply. I haven't got answer from my customer. Let me try
again.
> [C++] Crash at arrow::internal::CountSetBits
>
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FAULTING_SOURCE_LINE:
>
[jira] [Created] (ARROW-5700) [C++] Failed to open local file: Bad file descriptor
Tham created ARROW-5700:
---
Summary: [C++] Failed to open local file: Bad file descriptor
Key: ARROW-5700
URL: https://issues.apache.org/jira/browse/ARROW-5700
Project: Apache Arrow
Issue Type: Bug
Components: C++
Environment: Windows version 10.0.10586.1106 (th2_release.170904-1742)
Reporter: Tham
I open an output stream to write a parquet file. Here is the code:
{code:java}
std::shared_ptr outStream;
arrow::Status err;
err = arrow::io::FileOutputStream::Open(filePath.toStdString(), false,
);
if (err.code() != arrow::StatusCode::OK) {
std::cout << err.message() << std::endl;
}
{code}
Here is the error message I got:
{code:java}
Failed to open local file: , error: Bad file descriptor"
{code}
I've got this error only when running on Windows version 10.0.10586.1106
(th2_release.170904-1742).
Any idea?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847480#comment-16847480
]
Tham commented on ARROW-5410:
-
I have tried just before your comment, but unfortunately the standalone
reproducer doesn't crash :(
> Crash at arrow::internal::FileWrite
> ---
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847451#comment-16847451
]
Tham commented on ARROW-5410:
-
I just get a crash from customer machine (same windows version as mine), but
the stack trace is a little bit different:
{code:java}
STACK_TEXT:
0048`978fd660 7ffe`6f35d5df : ` 0048`978fe050
`0033 7ffe`6f2fa971 :
CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
0048`978fdf90 7ffe`6f35d5f9 : `ff02 7ffe`6f2f874d
`0033 `0033 : ucrtbase!invalid_parameter+0x13f
0048`978fdfd0 7ffe`6f3378fc : 7ff7`1838ca59 `ff02
0048`978fe050 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
0048`978fe010 7ffe`6f2f78dd : ` `0100
`0004 0206`853e8310 : ucrtbase!_write_nolock+0x3ffd8
0048`978fe070 7ff7`18261b7e : 0010`0004 `
0048`978fe380 0206`85110558 : ucrtbase!_write+0x8d
0048`978fe0c0 7ff7`181bd695 : 7ff7` 7ff7`1837f723
0206`885d2870 0048`978fe454 : CortexSync!arrow::internal::FileWrite+0x5e
0048`978fe180 7ff7`181bd352 : `a536 `0004
1a6e`d8f76f44 0206`84ef7fc0 : CortexSync!arrow::io::OSFile::Write+0x1d5
0048`978fe330 7ff7`180eec09 : 0048`978fe558 7ff7`18261842
0206`85164850 ` :
CortexSync!arrow::io::FileOutputStream::Write+0x12
0048`978fe360 7ff7`1816f58f : 0206`853e8310 0206`85164850
`0013 0048`978fe550 :
CortexSync!parquet::ArrowOutputStream::Write+0x39
0048`978fe500 7ff7`1817e60f : 7ff7`18831388 7ff7`18831388
0048`978fe7e0 ` :
CortexSync!parquet::ThriftSerializer::Serialize+0x11f
0048`978fe6e0 7ff7`1817d9f3 : ` 0206`850e6410
`0002 0206`8864c380 :
CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
0048`978fec40 7ff7`18176167 : 0206`850e6410 0048`978ff070
` `0008 :
CortexSync!parquet::TypedColumnWriterImpl
>::WriteDictionaryPage+0x143
0048`978fecf0 7ff7`180e2e10 : 0048`978fefe0 `
0206`850e6500 0206`850fad48 :
CortexSync!parquet::ColumnWriterImpl::Close+0x47
0048`978fed80 7ff7`180e7e6a : 0206`8516ad50 0048`978fefe0
0206`885caf00 0206`850fad48 : CortexSync!arrow::Schema::`vector
deleting destructor'+0xd0
0048`978fedc0 7ff7`180e8b2c : ` 0048`978fefe0
0206`885d2fa0 ` :
CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
0048`978fef70 7ff7`17cc2689 : `0001 0048`978ff250
`000f ` :
CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
0048`978ff230 7ff7`17c4b523 : 0206`8510b670 `
0206`3f80 ` :
CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49
{code}
> Crash at arrow::internal::FileWrite
> ---
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0
[jira] [Commented] (ARROW-5410) Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847446#comment-16847446
]
Tham commented on ARROW-5410:
-
I can assure. I run open() -> write data -> close() in one function
synchronously. So we can eliminate that case.
> Crash at arrow::internal::FileWrite
> ---
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847427#comment-16847427
]
Tham commented on ARROW-5410:
-
Updated:
{code:java}
buffer: 017770FAA7A0
before while: nbytes: 51
in while: nbytes: 51 chunksize: 51 bytes_written: 0
Invalid parameter detected in function (null). File: (null) Line: 0
Expression: (null){code}
> Crash at arrow::internal::FileWrite
> ---
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847419#comment-16847419
]
Tham commented on ARROW-5410:
-
Sorry I cannot share all the code. Here is the code I used to create file
object:
{code:java}
std::shared_ptr outStream;
arrow::Status err = arrow::io::FileOutputStream::Open(filePath, false,
); // returns OK{code}
> Crash at arrow::internal::FileWrite
> ---
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847416#comment-16847416
]
Tham commented on ARROW-5410:
-
Uhm, I try to run my application as normal app. here is the result:
{code:java}
before while: nbytes: 51
in while: nbytes: 51 chunksize: 51 bytes_written: 0
Invalid parameter detected in function (null). File: (null) Line: 0
Expression: (null)
{code}
I also added DCHECK(buffer != nullptr) and it passes.
> Crash at arrow::internal::FileWrite
> ---
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5410) Crash at arrow::internal::FileWrite
[
https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847394#comment-16847394
]
Tham commented on ARROW-5410:
-
My application running as Windows service, I cannot output to console to see. I
see arrow use glog but I still don't have time to figure out how to use it in
arrow :( I will try to log it and see. Any suggestion?
> Crash at arrow::internal::FileWrite
> ---
>
> Key: ARROW-5410
> URL: https://issues.apache.org/jira/browse/ARROW-5410
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>Reporter: Tham
>Priority: Major
> Labels: parquet
>
> My application is writing a bunch of parquet files and it often crashes. Most
> of the time it crashes when writing the first file, sometimes it can write
> the first file and crashing at the 2nd file. The file can always be opened.
> It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't
> crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:
> 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
> `0033 7ffc`032dbe21 :
> CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
> `0033 `0033 : ucrtbase!invalid_parameter+0x13f
> 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
> 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
> 001e`10efe1f0 7ffc`032d926d : ` `0140
> `0005 0122`bbe61e30 :
> ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 001e`10efe250 7ff7`7f66585e : 0010`0005 `
> 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
> 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
> 0122`bbe890e0 001e`10efe634 :
> CortexSync!arrow::internal::FileWrite+0x5e
> 001e`10efe360 7ff7`7f632442 : `348a `0004
> 733f`5e86f38c 0122`bbe14c40 :
> CortexSync!arrow::io::OSFile::Write+0x1d5
> 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
> 0122`bbffe6e0 ` :
> CortexSync!arrow::io::FileOutputStream::Write+0x12
> 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
> `0013 001e`10efe730 :
> CortexSync!parquet::ArrowOutputStream::Write+0x39
> 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
> 001e`10efe9c0 ` :
> CortexSync!parquet::ThriftSerializer::Serialize+0x11f
> 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
> `0002 0122`bc0218d0 :
> CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
> ` 0122`b168 :
> CortexSync!parquet::TypedColumnWriterImpl
> >::WriteDictionaryPage+0x143
> 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
> 0122`bbe3f540 0122`b2439998 :
> CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
> 0122`bbec4bb0 0122`b2439998 :
> CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting
> destructor'+0x100
> 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
> 0122`bbe89390 ` :
> CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
> `000f ` :
> CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
> `3f80 ` :
> CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here
> give me some information/advice please, so that I can investigate more?
> Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ARROW-5410) Crash at arrow::internal::FileWrite
Tham created ARROW-5410:
---
Summary: Crash at arrow::internal::FileWrite
Key: ARROW-5410
URL: https://issues.apache.org/jira/browse/ARROW-5410
Project: Apache Arrow
Issue Type: Bug
Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
Reporter: Tham
My application is writing a bunch of parquet files and it often crashes. Most
of the time it crashes when writing the first file, sometimes it can write the
first file and crashing at the 2nd file. The file can always be opened. It only
crashes at writeTable.
As I tested, my application crashes when build with release mode, but don't
crash with debug mode. It crashed only on one Windows machine, not others.
Here is stack trace from dump file:
{code:java}
STACK_TEXT:
001e`10efd840 7ffc`0333d53f : ` 001e`10efe230
`0033 7ffc`032dbe21 :
CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d
`0033 `0033 : ucrtbase!invalid_parameter+0x13f
001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02
001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9
001e`10efe1f0 7ffc`032d926d : ` `0140
`0005 0122`bbe61e30 :
ucrtbase!_acrt_uninitialize_command_line+0x6fd4
001e`10efe250 7ff7`7f66585e : 0010`0005 `
001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d
001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153
0122`bbe890e0 001e`10efe634 : CortexSync!arrow::internal::FileWrite+0x5e
001e`10efe360 7ff7`7f632442 : `348a `0004
733f`5e86f38c 0122`bbe14c40 : CortexSync!arrow::io::OSFile::Write+0x1d5
001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522
0122`bbffe6e0 ` :
CortexSync!arrow::io::FileOutputStream::Write+0x12
001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0
`0013 001e`10efe730 :
CortexSync!parquet::ArrowOutputStream::Write+0x39
001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78
001e`10efe9c0 ` :
CortexSync!parquet::ThriftSerializer::Serialize+0x11f
001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450
`0002 0122`bc0218d0 :
CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250
` 0122`b168 :
CortexSync!parquet::TypedColumnWriterImpl
>::WriteDictionaryPage+0x143
001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 `
0122`bbe3f540 0122`b2439998 :
CortexSync!parquet::ColumnWriterImpl::Close+0x47
001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0
0122`bbec4bb0 0122`b2439998 :
CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting destructor'+0x100
001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0
0122`bbe89390 ` :
CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430
`000f ` :
CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8
`3f80 ` :
CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
I tried a lot of ways to find out the root cause, but failed. Can anyone here
give me some information/advice please, so that I can investigate more? Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-5381) Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845741#comment-16845741
]
Tham commented on ARROW-5381:
-
Thanks for quick response. I'll send this to my customer and ask them to run
it. The response will be not as fast as you :)
> Crash at arrow::internal::CountSetBits
> --
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
> 00c9`5354b9e0 00c9`5354b9d8 :
> CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
> 00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
> `fffe ` :
> CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
> {code}
> {code:java}
> FAILED_INSTRUCTION_ADDRESS:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FOLLOWUP_IP:
> CortexService!arrow::internal::CountSetBits+16d
> [c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
> @ 99]
> 7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
> FAULTING_SOURCE_LINE:
>
[jira] [Commented] (ARROW-5381) Crash at arrow::internal::CountSetBits
[
https://issues.apache.org/jira/browse/ARROW-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845673#comment-16845673
]
Tham commented on ARROW-5381:
-
> Are you running this in a VM?
No, it's not a virtual machine.
I've got another machine which has the same crash:
{code:java}
Operating System: Windows 10 Pro 64-bit (10.0, Build 10240)
(10240.th1.170602-2340)
Language: English (Regional Setting: English)
System Manufacturer: HP
System Model: HP Laptop 14-bs0xx
BIOS: F.31
Processor: Intel(R) Celeron(R) CPU N3060 @ 1.60GHz (2 CPUs),
~1.6GHz
Memory: 4096MB RAM
Available OS Memory: 4002MB RAM
Page File: 2189MB used, 2516MB available
Windows Dir: C:\Windows
DirectX Version: 12
DX Setup Parameters: Not found
User DPI Setting: Using System DPI
System DPI Setting: 96 DPI (100 percent)
DWM DPI Scaling: Disabled
Miracast: Available, with HDCP
Microsoft Graphics Hybrid: Not Supported
DxDiag Version: 10.00.10240.16384 64bit Unicode
{code}
Can you please take a look?
> Crash at arrow::internal::CountSetBits
> --
>
> Key: ARROW-5381
> URL: https://issues.apache.org/jira/browse/ARROW-5381
> Project: Apache Arrow
> Issue Type: Bug
> Environment: Operating System: Windows 7 Professional 64-bit (6.1,
> Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
> Language: English (Regional Setting: English)
> System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
> System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
> BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
> Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
> Memory: 2048MB RAM
> Available OS Memory: 1962MB RAM
> Page File: 1517MB used, 2405MB available
> Windows Dir: C:\Windows
> DirectX Version: DirectX 11
>Reporter: Tham
>Priority: Major
>
> I've got a lot of crash dump from a customer's windows machine. The
> stacktrace shows that it crashed at arrow::internal::CountSetBits.
>
> {code:java}
> STACK_TEXT:
> 00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
> `1e00 ` :
> CortexService!arrow::internal::CountSetBits+0x16d
> 00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
> ` ` :
> CortexService!arrow::ArrayData::GetNullCount+0x8d
> 00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
> ` ` :
> CortexService!arrow::Array::null_count+0x37
> 00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::Visit >+0xa5
> 00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
> 00c9`5354ab40 ` :
> CortexService!arrow::VisitArrayInline namespace'::LevelBuilder>+0x298
> 00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
> 00c9`54476080 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::VisitInline+0x44
> 00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
> 00c9`54476080 00c9`5354b208 :
> CortexService!parquet::arrow::`anonymous
> namespace'::LevelBuilder::GenerateLevels+0x93
> 00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
> 00c9`54476080 `1e00 :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x25a
> 00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
> 00c9`54445c20 ` :
> CortexService!parquet::arrow::`anonymous
> namespace'::ArrowColumnWriter::Write+0x2a6
> 00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
> 00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
> 00c9`5354b4a8 ` :
> CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
> 00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
> ` `1e00 :
> CortexService!::operator()+0x195
> 00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
> 00c9`54442fb0 `1e00 :
> CortexService!parquet::arrow::FileWriter::WriteTable+0x521
> 00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
> ` ` :
> CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
> 00c9`5354b860
[jira] [Created] (ARROW-5381) Crash at arrow::internal::CountSetBits
Tham created ARROW-5381:
---
Summary: Crash at arrow::internal::CountSetBits
Key: ARROW-5381
URL: https://issues.apache.org/jira/browse/ARROW-5381
Project: Apache Arrow
Issue Type: Bug
Environment: Operating System: Windows 7 Professional 64-bit (6.1,
Build 7601) Service Pack 1(7601.win7sp1_ldr_escrow.181110-1429)
Language: English (Regional Setting: English)
System Manufacturer: SAMSUNG ELECTRONICS CO., LTD.
System Model: RV420/RV520/RV720/E3530/S3530/E3420/E3520
BIOS: Phoenix SecureCore-Tiano(tm) NB Version 2.1 05PQ
Processor: Intel(R) Pentium(R) CPU B950 @ 2.10GHz (2 CPUs), ~2.1GHz
Memory: 2048MB RAM
Available OS Memory: 1962MB RAM
Page File: 1517MB used, 2405MB available
Windows Dir: C:\Windows
DirectX Version: DirectX 11
Reporter: Tham
I've got a lot of crash dump from a customer's windows machine. The stacktrace
shows that it crashed at arrow::internal::CountSetBits.
{code:java}
STACK_TEXT:
00c9`5354a4c0 7ff7`2f2830fd : 00c9`544841c0 `
`1e00 ` :
CortexService!arrow::internal::CountSetBits+0x16d
00c9`5354a550 7ff7`2f2834b7 : 00c9`5337c930 `
` ` :
CortexService!arrow::ArrayData::GetNullCount+0x8d
00c9`5354a580 7ff7`2f13df55 : 00c9`54476080 00c9`5354a5d8
` ` :
CortexService!arrow::Array::null_count+0x37
00c9`5354a5b0 7ff7`2f13fb68 : 00c9`5354ab40 00c9`5354a6f8
00c9`54476080 ` : CortexService!parquet::arrow::`anonymous
namespace'::LevelBuilder::Visit >+0xa5
00c9`5354a640 7ff7`2f12fa34 : 00c9`5354a6f8 00c9`54476080
00c9`5354ab40 ` :
CortexService!arrow::VisitArrayInline+0x298
00c9`5354a680 7ff7`2f14bf03 : 00c9`5354ab40 00c9`5354a6f8
00c9`54476080 ` : CortexService!parquet::arrow::`anonymous
namespace'::LevelBuilder::VisitInline+0x44
00c9`5354a6c0 7ff7`2f12fe2a : 00c9`5354ab40 00c9`5354ae18
00c9`54476080 00c9`5354b208 : CortexService!parquet::arrow::`anonymous
namespace'::LevelBuilder::GenerateLevels+0x93
00c9`5354aa00 7ff7`2f14de56 : 00c9`5354b1f8 00c9`5354afc8
00c9`54476080 `1e00 : CortexService!parquet::arrow::`anonymous
namespace'::ArrowColumnWriter::Write+0x25a
00c9`5354af20 7ff7`2f14e66b : 00c9`5354b1f8 00c9`5354b238
00c9`54445c20 ` : CortexService!parquet::arrow::`anonymous
namespace'::ArrowColumnWriter::Write+0x2a6
00c9`5354b040 7ff7`2f12f137 : 00c9`544041f0 00c9`5354b4d8
00c9`5354b4a8 ` :
CortexService!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x70b
00c9`5354b400 7ff7`2f14b4d5 : 00c9`54431180 00c9`5354b4d8
00c9`5354b4a8 ` :
CortexService!parquet::arrow::FileWriter::WriteColumnChunk+0x67
00c9`5354b450 7ff7`2f12eef1 : 00c9`5354b5d8 00c9`5354b648
` `1e00 :
CortexService!::operator()+0x195
00c9`5354b530 7ff7`2eb8e31e : 00c9`54431180 00c9`5354b760
00c9`54442fb0 `1e00 :
CortexService!parquet::arrow::FileWriter::WriteTable+0x521
00c9`5354b730 7ff7`2eb58ac5 : 00c9`5307bd88 00c9`54442fb0
` ` :
CortexService!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0xfe
00c9`5354b860 7ff7`2eafdce6 : 00c9`5307bd80 00c9`5354ba08
00c9`5354b9e0 00c9`5354b9d8 :
CortexService!Cortex::Storage::ParquetFileWriter::writeRowGroup+0x545
00c9`5354b9a0 7ff7`2eaf8bae : 00c9`53275600 00c9`53077220
`fffe ` :
CortexService!Cortex::Storage::DataStreamWriteWorker::onNewData+0x1a6
{code}
{code:java}
FAILED_INSTRUCTION_ADDRESS:
CortexService!arrow::internal::CountSetBits+16d
[c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
@ 99]
7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
FOLLOWUP_IP:
CortexService!arrow::internal::CountSetBits+16d
[c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
@ 99]
7ff7`2f3a4e4d f3480fb800 popcnt rax,qword ptr [rax]
FAULTING_SOURCE_LINE:
c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
FAULTING_SOURCE_FILE:
c:\jenkins\workspace\cortexv2-dev-win64-service\src\thirdparty\arrow\cpp\src\arrow\util\bit-util.cc
FAULTING_SOURCE_LINE_NUMBER: 99
SYMBOL_STACK_INDEX: 0
SYMBOL_NAME: cortexservice!arrow::internal::CountSetBits+16d
{code}
{code:java}
ERROR_CODE: (NTSTATUS) 0xc01d - {EXCEPTION} Illegal Instruction An
attempt was made to execute an illegal instruction.
EXCEPTION_CODE: (NTSTATUS) 0xc01d - {EXCEPTION}
[jira] [Created] (ARROW-4821) [cpp] compiling issue on Windows
Tham created ARROW-4821:
---
Summary: [cpp] compiling issue on Windows
Key: ARROW-4821
URL: https://issues.apache.org/jira/browse/ARROW-4821
Project: Apache Arrow
Issue Type: Bug
Components: C++
Environment: Windows 10 x64
Reporter: Tham
I'm using arrow/cpp into my cpp project and got this compiling issue. I'm not
sure where this issue comes from. I don't have it on MacOS. Can anyone help to
point out the problem?
{code:java}
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
warning C4003: not enough actual parameters for macro 'max'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
error C2589: '(': illegal token on right side of '::'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
error C2062: type 'unknown-type' unexpected
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
error C2059: syntax error: ')'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
warning C4003: not enough actual parameters for macro 'max'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
error C2589: '(': illegal token on right side of '::'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
error C2062: type 'unknown-type' unexpected
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
error C2059: syntax error: ')'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
warning C4003: not enough actual parameters for macro 'max'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
error C2589: '(': illegal token on right side of '::'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
error C2062: type 'unknown-type' unexpected
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
error C2059: syntax error: ')'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
warning C4003: not enough actual parameters for macro 'max'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
warning C4003: not enough actual parameters for macro 'min'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
error C2589: '(': illegal token on right side of '::'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
error C2062: type 'unknown-type' unexpected
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
error C2144: syntax error: 'unknown-type' should be preceded by '('
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
error C2059: syntax error: ')'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
error C2589: '(': illegal token on right side of '::'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
error C2059: syntax error: ')'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
error C2143: syntax error: missing ';' before '{'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(459):
error C2181: illegal else without matching if
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
warning C4003: not enough actual parameters for macro 'max'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(462):
warning C4003: not enough actual parameters for macro 'min'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
error C2589: '(': illegal token on right side of '::'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
error C2062: type 'unknown-type' unexpected
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
error C2144: syntax error: 'unknown-type' should be preceded by '('
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
error C2059: syntax error: ')'
E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(462):
error C2589: '(': illegal token on right side of '::'
[jira] [Updated] (ARROW-4821) [C++] compiling issue on Windows
[
https://issues.apache.org/jira/browse/ARROW-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tham updated ARROW-4821:
Summary: [C++] compiling issue on Windows (was: [cpp] compiling issue on
Windows)
> [C++] compiling issue on Windows
> -
>
> Key: ARROW-4821
> URL: https://issues.apache.org/jira/browse/ARROW-4821
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Environment: Windows 10 x64
>Reporter: Tham
>Priority: Major
>
> I'm using arrow/cpp into my cpp project and got this compiling issue. I'm not
> sure where this issue comes from. I don't have it on MacOS. Can anyone help
> to point out the problem?
> {code:java}
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/util/hash.h(32):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(45):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(46):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> warning C4003: not enough actual parameters for macro 'min'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2144: syntax error: 'unknown-type' should be preceded by '('
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(456):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2059: syntax error: ')'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(457):
> error C2143: syntax error: missing ';' before '{'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(459):
> error C2181: illegal else without matching if
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> warning C4003: not enough actual parameters for macro 'max'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(462):
> warning C4003: not enough actual parameters for macro 'min'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> error C2589: '(': illegal token on right side of '::'
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> error C2062: type 'unknown-type' unexpected
> E:\Source\emotivpro\EmotivPro\thirdParty\Parquet\src\ThirdParty\arrow\cpp\src\arrow/builder.h(461):
> error C2144: syntax error: 'unknown-type'
