[jira] [Commented] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Tham (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298571#comment-17298571 ] Tham commented on PARQUET-1995: --- Ok, thanks [~emkornfield]. I'll try to upgrade and run o

[jira] [Comment Edited] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Tham (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298527#comment-17298527 ] Tham edited comment on PARQUET-1995 at 3/10/21, 6:42 AM: - [~emk

[jira] [Commented] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298550#comment-17298550 ] Micah Kornfield commented on PARQUET-1995: -- Well it seems like a bug someplace

[jira] [Comment Edited] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Tham (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298527#comment-17298527 ] Tham edited comment on PARQUET-1995 at 3/10/21, 4:38 AM: - [~emk

[jira] [Commented] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Tham (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298527#comment-17298527 ] Tham commented on PARQUET-1995: --- [~emkornfield] the arrow version I'm using is 0.17.1. S

[jira] [Commented] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298523#comment-17298523 ] Micah Kornfield commented on PARQUET-1995: -- we've also had some other bugs rel

[jira] [Commented] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298515#comment-17298515 ] Micah Kornfield commented on PARQUET-1995: -- This is a little bit hard to diagn

[jira] [Commented] (PARQUET-1996) [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298279#comment-17298279 ] ASF GitHub Bot commented on PARQUET-1996: - pitrou commented on a change in pull

[GitHub] [parquet-format] pitrou commented on a change in pull request #168: PARQUET-1996: [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread GitBox
pitrou commented on a change in pull request #168: URL: https://github.com/apache/parquet-format/pull/168#discussion_r590649223 ## File path: src/main/thrift/parquet.thrift ## @@ -481,9 +481,10 @@ enum CompressionCodec { SNAPPY = 1; GZIP = 2; LZO = 3; - BROTLI = 4; //

[jira] [Commented] (PARQUET-1996) [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298276#comment-17298276 ] ASF GitHub Bot commented on PARQUET-1996: - emkornfield commented on a change in

[GitHub] [parquet-format] emkornfield commented on a change in pull request #168: PARQUET-1996: [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread GitBox
emkornfield commented on a change in pull request #168: URL: https://github.com/apache/parquet-format/pull/168#discussion_r590647828 ## File path: src/main/thrift/parquet.thrift ## @@ -481,9 +481,10 @@ enum CompressionCodec { SNAPPY = 1; GZIP = 2; LZO = 3; - BROTLI =

[jira] [Commented] (PARQUET-1996) [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298268#comment-17298268 ] ASF GitHub Bot commented on PARQUET-1996: - pitrou commented on a change in pull

[GitHub] [parquet-format] pitrou commented on a change in pull request #168: PARQUET-1996: [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread GitBox
pitrou commented on a change in pull request #168: URL: https://github.com/apache/parquet-format/pull/168#discussion_r590644296 ## File path: src/main/thrift/parquet.thrift ## @@ -481,9 +481,10 @@ enum CompressionCodec { SNAPPY = 1; GZIP = 2; LZO = 3; - BROTLI = 4; //

[jira] [Commented] (PARQUET-1996) [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298262#comment-17298262 ] ASF GitHub Bot commented on PARQUET-1996: - emkornfield commented on a change in

[GitHub] [parquet-format] emkornfield commented on a change in pull request #168: PARQUET-1996: [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread GitBox
emkornfield commented on a change in pull request #168: URL: https://github.com/apache/parquet-format/pull/168#discussion_r590639574 ## File path: src/main/thrift/parquet.thrift ## @@ -481,9 +481,10 @@ enum CompressionCodec { SNAPPY = 1; GZIP = 2; LZO = 3; - BROTLI =

Re: [C++] Changing the versioning string for Parquet-CPP

2021-03-09 Thread Micah Kornfield
I think there might have been some old agreement on this when parquet-cpp was moved into the Arrow repo. I can't seem to find the thread, but it would be nice for some PMC members to chime it to make sure this seems OK to them. On Sat, Mar 6, 2021 at 7:38 AM Antoine Pitrou wrote: > On Fri, 5 Ma

[jira] [Commented] (PARQUET-1950) Define core features / compliance level

2021-03-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298244#comment-17298244 ] ASF GitHub Bot commented on PARQUET-1950: - pitrou commented on a change in pull

[GitHub] [parquet-format] pitrou commented on a change in pull request #164: PARQUET-1950: Define core features

2021-03-09 Thread GitBox
pitrou commented on a change in pull request #164: URL: https://github.com/apache/parquet-format/pull/164#discussion_r590617889 ## File path: CoreFeatures.md ## @@ -0,0 +1,181 @@ + + +# Parquet Core Features + +This document lists the core features for each parquet-format relea

Re: Request deprecation / removal of LZ4 compression

2021-03-09 Thread Antoine Pitrou
Hi Gabor, I've filed https://issues.apache.org/jira/browse/PARQUET-1996 and submitted https://github.com/apache/parquet-format/pull/168 for the format updates. Hopefully this will get the ball rolling. Best regards Antoine. On Mon, 8 Mar 2021 10:56:32 +0100 Gabor Szadovszky wrote: > Hi Ant

[jira] [Commented] (PARQUET-1996) [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298240#comment-17298240 ] ASF GitHub Bot commented on PARQUET-1996: - pitrou opened a new pull request #16

[GitHub] [parquet-format] pitrou opened a new pull request #168: PARQUET-1996: [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread GitBox
pitrou opened a new pull request #168: URL: https://github.com/apache/parquet-format/pull/168 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Created] (PARQUET-1996) [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec

2021-03-09 Thread Antoine Pitrou (Jira)
Antoine Pitrou created PARQUET-1996: --- Summary: [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec Key: PARQUET-1996 URL: https://issues.apache.org/jira/browse/PARQUET-1996 Project: P

[jira] [Commented] (PARQUET-1994) Upgrade ZSTD JNI to 1.4.9-1

2021-03-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298173#comment-17298173 ] ASF GitHub Bot commented on PARQUET-1994: - dongjoon-hyun commented on pull requ

[GitHub] [parquet-mr] dongjoon-hyun commented on pull request #880: PARQUET-1994: Upgrade ZSTD JNI to 1.4.9-1

2021-03-09 Thread GitBox
dongjoon-hyun commented on pull request #880: URL: https://github.com/apache/parquet-mr/pull/880#issuecomment-794144435 Thank you so much always, @gszadovszky ! This is an automated message from the Apache Git Service. To res

[jira] [Updated] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Tham (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tham updated PARQUET-1995: -- Description: I got this crash from our customer machine:  [^parquet_crash_WriteBatchSpaced.txt] , it crashes

[jira] [Updated] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl>

2021-03-09 Thread Tham (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tham updated PARQUET-1995: -- Attachment: parquet_crash_WriteBatchSpaced.txt > [C++][Parquet] Crash at parquet::TypedColumnWriterImpl>

[jira] [Updated] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced

2021-03-09 Thread Tham (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tham updated PARQUET-1995: -- Summary: [C++][Parquet] Crash at parquet::TypedColumnWriterImpl<>::WriteBatchSpaced (was: [C++][Parquet] Cra

[jira] [Created] (PARQUET-1995) [C++][Parquet] Crash at parquet::TypedColumnWriterImpl>

2021-03-09 Thread Tham (Jira)
Tham created PARQUET-1995: - Summary: [C++][Parquet] Crash at parquet::TypedColumnWriterImpl>https://issues.apache.org/jira/browse/PARQUET-1995 Project: Parquet Issue Type: Bug Reporter: Tham -- This message was sen

[jira] [Commented] (PARQUET-1994) Upgrade ZSTD JNI to 1.4.9-1

2021-03-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17297939#comment-17297939 ] ASF GitHub Bot commented on PARQUET-1994: - gszadovszky merged pull request #880

[jira] [Resolved] (PARQUET-1994) Upgrade ZSTD JNI to 1.4.9-1

2021-03-09 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky resolved PARQUET-1994. --- Resolution: Fixed > Upgrade ZSTD JNI to 1.4.9-1 > --- > >

[GitHub] [parquet-mr] gszadovszky merged pull request #880: PARQUET-1994: Upgrade ZSTD JNI to 1.4.9-1

2021-03-09 Thread GitBox
gszadovszky merged pull request #880: URL: https://github.com/apache/parquet-mr/pull/880 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Assigned] (PARQUET-1994) Upgrade ZSTD JNI to 1.4.9-1

2021-03-09 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky reassigned PARQUET-1994: - Assignee: Dongjoon Hyun > Upgrade ZSTD JNI to 1.4.9-1 > --