[jira] [Commented] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-16 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819773#comment-16819773 ] Fokko Driesprong commented on PARQUET-1563: --- Quighui is correct. The date typ

[jira] [Commented] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-16 Thread Qinghui Xu (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819644#comment-16819644 ] Qinghui Xu commented on PARQUET-1563: - So, regarding to your schema, the output is

[jira] [Commented] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-16 Thread Fan Mo (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819519#comment-16819519 ] Fan Mo commented on PARQUET-1563: - please check the screenshot, it shows you that when

[jira] [Updated] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-16 Thread Fan Mo (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Mo updated PARQUET-1563: Attachment: Screen Shot 2019-04-16 at 2.25.54 PM.png > cannot read 'date' datatype which write by spark >

[jira] [Commented] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-16 Thread Fan Mo (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819517#comment-16819517 ] Fan Mo commented on PARQUET-1563: - attachment is one testing data I'm using. the follow

[jira] [Updated] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-16 Thread Fan Mo (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Mo updated PARQUET-1563: Attachment: test.snappy.parquet > cannot read 'date' datatype which write by spark >

[jira] [Commented] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-16 Thread Qinghui Xu (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819505#comment-16819505 ] Qinghui Xu commented on PARQUET-1563: - Could you provide your parquet schema to hel

[jira] [Commented] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-16 Thread Fan Mo (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819332#comment-16819332 ] Fan Mo commented on PARQUET-1563: - I'm not trying to write the date datatype, I'm tryin

Re: Parquet Sync

2019-04-16 Thread Xinli shang
Thanks, Julien! I will work with Lars for the rotation. On Mon, Apr 15, 2019 at 10:54 PM Julien Le Dem wrote: > It would be fine to have a rotation. > > On Mon, Apr 15, 2019 at 10:44 PM Lars Volker > wrote: > > > Hi, > > > > I'd be happy to help. I have organized a few of these in the past, an

Re: Parquet Sync

2019-04-16 Thread Brian Bowman
All, I look forward to participating in the upcoming Parquet Syncs. I'll be happy to be a "scribe in rotation" but would first like to participate in a couple of Syncs. By way of introduction: I'm Brian Bowman, 34+ year veteran of SAS R&D. I've been working with Parquet Open Source and C++

[jira] [Commented] (PARQUET-1559) Add way to manually commit already written data to disk

2019-04-16 Thread Victor (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818965#comment-16818965 ] Victor commented on PARQUET-1559: - Ok, so I suppose this is a wont fix then, because it

[jira] [Resolved] (PARQUET-1559) Add way to manually commit already written data to disk

2019-04-16 Thread Victor (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor resolved PARQUET-1559. - Resolution: Won't Fix > Add way to manually commit already written data to disk > -

Re: [VOTE] Release Apache Parquet 1.11.0 RC6

2019-04-16 Thread Gabor Szadovszky
Based on our release process ( http://parquet.apache.org/documentation/how-to-release/) and the related scripts we use the final tag for an RC. So, the existence of this tag does not mean 1.11.0 is released. However, I agree this is misleading and not a good practice to remove already committed tag

[jira] [Commented] (PARQUET-1559) Add way to manually commit already written data to disk

2019-04-16 Thread Gabor Szadovszky (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818783#comment-16818783 ] Gabor Szadovszky commented on PARQUET-1559: --- A simple flush would not make th