I created https://issues.apache.org/jira/browse/ARROW-9598 to track.
On Wed, Jul 29, 2020 at 9:13 PM Micah Kornfield
wrote:
> So I think the problem is within WriteLevelSpaced [1], specifically how we
> calculate "min_spaced_def_level", seems incorrect (I think this only worked
> for single nest
Hi,
That makes a lot of sense. I am sorry that I did not understand that from
the versioning document and the discussion on this thread.
Best,
Jorge
On Tue, Jul 28, 2020 at 8:30 PM Wes McKinney wrote:
> On Tue, Jul 28, 2020 at 8:49 AM Jorge Cardoso Leitão
> wrote:
> >
> > Thanks for the sum
So I think the problem is within WriteLevelSpaced [1], specifically how we
calculate "min_spaced_def_level", seems incorrect (I think this only worked
for single nested lists). This value probably needs to be calculated by
walking up the tree to find the def level of the first repeated value.
[1]
Hi Radu,
This appears to be a bug, would you mind filing a bug in JIRA?
I'm looking into it to see if I can figure out what is going on.
Thanks,
Micah
On Wed, Jul 29, 2020 at 1:07 PM Radu Teodorescu
wrote:
> Is the current version supposed to allow struct columns with null values
> to be writt
Is the current version supposed to allow struct columns with null values to be
written to parquet:
I narrowed it down to a two rows table with one column and two rows and the
resulting parquet file is broken both according to parquet-tools as well as our
own reader (it looks like a buffer is no
Arrow Build Report for Job nightly-2020-07-29-0
All tasks:
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-29-0
Failed Tasks:
- homebrew-cpp:
URL:
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-29-0-travis-homebrew-cpp
- test-conda-python-3
