[ 
https://issues.apache.org/jira/browse/ARROW-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070445#comment-17070445
 ] 

Wes McKinney commented on ARROW-8257:
-------------------------------------

Would you mind sending this to d...@arrow.apache.org instead? Thank you

> Clarification regarding the `CDataInterface.rst`
> ------------------------------------------------
>
>                 Key: ARROW-8257
>                 URL: https://issues.apache.org/jira/browse/ARROW-8257
>             Project: Apache Arrow
>          Issue Type: Bug
>            Reporter: Anish Biswas
>            Priority: Major
>
> I have been trying to wrap my head around the[ 
> CDataInterface.rst|[https://github.com/apache/arrow/blob/master/docs/source/format/CDataInterface.rst]]
>  document for a few days now. So what I am trying is basically to use the C 
> interface with a minimum dependencies to produce blocks of bytes that pyarrow 
> can reconstruct and work on as a normal pyarrow array (and vice-versa: both 
> directions). 
> Here's what I already tried doing. 
>  * Created a C library that contains the two structs ArrowSchema and 
> ArrowArray and some functions to export an int64_t array as an Arrow Array. 
> This is very similar to what the document did with int32_t arrays.
>  * Imported the C library in Python. Created an int64_t pyarrow.array. 
> Serialized it to read the bytes via Numpy and populated the C struct I 
> created using the C library function. 
> What I expected was that the bytes would have some resemblance to each other 
> and that pyarrow would have some utility to pick up the ArrowArray struct and 
> treat it as an Arrow Array. But I couldn't get it to work. 
> I am also confused as to how do I use ArrowSchema properly. The 
> {{ArrowSchema}} is the only structure that differentiates different 
> {{ArrowArray}} formats. However, the fact that I am not using it anywhere 
> with the {{ArrowArray}} struct or for that matter for any kind of 
> initialization which tells the Arrow library that "The next structure you 
> will encounter would be of the kind that the {{ArrowSchema}} has provided 
> you", doesn't seem correct to me. 
> It would really help me out, if you could tell if I actually misinterpreted 
> the doc, or am I doing something wrong. Thanks!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to