[GitHub] [arrow] emkornfield commented on pull request #7110: Proof of concept for Arrow text schema

2020-05-06 Thread GitBox


emkornfield commented on pull request #7110:
URL: https://github.com/apache/arrow/pull/7110#issuecomment-624994025


   > Seems pretty straightforward to read for anyone who knows about Arrow's 
data representation to me. A bit verbose for the simpler cases, however. Maybe 
we would need to add a couple extra keys at the top level... Versioning for the 
text schema? Something that says this is an Arrow schema? Or maybe that's not 
necessary.
   
   I would be prefer not to add anything that the flatbuffer parser can't 
parse.  Feature versioning is something I've been meaning to make a proposal 
for but I think that might be different then what you are thinking of.  I'd be 
OK with having this as a non-official function (probably move out of IPC 
namespace) to clarify this is only an convenience in the C++ (and binding code 
base).  I think @wesm had some concerns in general about exposing this.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [arrow] emkornfield commented on pull request #7110: Proof of concept for Arrow text schema

2020-05-08 Thread GitBox


emkornfield commented on pull request #7110:
URL: https://github.com/apache/arrow/pull/7110#issuecomment-625963511


   >  I'm not sure what you mean by non-official function, though. Could you 
expand on that?
   Sorry, I meant not something that is supported officially in the IPC format 
specification (i.e. other languages need to support reading the JSON).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [arrow] emkornfield commented on pull request #7110: Proof of concept for Arrow text schema

2020-05-26 Thread GitBox


emkornfield commented on pull request #7110:
URL: https://github.com/apache/arrow/pull/7110#issuecomment-633784293


   @chish42 that seems like the right order.
   
   For #1 given that you discussed it on the mailing list and people have been 
CCed here, since no one has objected I think we can move forward.  (lazy 
consensus).
   
   Yes, please create a JIRA for tracking purposes (and it will give one more 
bump to the thread of anybody monitoring JIRA has any hard disagreements/input).
   
   For #3 I would have to think about it a bit, but maybe additional methods on 
Schema or functions defined in type.h 
   
   4. yes, please maybe mark the header title here as WIP until you feel 
comfortable for a review.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org