kou commented on PR #51396: URL: https://github.com/apache/arrow/pull/51396#issuecomment-6513941003
I checked the history. It seems that we wanted to show an example of how to convert row-based data to Apache Arrow data efficiently: * https://github.com/apache/arrow/pull/12775 : The original PR that added the RapidJSON based example. Its description says: > This PR is meant to improve the ease of converting between Arrow tabular structure and row-based data. It adds an example of implementing and using the row converters to convert between vectors of `rapidjson::Document` and Arrow tables, highlighting some common patterns and important utilities provided by Arrow C++. * https://github.com/apache/arrow/pull/12775#issuecomment-1151339269 : The use case explained by the original author: > One of the intended use case is designing performant connectors for NoSQL databases, who typically provide results as a vector or iterator of row / document objects. If simdjson isn't suitable for column-based conversion, we may keep using RapidJSON in this example. In that case, I want to stop bundling RapidJSON and use only system RapidJSON. If simdjson is suitable for row-based conversion and it's fast, we may add a new example that shows fast row-based conversion. If row-based conversion is always faster than column-based conversion in any approach, we can remove the column-based conversion example. Otherwise, I think that we should keep the column-based conversion example. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
