GitHub user ueshin opened a pull request:
https://github.com/apache/spark/pull/18680
[SPARK-21472][SQL] Introduce ArrowColumnVector as a reader for Arrow
vectors.
## What changes were proposed in this pull request?
Introducing `ArrowColumnVector` as a reader for Arrow vectors.
It extends `ColumnVector`, so we will be able to use it with
`ColumnarBatch` and its functionalities.
Currently it supports primitive types and `StringType`, `ArrayType` and
`StructType`.
## How was this patch tested?
Added tests for `ArrowColumnVector` and existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ueshin/apache-spark issues/SPARK-21472
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18680.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18680
----
commit 73899b26d10ed3763569f4aa2e836643a5ce941a
Author: Takuya UESHIN <ues...@databricks.com>
Date: 2017-07-19T05:50:22Z
Introduce ArrowColumnVector as a reader for Arrow vectors.
commit 689f86f761009d2220d9679102770a8763e55573
Author: Takuya UESHIN <ues...@databricks.com>
Date: 2017-07-19T06:22:24Z
Import ArrowUtils and use it.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
