Kazuyuki Tanimura created SPARK-38086:
-----------------------------------------

             Summary: Make ArrowColumnVector Extendable
                 Key: SPARK-38086
                 URL: https://issues.apache.org/jira/browse/SPARK-38086
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.3.0
            Reporter: Kazuyuki Tanimura


Some Spark extension libraries need to extend ArrowColumnVector.java. For now, 
it is impossible as ArrowColumnVector class is final and the accessors are all 
private.

For example, Rapids copies the entire ArrowColumnVector class in order to work 
around the issue

[https://github.com/NVIDIA/spark-rapids/blob/main/sql-plugin/src/main/java/org/apache/spark/sql/vectorized/rapids/AccessibleArrowColumnVector.java]

Proposing to relax private/final restrictions to make ArrowColumnVector 
extendable.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to