Github user viirya commented on the issue: https://github.com/apache/spark/pull/13439 @kiszk 1. The allocation mechanism is not changed in this patch. Just for the column vector representing partition columns and null columns, this patch only allocates 1 row. 2. I think the speed-up might come from simplified memory access. Because we don't need to scan the memory space for all values. For the constant column vectors, only one value is accessed. I don't know if elimination of index bound helps or not. I will try to do that in `OnHeapColumnVector` and benchmark them again to see the difference.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org