[
https://issues.apache.org/jira/browse/PARQUET-163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manish Agarwal updated PARQUET-163:
-----------------------------------
Description:
I have 2 int fields and 1 string field . To insert it into parquet File I use 2
IntWritable and 1 BinaryWritable object .
For next record i can reuse my 2 IntWritable objects but i have to create a new
BinaryWritable object because BinaryWritable do not have set method . This
is a bottleneck for me in performance as i am doing new again for every
nextrecord .
How do you guys recommend i solve this since BytesWritable is not in parquet
's writePrimitive in DataWritableWriter class . it has ByteWritable and we need
BytesWritable
was:
currently i have 2 int fileds and 1 string field . To insert it into parquet i
use 2 intwritables and 1 binarywriatbel object .
For next record i can reuse my 2 IntWritable objects but i have to create a new
BinaryWritable object because BinaryWritable do not have set method . this
is a bottleneck for me in performance as i am doing new again for every record
.
How do you guys recommend i solve this since BytesWritable is not in parquet
's writePrimitive in DataWritableWriter class . it has ByteWritable and we need
BytesWritable
> BytesWritable is not in parquet 's writePrimitive method in
> DataWritableWriter class
> --------------------------------------------------------------------------------------
>
> Key: PARQUET-163
> URL: https://issues.apache.org/jira/browse/PARQUET-163
> Project: Parquet
> Issue Type: Bug
> Reporter: Manish Agarwal
>
> I have 2 int fields and 1 string field . To insert it into parquet File I use
> 2 IntWritable and 1 BinaryWritable object .
>
> For next record i can reuse my 2 IntWritable objects but i have to create a
> new BinaryWritable object because BinaryWritable do not have set method .
> This is a bottleneck for me in performance as i am doing new again for every
> nextrecord .
> How do you guys recommend i solve this since BytesWritable is not in parquet
> 's writePrimitive in DataWritableWriter class . it has ByteWritable and we
> need BytesWritable
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
