[ 
https://issues.apache.org/jira/browse/PARQUET-163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271571#comment-14271571
 ] 

Ryan Blue commented on PARQUET-163:
-----------------------------------

[~manish.agarwal], are you using Hive's DataWritableWriter class? That class is 
not really designed to be user-facing, it is part of the Hive implementation. I 
recommend using a different object model, like parquet-avro, that would be more 
straight-forward and not require using Writables.

>  BytesWritable is not in  parquet 's writePrimitive method in 
> DataWritableWriter class
> --------------------------------------------------------------------------------------
>
>                 Key: PARQUET-163
>                 URL: https://issues.apache.org/jira/browse/PARQUET-163
>             Project: Parquet
>          Issue Type: Bug
>            Reporter: Manish Agarwal
>
> I have 2 int fields and 1 string field . To insert it into parquet File I use 
> 2 IntWritable and 1 BinaryWritable object .
>  
> For next record i can reuse my 2 IntWritable objects but i have to create a 
> new  BinaryWritable object because  BinaryWritable do not have  set method . 
> This is a bottleneck for me in performance as i am doing new again for every 
> nextrecord . 
> How do you guys recommend i solve this since BytesWritable is not in  parquet 
> 's writePrimitive in DataWritableWriter class . it has ByteWritable and we 
> need BytesWritable



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to