Hi Evan, I found it difficult to install pyavroc. I just switched to fastavro. But still have no idea how to do binary decoding by leveraging fastavro. I am very appreciated if you can provide a sample.
Thank you, Welly -----Original Message----- From: Hong, Shunhui Welly Sent: Friday, March 25, 2016 9:03 AM To: 'user@avro.apache.org' Subject: RE: Avro decode very slow in Python Hi Evan, Thank you for the information. However, it is difficult to find document on pyavroc. I can't find how pyavroc to decode binary (It took 5mins to decode 55M data in Avro Python). Can you give me a sample? Thank you, Welly -----Original Message----- From: Evan McClain [mailto:aeroe...@gmail.com] Sent: Thursday, March 24, 2016 9:21 PM To: user@avro.apache.org Subject: Re: Avro decode very slow in Python On Thu, 2016-03-24 at 21:03 +0000, Hong, Shunhui Welly wrote: > Hi guys, > > I am trying to decode avro binary data (55M took 5 mins) in Python. > It seems 10+ times slower than in Java. Any suggestions? I have used both fastavro and pyavroc. pyavroc is a little more trouble to install but should be fairly close to the java implementation. fastavro could definitely be improved since it's not even using cython's types. I've been meaning to look into adding types to fastavro but free time is harder to find these days... -- Evan McClain <aeroe...@gmail.com> This email is confidential and subject to important disclaimers and conditions including on offers for the purchase or sale of securities, accuracy and completeness of information, viruses, confidentiality, legal privilege, and legal entity disclaimers, available at http://www.jpmorgan.com/pages/disclosures/email
