Re: [protobuf] Decoding .pb file via protoc command

2019-03-27 Thread tausif.elahi via Protocol Buffers
Thanks Adam for checking the issue; the file is not binary, as because after opening the file on any text editor(like Sublime) all I can see is different website links and random numbers. For convenience I have uploaded the file on Google drive and you can the check it through this link:

Re: [protobuf] Decoding .pb file via protoc command

2019-03-27 Thread 'Adam Cozzette' via Protocol Buffers
That's the surprising that the file is so large and also that its size doesn't match the size in your error message. Can you just confirm that it is a binary file and not a text file? I just want to rule out the possibility that it's formatted in the protobuf text format. On Tue, Mar 26, 2019 at

Re: [protobuf] protobuf-net desrialization taking too long

2019-03-27 Thread Marc Gravell
> Where can I send you mail? My e-mail is ... I'll ping you On Wed, 27 Mar 2019 at 15:12, Shweta Sharma wrote: > Thanks again Marc. Yes Deserialization code is as you listed below. I was > using protobuf-net 2.4.0.0 but then moved to older version currently being > used across our code base,

Re: [protobuf] protobuf-net desrialization taking too long

2019-03-27 Thread Shweta Sharma
Thanks again Marc. Yes Deserialization code is as you listed below. I was using protobuf-net 2.4.0.0 but then moved to older version currently being used across our code base, 2.0.0.668, to see any impact. Where can I send you mail? My e-mail is shwetad...@gmail.com. I can get these objects

Re: [protobuf] protobuf-net desrialization taking too long

2019-03-27 Thread Marc Gravell
> using StackExchange.Redis MGET Yeah, there's really no way for me to dodge this, is there? ;p Minor note: your parallel code currently doesn't actually allow any meaningful parallelism - you *might* want to move the "lock" so that you only "lock" around the "Add". You're also currently doing a

Re: [protobuf] protobuf-net desrialization taking too long

2019-03-27 Thread Shweta Sharma
Big Thanks Marc for helping me here. Question: how fast is "fast enough" here, and how big are your payloads? Answer: < 50 ms for read and deserialization for 20K keys. Payload varies depending on SubObj array length but in avg case SubObj array length does not exceed 100 elements. I am

Re: [protobuf] protobuf-net desrialization taking too long

2019-03-27 Thread Marc Gravell
Hi; I'd love to help you on this - I'm the protobuf-net author, and I also know more than a little about redis; it *might* be a little off-piste for this group though. Running some tests locally with 5000 instances, I get times like 1ms, but it might be that I'm misunderstanding your object model.