Re: Week 2 Report and A Question

Hi All, Further to my previous email, I have now updated the code to reflect the code optimisations proposed by Alfonso. I have completely removed the reflection approach. @Alfonso Nishikawa , the reason I did not use *SpecificRecordBase.get(int index)* and *SpecificRecordBase.put(int index,

Re: Week 2 Report and A Question

Hi Renato, I will follow Alfonso's recommendations about reusing objects as much as I can. I will push those changes to the branch by the end of this week. To answer your questions. Yes, you are right I am using a clean cold JVM. If necessary, I can also have a look at warming the JVM down the

Re: Week 2 Report and A Question

Hey Sheriffo, Cool to hear you are making progress! :) and great to see that we have some numbers already! :) Regarding optimization point (1), regardless that this was not he cause of the issue or not, Alfonso suggestions are something we should follow, many objects with a short life in java

Re: Week 2 Report and A Question

Hello, I have taken a proper look at the recommendations from @Alfonso and @Renato and below are the outcomes. Failed Attempts 1. Optimisation, for the insert operation, to avoid the concatenation issue, I have just taken the quickest route by calling the methods directly without reflection.

Re: Week 2 Report and A Question

Hello Alfonso and Renato, Thank you for getting in touch and thanks for the detailed replies. I will have proper look at this tomorrow morning. I did some troubleshooting yesterday (mostly playing with Xmx and zookeeper timeout settings), that improved the conditions, but it did not entirely

Re: Week 2 Report and A Question

Hi! My hypothesis is taht that the difference between MongoDB and HBase is that HBase put more stress serializing with avro. It could affect too that if the HBase's test is performed after MongoDB's ones, then the GC starts from a "bad" situation. >From [A] linked by @Renato, if the error was

Re: Week 2 Report and A Question

@Alfonso, Thank you very much for the suggestions! you are totally right about all of your points! Sheriffo, please benefit from them ;) Also what is strange is this (although it can be optimized as Alfonso pointed out) is that it works for the MongoDB backend. So I would also suspect on the

Re: Week 2 Report and A Question

Hi again, Sheriffo. More improvements to [1] over the last email: - fields.toArray() doesn't need a full array like in [6]. You should do just fields.toArray(new String[0]), and better if you create an array [0] and reuse it. That call only needs the type. - I guess the class at [2] will always

Re: Week 2 Report and A Question

Hi, Sheriffo. You can try reusing the Persistent instances [1] to insert the data. I don't know all the backends, but they should be reusable, at least in mongoDB and HBase. [1] -

Re: Week 2 Report and A Question

Hi, Sheriffo. I really don't know how to solve it, but are you setting any Xmx / Xms configuration values? Regards, Alfonso NIshikawa El sáb., 8 jun. 2019 a las 16:02, Sheriffo Ceesay () escribió: > Hi All, > > Week 2 progress update is available at > >

Week 2 Report and A Question

Hi All, Week 2 progress update is available at https://cwiki.apache.org/confluence/display/GORA/%5BGORA-532%5D+Apache+Gora+Benchmark+Module+Weekly+Report I have one question that I would like my mentors to advise on, I am still working it but thought it would be good to report it because it is