Re: Kudu datastore reports

2019-06-10 Thread John Mora
Hi Alfonso. Thanks so much for your feedback. I am working on your comments. Best, John El lun., 10 jun. 2019 a las 16:11, Alfonso Nishikawa (< alfonso.nishik...@gmail.com>) escribió: > Hi, John. > > Regarding your questions at the report [1]: > > >- How to represent partitioning

Re: Redis datastore

2019-06-10 Thread FRANCISCO XAVIER SUMBA TORAL
Thanks Alonso for your comments. I will analyze the code from HBase. Thanks for your suggestion… Also, my code is in master, but I will move to the branch 527, it will be easier to trace changes. Best, Xavier. > On Jun 10, 2019, at 18:20, Alfonso Nishikawa > wrote: > > Hi, Xavier. > >

Re: Week 2 Report and A Question

2019-06-10 Thread Sheriffo Ceesay
Hello Alfonso and Renato, Thank you for getting in touch and thanks for the detailed replies. I will have proper look at this tomorrow morning. I did some troubleshooting yesterday (mostly playing with Xmx and zookeeper timeout settings), that improved the conditions, but it did not entirely

Re: Redis datastore

2019-06-10 Thread Alfonso Nishikawa
Hi, Xavier. I don't see your branch GORA-527 told in your report. What I would want to ask for is to add the same functionality to load the mapping from configuration in you RedisStore [1] as in HBase's store [2]. This will have implications on your readMapping that in HBase was done by passing

Re: Week 2 Report and A Question

2019-06-10 Thread Alfonso Nishikawa
Hi! My hypothesis is taht that the difference between MongoDB and HBase is that HBase put more stress serializing with avro. It could affect too that if the HBase's test is performed after MongoDB's ones, then the GC starts from a "bad" situation. >From [A] linked by @Renato, if the error was

Re: Week 2 Report and A Question

2019-06-10 Thread Renato Marroquín Mogrovejo
@Alfonso, Thank you very much for the suggestions! you are totally right about all of your points! Sheriffo, please benefit from them ;) Also what is strange is this (although it can be optimized as Alfonso pointed out) is that it works for the MongoDB backend. So I would also suspect on the

Re: Week 2 Report and A Question

2019-06-10 Thread Alfonso Nishikawa
Hi again, Sheriffo. More improvements to [1] over the last email: - fields.toArray() doesn't need a full array like in [6]. You should do just fields.toArray(new String[0]), and better if you create an array [0] and reuse it. That call only needs the type. - I guess the class at [2] will always

Re: Week 2 Report and A Question

2019-06-10 Thread Alfonso Nishikawa
Hi, Sheriffo. You can try reusing the Persistent instances [1] to insert the data. I don't know all the backends, but they should be reusable, at least in mongoDB and HBase. [1] -

Re: Week 2 Report and A Question

2019-06-10 Thread Alfonso Nishikawa
Hi, Sheriffo. I really don't know how to solve it, but are you setting any Xmx / Xms configuration values? Regards, Alfonso NIshikawa El sáb., 8 jun. 2019 a las 16:02, Sheriffo Ceesay () escribió: > Hi All, > > Week 2 progress update is available at > >

Re: Kudu datastore reports

2019-06-10 Thread Alfonso Nishikawa
Hi, John. Regarding your questions at the report [1]: - How to represent partitioning configurations on the mapping file. This was discussed in other emails, isn't it? :) - KuduTestHarness requires the Maven plugin os-maven-plugin, which needs Maven 3.1.1+, is it a problem for Apache

Re: Kudu datastore reports

2019-06-10 Thread Alfonso Nishikawa
Hi, John. Thank you! Things I have seen: - The version of a maven dependency [1] should go on the Dependency Management of the root pom [2]. Same for [3] and from there, should not set the version there. - Set test dependencies' scope to test, at [4] and from there. - Set the indentation to 2