Archived version is here:

https://cwiki.apache.org/confluence/display/HADOOP/2020-06-08+Meeting+notes






 >>> APAC/EMEA Community meeting

  * The time of the second Community Sync:
       Friday 12:15PM Beijing / 9:45AM India

* We agreed to use the same Zoom link as on Monday for the sake of simplicity, but rooms seems to be assigned to hosts. I suggest to use the existing/old link: https://cloudera.zoom.us/j/5780476042

 >>> OzoneFS changes

   * Marton quickly shared the project structure of ozonefs projects

* TLDR; use ozonefs-hadoop2/3 in external projects, ozonefs-shaded does the shading, ozonefs-common contains all the important java code, ozonefs is a non-shaded version (used by ozone fs command)

>>> Storage-class support

* There are some open questions which are summarized (and added to the hackmd doc)

   * https://hackmd.io/4kxufJBOQNaKn7PKFK_6OQ?edit

   * How to configure? What is the level of abstraction?

   * Transitions between storage-classes

   * Required implementation changes?

   * Mukul suggested to add more technical details (POC?).

* If I understood well there was an agreement about the concept, but some questions depend on the exact implementation

>>> Upgrade design doc

* uploaded to HDDS-3698. An introduction can be done next Monday, id Aravindan is available.

>>> OFS merge vote is on-going, please follow the thread


>>> Rocksdb performance problems on datanode

 * The problem quickly summarized as it can be a big change

* Too many closed containers --> too many RocksDB handlers (+ memory, + threads)

 * @runzhiwang is working actively on a proposal

* https://docs.google.com/document/d/18Ybg-NjyU602c-MYXaJHP6yrg-dVMZKGyoK5C_pp1mM/edit#

>>> Unit test

* Mukul: Many integration tests are disabled, we should spend time on fix then. Please fix one unit test per week, and we are done

* Code coverage data is uploaded to the Sonar. Acceptance test coverage will be added soon.

* Vivek is working on an integration with pull requests (PR will be commented with coverage information)


Marton

ps: sorry I forget to record the meeting, still new to me

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to