[yocto] [layerindex-web][PATCH 4/5] update_layer.py: use it as a module

2018-01-02 Thread Robert Yang
It had been split to a separate tool and use subprocess to run it to avoid tinfoil issues (e.g., can't be shutdown correctly in old version), but the utils.setup_django() cost a lot of time which made it a little slow, use mulitprocessing.Process() to run it as function can avoid both issues

[yocto] [layerindex-web][PATCH 5/5] update_layer.py: only call init_parser when needed

2018-01-02 Thread Robert Yang
The tinoil is not needed in cases like the layer is already up-to-date or the layer is invalid, so only init it when needed. This can save about 1min when run "update.py -b " (124 layers). Signed-off-by: Robert Yang --- layerindex/update_layer.py | 45

[yocto] [layerindex-web][PATCH 2/5] update.py: make sure oe-core is fetched

2018-01-02 Thread Robert Yang
Fixed: $ ./update.py -l foo -b new_branch INFO: Fetching remote repository foo DEBUG: run cmd 'git fetch -p' in 'foo' [snip] DEBUG: run cmd 'git checkout origin/new_branch' in oe-core ERROR: error: pathspec 'origin/new_branch' did not match any file(s) known to git. The "new_branch" is newly

[yocto] [layerindex-web][PATCH 3/5] update.py: fetch repos parallelly

2018-01-02 Thread Robert Yang
This can save a lot of time, here is my testing data when PARALLEL_JOBS is 10, this is the fetch time only, I hacked it to stop when the fetch is done to get the data (124 layers): $ update.py -b Before: 2m30 Now: 16s Signed-off-by: Robert Yang ---

[yocto] [layerindex-web][PATCH 1/5] utils.py: fix remove obsolete dependencies

2018-01-02 Thread Robert Yang
The obsolete dependency is the one which is in database but not in conf/layer.conf anymore. The old code had a problem for newly created layerbranch, the new layerbranch has no dependencies, so no need remove. And it had a side effect was that when need_remove was cleaned up, it would be set again

[yocto] [layerindex-web][PATCH 0/5] update.py: performance improve and 2 fixes

2018-01-02 Thread Robert Yang
Hi Paul, This email contains two parts: - The first 2 are bug fixes - The other 3 are performance improvements, I have 124 layers, the "update.py -b " needs about 9m20s to finish the running when everything is update, and we have several branches, we need them to run in periodically (e.g.,

Re: [yocto] [RFC PATCH 0/1] update.py: fetch repos parallelly

2018-01-02 Thread Robert Yang
Hi Paul, On 12/27/2017 09:23 PM, Robert Yang wrote: Hi Paul, We have 124 layers, the "update.py -b " costs about 10 minutes to finish the update for one branch, and we need update several branches periodly, which is really a little slow. So I'd like to make it can run parally, here are some

Re: [yocto] [meta-dpdk][PATCH 1/3] dpdk-dev-libibverbs: fix do_fetch failure in case of multilib

2018-01-02 Thread ChenQi
Hi Saul, I sent this patch series to yocto mailing list, and also to meta-intel mailing list. I'm not sure if this is the correct mailing list to send. Anyway, could you please help review this patch series when convenient? Best Regards, Chen Qi On 12/26/2017 09:19 AM, Chen Qi wrote: Fix to

Re: [linux-yocto] Kernel modules and vermagic

2018-01-02 Thread Gutierrez, Hernan Ildefonso (Boise R, FW)
Hi Bruce, I sent the note below back in August and you nicely point me to the external source recipe workflow. Just before the Dec break, I ran into this nice tutorial from the yocto project which covers the topic in detail. https://www.yoctoproject.org/sites/default/files/kernel-lab-1.5.pdf

[yocto] Minutes: Yocto Project Technical Team Meeting

2018-01-02 Thread Jolley, Stephen K
Attendees: Stephen, Armin, Joshua W., Stephano, Joshua L., David, Richard, Aaron, Mark, Michael, Randy, Wmills, Agenda: * Yocto Project status - 5 min (Stephen/team) * The QA of YP 2.4.1 rc1 is complete. See:

[yocto] Yocto Project Status WW52’17 & WW01’18

2018-01-02 Thread Jolley, Stephen K
Current Dev Position: YP 2.5 M2 development Next Deadline: YP 2.5 M2 cut off of 1/15/18 SWAT team rotation: Maxin -> Rebecca on Dec. 22, 2017. SWAT team rotation: Rebecca -> Cal on Dec. 29, 2017. SWAT team rotation: Cal -> Joshua on Jan. 5, 2018.

Re: [yocto] QA cycle report for 2.4.1 RC1

2018-01-02 Thread Richard Purdie
Hi, On Fri, 2017-12-22 at 01:40 -0800, Yeoh, Ee Peng wrote: > Enjoy viewing the full Report for 2.4.1 > RC1:  https://wiki.yoctoproject.org/wiki/WW51_-_2017-12-21- > _Full_Test_Cycle_-_2.4.1_rc1 > > === Summary > > The QA cycle for release 2.4.1 RC1 is complete.  There are 5 new