Re: The linaro-2.6.39 kernel / Panda

2011-06-06 Thread Andy Green

On 06/04/2011 02:17 PM, Somebody in the thread at some point said:

Hi -


When booted on a Beagleboard-xM, the resulting kernel appears to hang
after Starting kernel I haven't investigated any further.


Panda chokes the same way with previously OK omap4_defconfig.

Uncompressing Linux... done, booting the kernel.
[0.00] Linux version 2.6.39-panda_reb39+ 
(agr...@otae.warmcat.com) (gcc version 4.5.1 20101112 (Red Hat 4.5.1-5) 
(GCC) ) #6 SMP PREEMPT Mon Jun 6 09:04:39 BST 2011
[0.00] CPU: ARMv7 Processor [411fc092] revision 2 (ARMv7), 
cr=10c5387f
[0.00] CPU: VIPT nonaliasing data cache, VIPT aliasing 
instruction cache

[0.00] Machine: OMAP4 Panda board
[0.00] Reserving 33554432 bytes SDRAM for VRAM
[0.00] Memory policy: ECC disabled, Data cache writealloc
[0.00] OMAP4430 ES2.1
[0.00] SRAM: Mapped pa 0x4030 to va 0xfe40 size: 0xe000
[0.00] powerdomain: waited too long for powerdomain dss_pwrdm to 
complete transition
[0.00] PERCPU: Embedded 8 pages/cpu @c10ea000 s9728 r8192 d14848 
u32768
[0.00] Built 1 zonelists in Zone order, mobility grouping on. 
Total pages: 109410
[0.00] Kernel command line: console=tty0 console=ttyO2,115200n8 
earlycon=ttyO2,115200n8 earlyprintk=1 
root=UUID=3f5789f6-fdb2-43cb-abe8-5e064f387200 rootwait ro fixrtc 
nocompcache vram=32M omapfb.vram=0:24M mem=463M ip=none omapfb.debug=1

[0.00] PID hash table entries: 2048 (order: 1, 8192 bytes)
[0.00] Dentry cache hash table entries: 65536 (order: 6, 262144 
bytes)
[0.00] Inode-cache hash table entries: 32768 (order: 5, 131072 
bytes)

[0.00] Memory: 430MB 1MB = 431MB total
[0.00] Memory: 419652k/419652k available, 54460k reserved, 0K 
highmem

[0.00] Virtual kernel memory layout:
[0.00] vector  : 0x - 0x1000   (   4 kB)
[0.00] fixmap  : 0xfff0 - 0xfffe   ( 896 kB)
[0.00] DMA : 0xffc0 - 0xffe0   (   2 MB)
[0.00] vmalloc : 0xdd00 - 0xf800   ( 432 MB)
[0.00] lowmem  : 0xc000 - 0xdcf0   ( 463 MB)
[0.00] pkmap   : 0xbfe0 - 0xc000   (   2 MB)
[0.00] modules : 0xbf00 - 0xbfe0   (  14 MB)
[0.00]   .init : 0xc0008000 - 0xc005   ( 288 kB)
[0.00]   .text : 0xc005 - 0xc0757cd4   (7200 kB)
[0.00]   .data : 0xc0758000 - 0xc07dff68   ( 544 kB)
[0.00] Preemptable hierarchical RCU implementation.
[0.00]  RCU-based detection of stalled CPUs is disabled.
[0.00]  Verbose stalled-CPUs detection is disabled.
[0.00] NR_IRQS:410
[0.00] omap_hwmod: dpll_mpu_m2_ck: missing clockdomain for 
dpll_mpu_m2_ck.

[0.00] OMAP clockevent source: GPTIMER1 at 32768 Hz
[0.00] sched_clock: 32 bits at 32kHz, resolution 30517ns, wraps 
every 131071999ms

[0.00] Console: colour dummy device 80x30
[0.00] console [tty0] enabled
[0.00] Lock dependency validator: Copyright (c) 2006 Red Hat, 
Inc., Ingo Molnar

[0.00] ... MAX_LOCKDEP_SUBCLASSES:  8
[0.00] ... MAX_LOCK_DEPTH:  48
[0.00] ... MAX_LOCKDEP_KEYS:8191
[0.00] ... CLASSHASH_SIZE:  4096
[0.00] ... MAX_LOCKDEP_ENTRIES: 16384
[0.00] ... MAX_LOCKDEP_CHAINS:  32768
[0.00] ... CHAINHASH_SIZE:  16384
[0.00]  memory used by lock dependency info: 3695 kB
[0.00]  per task-struct memory footprint: 1152 bytes
[0.002380] Calibrating delay loop... 2007.19 BogoMIPS (lpj=7839744)
[0.062591] pid_max: default: 32768 minimum: 301
[0.063201] Security Framework initialized
[0.063568] Mount-cache hash table entries: 512
[0.067138] CPU: Testing write buffer coherency: ok
[0.067962] Calibrating local timer... 491.91MHz.
[0.109649] L310 cache controller enabled
[0.109710] l2x0: 16 ways, CACHE_ID 0x41c4, AUX_CTRL 0x7e47, 
Cache size: 1048576 B

[0.186370] CPU1: Booted secondary processor
[0.186401] CPU1: Unknown IPI message 0x1
[0.216491] Brought up 2 CPUs
[0.216522] SMP: Total of 2 processors activated (3963.96 BogoMIPS).
[0.217681] devtmpfs: initialized
[0.224029] omap_hwmod: _populate_mpu_rt_base found no _mpu_rt_va for 
emif_fw
[0.224060] omap_hwmod: _populate_mpu_rt_base found no _mpu_rt_va for 
l3_instr
[0.224090] omap_hwmod: _populate_mpu_rt_base found no _mpu_rt_va for 
l3_main_1
[0.224121] omap_hwmod: _populate_mpu_rt_base found no _mpu_rt_va for 
l3_main_2
[0.224151] omap_hwmod: _populate_mpu_rt_base found no _mpu_rt_va for 
l4_abe
[0.224182] omap_hwmod: _populate_mpu_rt_base found no _mpu_rt_va for 
l4_cfg
[0.224212] omap_hwmod: _populate_mpu_rt_base found no _mpu_rt_va for 
l4_per
[0.224212] omap_hwmod: _populate_mpu_rt_base found no _mpu_rt_va for 
l4_wkup
[0.224243] omap_hwmod: _populate_mpu_rt_base found 

Re: Issues with repo --mirror

2011-06-06 Thread Paul Sokolovsky
Hello Nicolas,

On Thu, 2 Jun 2011 23:04:42 +0200
Dechesne, Nicolas n-deche...@ti.com wrote:

 Paul
 
 On Thu, Jun 2, 2011 at 9:24 AM, Paul Sokolovsky
 paul.sokolov...@linaro.orgwrote:
 
 
  This is even more interesting, with Google people confirming that
  repo --mirror works within some bounds and limitations:
 
 
  http://groups.google.com/group/repo-discuss/browse_thread/thread/401656c3ad0a4a0c
 
[]

 
 I have spent some time in the past with repo --mirror (we have
 internal mirrors within TI). After several attempts my conclusion was
 that it was not the best approach. the main problem is that repo
 --mirror expects that you give a manifest tree. If you have several
 branches in your manifest tree (like it's the case for the
 omapmanifest on git.omapzoom.org), repo sync will only sync the
 branch you've used initially. So if you have new or different trees
 on other branches they aren't sync'd. that pretty much means that you
 need 1 mirror for each manifest branch. (in fact I am the one that
 asked the repo --mirror question you've found!)

But, as far as I understood from the mailing list thread above, it's
possible for one mirror to contain different manifest branches, one
just need to sync them explicitly (unlike one would think mirror would
do). (That's what we do now, I just want to be sure we won't any
additional surprises soon.)

 
 so i ended it doing a git mirror, and I wrote this simple helper
 script https://github.com/ndechesne/git-mirror which can be used to
 mirror a complete 'git server' using gitweb. for example, you just
 need to add this in a cron:
 
 git-mirror -o /data/git/repositories/ -s http://git.omapzoom.org -g
 git:// git.omapzoom.org

Thanks, this looks interesting.

 
 and the script will mirror the server locally. everytime it runs:
 - it creates new trees that have appeared on the remote
 - updates all existing trees
 - removed trees that have disappeared from the remote.
 
 i have been using this script on several mirror (1 at every site)
 quite reliably for ~2 years. prior to that I was using repo sync and
 frequently had failures...

Nice, thanks much for sharing the experience! We'd probably still want
to use manifest as the source for what to mirror (that's the only
thing that our mirror service takes as input actually), but it's great
to know that using git clone --mirror works well with repo and actually
improves reliability.


 
 hope this helps.

--
Best regards,
Paul

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: [PATCH v5] sdio: optimized SDIO IRQ handling for single irq

2011-06-06 Thread Daniel Mack
On Wed, May 11, 2011 at 6:45 PM, Chris Ball c...@laptop.org wrote:
 Hi Per,

 On Wed, May 11 2011, Per Forlin wrote:
 From: Stefan Nilsson XK stefan.xk.nils...@stericsson.com

 If there is only 1 function interrupt registered it is possible to
 improve performance by directly calling the irq handler
 and avoiding the overhead of reading the CCCR registers.

 Signed-off-by: Per Forlin per.for...@linaro.org
 Acked-by: Ulf Hansson ulf.hans...@stericsson.com
 Reviewed-by: Nicolas Pitre nicolas.pi...@linaro.org
 ---
  drivers/mmc/core/sdio_irq.c |   33 -
  include/linux/mmc/card.h    |    1 +
  2 files changed, 33 insertions(+), 1 deletions(-)

 diff --git a/drivers/mmc/core/sdio_irq.c b/drivers/mmc/core/sdio_irq.c
 index bb192f9..a0890ac 100644
 --- a/drivers/mmc/core/sdio_irq.c
 +++ b/drivers/mmc/core/sdio_irq.c
 @@ -31,6 +31,17 @@ static int process_sdio_pending_irqs(struct mmc_card 
 *card)
  {
       int i, ret, count;
       unsigned char pending;
 +     struct sdio_func *func;
 +
 +     /*
 +      * Optimization, if there is only 1 function interrupt registered
 +      * call irq handler directly
 +      */
 +     func = card-sdio_single_irq;
 +     if (func) {
 +             func-irq_handler(func);
 +             return 1;
 +     }

       ret = mmc_io_rw_direct(card, 0, 0, SDIO_CCCR_INTx, 0, pending);
       if (ret) {
 @@ -42,7 +53,7 @@ static int process_sdio_pending_irqs(struct mmc_card *card)
       count = 0;
       for (i = 1; i = 7; i++) {
               if (pending  (1  i)) {
 -                     struct sdio_func *func = card-sdio_func[i - 1];
 +                     func = card-sdio_func[i - 1];
                       if (!func) {
                               printk(KERN_WARNING %s: pending IRQ for 
                                       non-existant function\n,
 @@ -186,6 +197,24 @@ static int sdio_card_irq_put(struct mmc_card *card)
       return 0;
  }

 +/* If there is only 1 function registered set sdio_single_irq */
 +static void sdio_single_irq_set(struct mmc_card *card)
 +{
 +     struct sdio_func *func;
 +     int i;
 +
 +     card-sdio_single_irq = NULL;
 +     if ((card-host-caps  MMC_CAP_SDIO_IRQ) 
 +         card-host-sdio_irqs == 1)
 +             for (i = 0; i  card-sdio_funcs; i++) {
 +                    func = card-sdio_func[i];
 +                    if (func  func-irq_handler) {
 +                            card-sdio_single_irq = func;
 +                            break;
 +                    }
 +            }
 +}
 +
  /**
   *   sdio_claim_irq - claim the IRQ for a SDIO function
   *   @func: SDIO function
 @@ -227,6 +256,7 @@ int sdio_claim_irq(struct sdio_func *func, 
 sdio_irq_handler_t *handler)
       ret = sdio_card_irq_get(func-card);
       if (ret)
               func-irq_handler = NULL;
 +     sdio_single_irq_set(func-card);

       return ret;
  }
 @@ -251,6 +281,7 @@ int sdio_release_irq(struct sdio_func *func)
       if (func-irq_handler) {
               func-irq_handler = NULL;
               sdio_card_irq_put(func-card);
 +             sdio_single_irq_set(func-card);
       }

       ret = mmc_io_rw_direct(func-card, 0, 0, SDIO_CCCR_IENx, 0, reg);
 diff --git a/include/linux/mmc/card.h b/include/linux/mmc/card.h
 index d8dffc9..4910dec 100644
 --- a/include/linux/mmc/card.h
 +++ b/include/linux/mmc/card.h
 @@ -191,6 +191,7 @@ struct mmc_card {
       struct sdio_cccr        cccr;           /* common card info */
       struct sdio_cis         cis;            /* common tuple info */
       struct sdio_func        *sdio_func[SDIO_MAX_FUNCS]; /* SDIO functions 
 (devices) */
 +     struct sdio_func        *sdio_single_irq; /* SDIO function when only 
 one IRQ active */
       unsigned                num_info;       /* number of info strings */
       const char              **info;         /* info strings */
       struct sdio_func_tuple  *tuples;        /* unknown common tuples */

 Thanks, looks good now -- pushed to mmc-next for .40.

This patch breaks libertas over SDIO, as the interrupt handler of that
driver is now called even though the hardware didn't signal any
interrupt condition. This is a problem for at least two reasons in
this case:

a) the libertas code is currently structured in a way that it calls
sdio_claim_irq() before everything is fully set up (which wasn't a
problem so far as the hardware has an own register to mask
interrupts). That results in a kernel Ooops as card-priv == NULL.

b) the libertas interrupt handler assumes that a received callback to
its interrupt handler signals activity per se
(card-priv-activty_detected = 1).


I have a patch ready for libertas that works around the first problem,
but I'm unsure if that's not fixing the wrong end. What the driver
really should do is poll the card's CCCR register to find out if there
was any interrupt at all and bail if that's not the case, but then
we're back to the implementation without this patch.

The other option is to revert the patch again.


Re: Android kernel git update frequency

2011-06-06 Thread Zach Pfeffer
Thanks for starting this topic Paul.

As we role out Gerrit CI we'll need to host all the components of the
Android build in Gerrit. Users will push their changes to Gerrit and
the changes will automatically get tested and merged after review.

It works pretty good once it all gets going.

As for the upstream.

We'll get the opportunity to work with the Gerrit folks to add an
upstream path to the tool. I have a flow chart in a slide from the
public plan review:

https://wiki.linaro.org/Cycles//PublicPlanReview?action=AttachFiledo=viewtarget=Android_Dev_Platform_11.11_Public_Plan.pdf

Slide:

Linaro CI Loop

-Zach


On 16 May 2011 14:11, John Stultz john.stu...@linaro.org wrote:
 On Mon, 2011-05-16 at 20:23 +0300, Paul Sokolovsky wrote:
 I'm just trying to wrap my mind on how we'll bootstrap Continuous
 Integration in the next cycle, which is not far away. So, I just would
 like to make sure that all teams involved are on the same line to make
 CI work effectively, i.e. that kernel team is able to update Android
 kernel regularly, infrastructure team has build system which produces
 Android images reliably, and validation team has all hooks needed to
 start testing them as soon as they are built.

 So bootstrapping wise from the kernel's perspective, it seems like using
 the linaro-android-2.6.38 tree to start would be fine. As soon as Nico
 opens the 2.6.39 tree, I'll work to get a linaro-android-2.6.39 tree
 available, and you can update your fetching scripts to pull from the new
 branch.

 From that point, I think we just need to sort out the communication
 paths. I can try to update the linaro-android tree at a fairly regular
 pace (I'm thinking weekly?) with more frequent updates on demand, should
 something like a fix be needed from Nico's tree. If there is a more
 specific frequency you'd like to see, please let me know.

 For the last cycle I've been somewhat slow at times, as it wasn't always
 clear that my work (merging, resolving collisions, initial testing) was
 getting used. This was mostly just starting pains as the platform build
 process was being worked out. But it helps motivate me to update more
 regularly if I can get some feedback as to how the last update performed
 in testing. As updating a tree multiple times without anyone pulling
 makes it seem like unnecessary extra effort.

 So, I guess validation team would lead on CI start-up sequence, when
 they have all needed infrastructure and testsuites integrated. In
 particular, I'm waiting from them for details on how build
 notifications should be communicated to the LAVA system.

 Do keep me updated!

 thanks
 -john



 ___
 linaro-dev mailing list
 linaro-dev@lists.linaro.org
 http://lists.linaro.org/mailman/listinfo/linaro-dev


___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread James Westby
On Thu, 2 Jun 2011 23:17:02 +0100, Ramana Radhakrishnan 
ramana.radhakrish...@linaro.org wrote:
 Sorry I'm getting into this conversation a bit late but is there also
 a need to figure out what toolchain was used to build this hwpack and
 the way in which the toolchain was configured (v7-a, neon, vfp ,
 vfpv3-d16) and what version of the toolchain was used. If this
 information is already captured or there is an easy way of getting back
 to this. This is if you think there is a use-case of regenerating the hwpack
 to investigate any issues that might come up

While this would be a useful thing to record it's not that easy given
that the toolchain used is a couple of steps removed from the hwpack.
It currently works like

  Source package - Binary package - Hardware pack

with the toolchain being used in the first translation. We would need to
record the toolchain used in the binary packages to provide this
information. There's currently no mechanism to do this generally, but
again if we are modifying the packaging of each piece to do this they
could run something to discover the toolchain information and store this
in a similar way to git-describe output used to identify the ref that
was built.

Thanks,

James

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: The linaro-2.6.39 kernel repository is now alive

2011-06-06 Thread Dave Martin
On Sat, Jun 4, 2011 at 2:17 PM, Tixy t...@yxit.co.uk wrote:
 On Thu, 2011-06-02 at 01:12 -0400, Nicolas Pitre wrote:
 Time to leave 2.6.38 behind and move on!  We now have a 2.6.39 based
 Linaro kernel which can be viewed here:

   http://git.linaro.org/gitweb?p=kernel/linux-linaro-2.6.39.git;a=summary

 or cloned from either of those:

   git://git.linaro.org/kernel/linux-linaro-2.6.39.git

   http://git.linaro.org/git/kernel/linux-linaro-2.6.39.git


 When building for OMAP there's a build error in smc91x.c which is fixed
 by http://permalink.gmane.org/gmane.linux.network/197474

 There are also build errors to do with DSS (mentioned elsewhere in this
 thread). A kernel can be successfully built after disabling the
 following config option:

 Device Drivers -- Graphics support -- OMAP2+ Display Subsystem support
 -- DPI support

 When booted on a Beagleboard-xM, the resulting kernel appears to hang
 after Starting kernel I haven't investigated any further.

 The .config I'm using is that described on the wiki at
 https://wiki.linaro.org/Resources/HowTo/KernelDeploy#From_Linaro_sources

Try disabling CONFIG_THUMB2_KERNEL and rebuilding.

If this does fix the problem, this suggests that this problem is
indeed Thumb-2 related.  I will have a go at digging into this
tomorrow.

Cheers
---Dave

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread James Westby
Hi,

Apologies for asking you directly what could probably be looked up, but
the spec isn't very easy to digest.

On Thu, 2 Jun 2011 16:59:46 -0500, Zach Pfeffer zach.pfef...@linaro.org wrote:
 PackageName: linux-linaro-omap 2.6.38-1002.3
 #https://launchpad.net/ubuntu/+source/linux-linaro-omap
 PackageDownloadLocation:
 https://launchpad.net/ubuntu/+archive/primary/+files/linux-linaro-omap_2.6.38.orig.tar.gz

This isn't the full source that was built. The source package has three
parts. Can we link to three things here? If we can only link to one it
should probably be the .dsc which is the description for the whole
thing.

 SourceInfo: uses Linux v2.6.38.1
 SourceInfo: uses linaro-linux-2.6.38-upstream-29Mar2011
 SourceInfo: uses (fill in patch1)
 SourceInfo: uses (fill in patch2)
 SourceInfo: uses (fill in patch3)

What's the constraints on what we put here? What's the use for it?

What's listed here seems fairly tricky to produce automatically.

 FileName: file1
 FileName: file2
 FileName: file3
 FileChecksum: SHA1: calculated

This is all the files in the source?

 Creator: Person: Zach Pfeffer (zach.pfef...@linaro.org)

What option do we have here? Given this is going to be produced
automatically I'm not sure we should blame you for all of the mistakes
;-)

 PackageLicenseDeclared: GPL-2.0

Is this is single choice field? Does it cover source or binary?

 PackageVerificationCode: (fill in SHA1 of all souyrce files)

SHA1 of all source calculated how?

 LicenseConcluded: GPL-2.0
 LicenseInfoFromFiles: GPL-2.0

What do these mean?

Thanks,

James

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread Fathi Boudra
On 6 June 2011 16:30, James Westby james.wes...@canonical.com wrote:
 We should put this info somewhere else (use Vcs-* perhaps?) so that we can 
 provide
 this information for other packages too.

You can add additional user-defined fields to the control file if it's
required or more convenient.

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread Alexander Sack
On Fri, Jun 3, 2011 at 12:17 AM, Ramana Radhakrishnan
ramana.radhakrish...@linaro.org wrote:
 On 01/06/11 19:41, Christian Robottom Reis wrote:
 Hello there,

      This week I initiated a confused conversation during the techleads
 call about having a way to describe what the hardware pack was built
 from. We had a couple of false starts but I think we agreeing that there
 needs to be some form of manifest that describes what the hardware pack
 contains.


 Sorry I'm getting into this conversation a bit late but is there also
 a need to figure out what toolchain was used to build this hwpack and
 the way in which the toolchain was configured (v7-a, neon, vfp ,
 vfpv3-d16) and what version of the toolchain was used. If this
 information is already captured or there is an easy way of getting back
 to this. This is if you think there is a use-case of regenerating the hwpack
 to investigate any issues that might come up

Is there a gcc fingerprints in binaries that we could use to extract
the toolchain info?

Otherwise, we probably would have to fiddle this out of the build logs
and so on and it feels like quite a challenge to get this right. e.g.
some packages work around toolchain bugs by compiling objects, so's
and binaries with non-default compiler flags etc. so even if we try to
track this manually, everything short of having that info directly in
the binaries would yield to inaccurate info is my guess.

-- 

 - Alexander

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread James Westby
On Mon, 6 Jun 2011 16:45:35 +, Fathi Boudra fathi.bou...@linaro.org wrote:
 On 6 June 2011 16:30, James Westby james.wes...@canonical.com wrote:
  We should put this info somewhere else (use Vcs-* perhaps?) so that we can 
  provide
  this information for other packages too.
 
 You can add additional user-defined fields to the control file if it's
 required or more convenient.

I'm well aware of that, thanks.

However, automatic insertion of generated new fields is not that easy,
and can cause problems when interacting with e.g. version control.

In addition the information is used in a variety of places, and if the
rules for how to specify where the information end up don't work for you
use case you are forced to push the information in to places it doesn't
really belong, at best causing bloat.

Thanks,

James

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread Zach Pfeffer
On 6 June 2011 11:45, James Westby james.wes...@canonical.com wrote:
 Hi,

 Apologies for asking you directly what could probably be looked up, but
 the spec isn't very easy to digest.

 On Thu, 2 Jun 2011 16:59:46 -0500, Zach Pfeffer zach.pfef...@linaro.org 
 wrote:
 PackageName: linux-linaro-omap 2.6.38-1002.3
 #https://launchpad.net/ubuntu/+source/linux-linaro-omap
 PackageDownloadLocation:
 https://launchpad.net/ubuntu/+archive/primary/+files/linux-linaro-omap_2.6.38.orig.tar.gz

 This isn't the full source that was built. The source package has three
 parts. Can we link to three things here? If we can only link to one it
 should probably be the .dsc which is the description for the whole
 thing.

For reference:

http://www.spdx.org/system/files/spdx-draft20110516_0.pdf

Right now the spec has this as:

4.3.3Cardinality: Mandatory, one.

Kate would have to comment if this could change to:

4.3.3Cardinality: Mandatory, one or more.



 SourceInfo: uses Linux v2.6.38.1
 SourceInfo: uses linaro-linux-2.6.38-upstream-29Mar2011
 SourceInfo: uses (fill in patch1)
 SourceInfo: uses (fill in patch2)
 SourceInfo: uses (fill in patch3)

 What's the constraints on what we put here? What's the use for it?

The spec says:

4.6Source Information
4.6.1Purpose: This is a free form text field that contains additional
comments about the origin of the package. For instance, this field
might include comments indicating whether the package been pulled from
a source code management system or has been repackaged.
4.6.2Intent: Here, by providing a freeform field, reviewers can
provide any additional information to describe any anomalies, or
discoveries, in the determination of the origin of the package.
4.6.3Cardinality: Optional, one
4.6.4Data Format: single line of free form text
4.6.5Tag: SourceInfo
Example:
SourceInfo: uses glibc-2_11-branch from git://sourceware.org/git/glibc.git.


 What's listed here seems fairly tricky to produce automatically.

What part do you think would be tricky?


 FileName: file1
 FileName: file2
 FileName: file3
 FileChecksum: SHA1: calculated

 This is all the files in the source?

Yeah.


 Creator: Person: Zach Pfeffer (zach.pfef...@linaro.org)

 What option do we have here? Given this is going to be produced
 automatically I'm not sure we should blame you for all of the mistakes

Ha! This is just the Creator of the SPDX file. It will probably become
the PoC. Kate is there a specific field for, ask this person questions
about the package? Perhaps we need

SpdxCreator:  Person: Zach Pfeffer (zach.pfef...@linaro.org)
PackageCreator: Person: Not Zach Pfeffer :)

 ;-)

 PackageLicenseDeclared: GPL-2.0

 Is this is single choice field? Does it cover source or binary?

You link all the licenses together with ANDs and ORs. Looks like it
covers both, Kate?


 PackageVerificationCode: (fill in SHA1 of all souyrce files)

 SHA1 of all source calculated how?

4.5.4Algorithm:
verificationcode = 0
filelist = “”
for all files in package {
if file is an “excludes” file, skip it /* exclude SPDX analysis file itself */
appended filelist with “SHA1(file) || string(file)”
}
sort filelist in ascending order by SHA1 value
verificationcode = SHA1(filelist)


 LicenseConcluded: GPL-2.0

From the spec:

The licensing that the preparer of this SPDX document has concluded,
based on the evidence, actual applies to the package.

I think this is where the lawyer would say, this is the license.

 LicenseInfoFromFiles: GPL-2.0

This is a field that has all the license found in the package.


 What do these mean?

 Thanks,

 James


___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: The linaro-2.6.39 kernel repository is now alive

2011-06-06 Thread Andy Green

On 06/06/2011 05:44 PM, Somebody in the thread at some point said:


The .config I'm using is that described on the wiki at
https://wiki.linaro.org/Resources/HowTo/KernelDeploy#From_Linaro_sources


Try disabling CONFIG_THUMB2_KERNEL and rebuilding.

If this does fix the problem, this suggests that this problem is
indeed Thumb-2 related.  I will have a go at digging into this
tomorrow.


FWIW in my tree's reference omap4_defconfig, CONFIG_THUMB2_KERNEL is 
disabled (this kernel just stops at the end of initrd scripts, although 
twice thisafternoon during dozens of boots I saw it continue as if 
nothing was wrong and complete a normal boot, whatever that means).


On omap2plus_defconfig, CONFIG_THUMB2_KERNEL doesn't appear in the 
config because CPU_V6 is set.  And that's the guy who blows SIGILL.


-Andy

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread James Westby
On Mon, 6 Jun 2011 14:37:18 -0500, Zach Pfeffer zach.pfef...@linaro.org wrote:
 The spec says:
 
 4.6Source Information
 4.6.1Purpose: This is a free form text field that contains additional
 comments about the origin of the package. For instance, this field
 might include comments indicating whether the package been pulled from
 a source code management system or has been repackaged.
 4.6.2Intent: Here, by providing a freeform field, reviewers can
 provide any additional information to describe any anomalies, or
 discoveries, in the determination of the origin of the package.
 4.6.3Cardinality: Optional, one
 4.6.4Data Format: single line of free form text
 4.6.5Tag: SourceInfo
 Example:
 SourceInfo: uses glibc-2_11-branch from git://sourceware.org/git/glibc.git.

So it looks like we'd have to define our own microformat here (though
it's going to be consumed by humans at least to start with, so
consistency doesn't really matter at this stage)

  What's listed here seems fairly tricky to produce automatically.
 
 What part do you think would be tricky?

It depends when we are generating this file, but the format of what you
specify seems a little clever for humans.

If the content is freeform then we can obviously choose something that
is easy to generate.

 
  FileName: file1
  FileName: file2
  FileName: file3
  FileChecksum: SHA1: calculated
 
  This is all the files in the source?
 
 Yeah.

I guess the cost of that in a kernel build is pretty small.

You only list one FileChecksum here. Can that line follow every FileName
line?

  LicenseConcluded: GPL-2.0
 
 From the spec:
 
 The licensing that the preparer of this SPDX document has concluded,
 based on the evidence, actual applies to the package.
 
 I think this is where the lawyer would say, this is the license.

Yeah. Again my question is source or binary?

I presume this can be an AND/OR list again?

  LicenseInfoFromFiles: GPL-2.0
 
 This is a field that has all the license found in the package.

Just a dumping ground of every license found?


My overally impression is that this is rather a large additional
overhead to just be able to say

  the kernel was built from 0A2E345 of
  git://git.linaro.org/jcrigby/linux-linaro-natty.git

which is the main thrust of kiko's request as I understand it.

Debian packages already contain licensing info (they also have a
proposed standard to make that info machine readable.) Is it worth
Linaro's time to try and move everything to one of these new formats at
this stage?

Thanks,

James

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: 2 cross-development toochain quesions

2011-06-06 Thread Michael Hope
On Sat, Jun 4, 2011 at 3:02 AM, Bernard Ogden bernard.og...@arm.com wrote:
 I was asked to take a look at the blueprints relating to cross-toolchain 
 development (e.g. 
 https://blueprints.launchpad.net/ubuntu/+spec/linaro-platforms-o-linaro-cross-toolchain-stories)
  in advance of Monday's 'Android and Developer Platform' plan review call. I 
 just have two questions to ask for now:

 1) I would like confirmation that the Windows binaries will be 'windows 
 native' and standalone i.e. customer does not need to install 
 MSYS/cygwin/etc. I got the impression that this is the intention, but am not 
 100% clear that it's a requirement.

The build will be Windows native and self contained.  Cygwin will not
be used and any mingw support libraries will be minimal and shipped
with the binary.

The goal is to have something that is usable from a NT CMD prompt,
cygwin prompt, and Eclipse.

 2) Will Linaro test the toolchains on Red Hat Enterprise? RHEL 5 is one the 
 supported platforms for DS-5, so it would be useful to know if the toolchain 
 will be validated on that platform, or if we need to test ourselves.

Not at the moment but we might slip it in to meet the requirement of
working on the top four development Linuxes.  As Marcin says, we'd
test under CentOS instead of Redhat.

-- Michael

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread Kate Stewart
On Mon, 2011-06-06 at 16:37 -0400, James Westby wrote:
 On Mon, 6 Jun 2011 14:37:18 -0500, Zach Pfeffer zach.pfef...@linaro.org 
 wrote:
  The spec says:
  
  4.6Source Information
  4.6.1Purpose: This is a free form text field that contains additional
  comments about the origin of the package. For instance, this field
  might include comments indicating whether the package been pulled from
  a source code management system or has been repackaged.
  4.6.2Intent: Here, by providing a freeform field, reviewers can
  provide any additional information to describe any anomalies, or
  discoveries, in the determination of the origin of the package.
  4.6.3Cardinality: Optional, one
  4.6.4Data Format: single line of free form text
  4.6.5Tag: SourceInfo
  Example:
  SourceInfo: uses glibc-2_11-branch from git://sourceware.org/git/glibc.git.
 
 So it looks like we'd have to define our own microformat here (though
 it's going to be consumed by humans at least to start with, so
 consistency doesn't really matter at this stage)

If there are some pretty common trends, we can look at adding fields to
support.  Its in beta right now so this sort of feedback can be gathered
after all ;)

 
   What's listed here seems fairly tricky to produce automatically.
  
  What part do you think would be tricky?
 
 It depends when we are generating this file, but the format of what you
 specify seems a little clever for humans.
 
 If the content is freeform then we can obviously choose something that
 is easy to generate.
 
  
   FileName: file1
   FileName: file2
   FileName: file3
   FileChecksum: SHA1: calculated
  
   This is all the files in the source?
  
  Yeah.
 
 I guess the cost of that in a kernel build is pretty small.
 
 You only list one FileChecksum here. Can that line follow every FileName
 line?

After every FileName: there should be a FileChecksum: field.

For each file listed in the package,   the fields that are mandatory and
should show up are: 
  - FileName:
  - FileChecksum:
  - LicenseConcluded:
  - LicensesInfoInFile:
  - CopyrightText:

The rest are optional,  and can be included or not.

   LicenseConcluded: GPL-2.0
  
  From the spec:
  
  The licensing that the preparer of this SPDX document has concluded,
  based on the evidence, actual applies to the package.
  
  I think this is where the lawyer would say, this is the license.
 
 Yeah. Again my question is source or binary?

This is captured as an optional field (FileType:) at the file level.

 I presume this can be an AND/OR list again?
 
   LicenseInfoFromFiles: GPL-2.0
  
  This is a field that has all the license found in the package.
 
 Just a dumping ground of every license found?

If a package has multiple file, its a way of having a summary of all the
licenses encountered in those files.   Ideally the LicenseConcluded: at
the package level,  will match the LicenseInfoFromFiles:.   By making
this visible, its hoped over time that the package owners will look into
clearing up the ambiguities.

 
 My overally impression is that this is rather a large additional
 overhead to just be able to say
 
   the kernel was built from 0A2E345 of
   git://git.linaro.org/jcrigby/linux-linaro-natty.git
 
 which is the main thrust of kiko's request as I understand it.

If you just want to say the build origins, then yes its overkill for
that.  If you want to be able to pass on a package that has a set of
patches off a known public kernel (with its own SPDX file ;) ) then it
permits the licensing and copyrights to be clearly articulated. 

 Debian packages already contain licensing info (they also have a
 proposed standard to make that info machine readable.) Is it worth
 Linaro's time to try and move everything to one of these new formats at
 this stage?

Debian package standard has no way to track the accuracy of the file
level information, so it could change underneath without there being a
way of detecting it - which causes problems.   If you look at:
http://dep.debian.net/deps/dep5/ (machine readable info),  you'll see
this aspect missing (the wildcards preclude it).  The DEP5 proposal was
analyzed extensively last year but commercial companies didn't feel they
could rely on the accuracy information provided through it, but there is
a lot of common ground on the fields provided, file paragraphs, separate
licensing section, etc.   We've had a team of volunteer corporate
lawyers (Motorola, HP, etc. ) working on the SPDX for the last year and
reviewing and modifying the proposed fields extensively. 

Kate



___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread James Westby
Hi Kate,

Thanks for the information. I have some responses inline. To be clear
I'm veering in to commentary on the format itself for a lot of this,
rather than specific statements on whether I think Linaro should use it
or not.

On Mon, 06 Jun 2011 18:05:54 -0500, Kate Stewart kate.stew...@canonical.com 
wrote:
 If there are some pretty common trends, we can look at adding fields to
 support.  Its in beta right now so this sort of feedback can be gathered
 after all ;)

That's good to know.

 After every FileName: there should be a FileChecksum: field.
 
 For each file listed in the package,   the fields that are mandatory and
 should show up are: 
   - FileName:
   - FileChecksum:
   - LicenseConcluded:
   - LicensesInfoInFile:
   - CopyrightText:
 
 The rest are optional,  and can be included or not.

You say for each file listed in the package, is it mandatory to list
all files? It seems to me that it would be much better to allow for
gradual implementation of what will be a large job for some projects, so
I hope it is optional.

I guess it's intended for the format to always be output from some tool
rather than hand-edited, unless it's possible to put glob patterns or
similar in the FileName field?

LicenseConcluded: GPL-2.0
   
   From the spec:
   
   The licensing that the preparer of this SPDX document has concluded,
   based on the evidence, actual applies to the package.
   
   I think this is where the lawyer would say, this is the license.
  
  Yeah. Again my question is source or binary?
 
 This is captured as an optional field (FileType:) at the file level.

Well, this applies to the whole package by my understanding, so the
particular file types may not matter.

Take for instance a package which is dual licensed GPL-2 and something
else at the source level. If you choose to build this package and link
it against GPL-2 only code then some people's interpretation of the GPL
would say that the binary is GPL-2 only, despite the source being dual
licensed.

Perhaps that's a minority opinion, but I expect there are other cases
where the source and binary licenses may not match, so I am wondering if
the expectation that this defines the source or binary concluded
license.

Perhaps what you are saying is that there will be different SPDX files
for the source and binary, and the difference would be captured there?

  My overally impression is that this is rather a large additional
  overhead to just be able to say
  
the kernel was built from 0A2E345 of
git://git.linaro.org/jcrigby/linux-linaro-natty.git
  
  which is the main thrust of kiko's request as I understand it.
 
 If you just want to say the build origins, then yes its overkill for
 that.  If you want to be able to pass on a package that has a set of
 patches off a known public kernel (with its own SPDX file ;) ) then it
 permits the licensing and copyrights to be clearly articulated. 

Yeah. Is the kernel going to be released with an SPDX file that we can
base our work on?

 Debian package standard has no way to track the accuracy of the file
 level information, so it could change underneath without there being a
 way of detecting it - which causes problems.   If you look at:
 http://dep.debian.net/deps/dep5/ (machine readable info),  you'll see
 this aspect missing (the wildcards preclude it).  The DEP5 proposal was
 analyzed extensively last year but commercial companies didn't feel they
 could rely on the accuracy information provided through it, but there is
 a lot of common ground on the fields provided, file paragraphs, separate
 licensing section, etc.   We've had a team of volunteer corporate
 lawyers (Motorola, HP, etc. ) working on the SPDX for the last year and
 reviewing and modifying the proposed fields extensively. 

Sure, I don't doubt that a lot of effort has been put in to SPDX, and I
don't want to get in to a debate about whether it is a good idea to have
wildcards or not. My point was more that I don't see it being worth
Linaro engineering time to push for adoption of either format inside
Debian packages at this time.

Thanks,

James

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev


Re: What do we want our hwpack sources

2011-06-06 Thread Kate Stewart
On Mon, 2011-06-06 at 20:19 -0400, James Westby wrote:
 On Mon, 06 Jun 2011 18:05:54 -0500, Kate Stewart kate.stew...@canonical.com 
 wrote:
  After every FileName: there should be a FileChecksum: field.
  
  For each file listed in the package,   the fields that are mandatory and
  should show up are: 
- FileName:
- FileChecksum:
- LicenseConcluded:
- LicensesInfoInFile:
- CopyrightText:
  
  The rest are optional,  and can be included or not.
 
 You say for each file listed in the package, is it mandatory to list
 all files? It seems to me that it would be much better to allow for
 gradual implementation of what will be a large job for some projects, so
 I hope it is optional.

Afraid not.  Each file gets in a package/tarball/what ever you choose
to group together,  gets its own file name listed.  Package could be
interpreted as tarball equally well as a .deb.  

So, yeah, its a large job for some projects.   Problem is that right now
alot of folks are doing the work in multiple formats already, as a
necessary condition of license compliance for shipping code.   So, some
of the original files may not be produced by the project itself, but
rather by some 3rd party, that then can be 'reviewed' and signed off by
others.  

Yes, tools will help.   I'd like to get some open source tools available
to do the generation,  and am working with Ninka and FOSSology on some
prototypes.  (help is always welcome ;) ).  There are some commercial
tool providers who have built up plans to produce the RDF varient of
files already with their tools - BlackDuck, Open Logic, Protecode are
all active participants.  Tag value and the RDF have been designed to be
interchangeable for this reason.
 
 I guess it's intended for the format to always be output from some tool
 rather than hand-edited, unless it's possible to put glob patterns or
 similar in the FileName field?

For small projects or even single binary files that get packaged,  it
should be possible to hand generate.  For larger packages with multiple
source files, yeah, tools are going to be the key here.  See comments
above.  ;)

 
 LicenseConcluded: GPL-2.0

From the spec:

The licensing that the preparer of this SPDX document has concluded,
based on the evidence, actual applies to the package.

I think this is where the lawyer would say, this is the license.
   
   Yeah. Again my question is source or binary?
  
  This is captured as an optional field (FileType:) at the file level.
 
 Well, this applies to the whole package by my understanding, so the
 particular file types may not matter.

Actually if you're shipping a binary file as its own package, like the
linux kernel, then its just a package with one file,  there's just one
file, and the FileType: applies.   If you're shipping a source tar ball
with 30K+ files, in it, then the Type doesn't make much sense at the
Package level, since there could be multiple types involved.  There are
firmware binaries in the linux kernel sources, for instance. ;)  

 
 Take for instance a package which is dual licensed GPL-2 and something
 else at the source level. If you choose to build this package and link
 it against GPL-2 only code then some people's interpretation of the GPL
 would say that the binary is GPL-2 only, despite the source being dual
 licensed.

This is the sort of argument that lead us down the notion of
ConcludedLicense vs. LicenseInfoInFile  (at the file and package
levels). 

 Perhaps that's a minority opinion, but I expect there are other cases
 where the source and binary licenses may not match, so I am wondering if
 the expectation that this defines the source or binary concluded
 license.

Yup, its not just source and binary though that cause conflicts. BTW.

 Perhaps what you are saying is that there will be different SPDX files
 for the source and binary, and the difference would be captured there?

We're still figuring out all the use cases, but I would expect the
source to be packaged separately from the binary (thinking about how the
archive work, this seems to be the case in practice),  and there would
be different SPDX files as a result.

   My overally impression is that this is rather a large additional
   overhead to just be able to say
   
 the kernel was built from 0A2E345 of
 git://git.linaro.org/jcrigby/linux-linaro-natty.git
   
   which is the main thrust of kiko's request as I understand it.
  
  If you just want to say the build origins, then yes its overkill for
  that.  If you want to be able to pass on a package that has a set of
  patches off a known public kernel (with its own SPDX file ;) ) then it
  permits the licensing and copyrights to be clearly articulated. 
 
 Yeah. Is the kernel going to be released with an SPDX file that we can
 base our work on?

That's been the request from others as well.  Am working with
Ninka/FOSSology to see if we can make it happen in an Open Source way,
and then it will be a packaging 

Re: current status -- releases^H recipes needed

2011-06-06 Thread Zygmunt Krynicki

W dniu 07.06.2011 02:16, Zygmunt Krynicki pisze:


I think at this point we should do some releases. If you agree Zygmunt,
can you do that? (a) because it's nearly the end of my work day and (b)
you're more experienced at it :) I guess this means uploading to pypi
and building in a ppa? Do you upload releases to lp too?


I'll release everything after I get myself together (staying up past 3AM
again).


Did this happen yet? It doesn't look like it.


No :/

I got stuck making the process easier. I'll post details soon.


I got unstuck but more work is required.

I wrote something that assists ISV developers (like us) to develop, 
release and publish for multiple ubuntu versions efficiently.


You can find the early version (in shell, yuck) at: 
lp:~zkrynicki/+junk/lava-project-ci.


Have a look at the README file and at the recipes.

Before you can start using this tool please build each pbuilder with 
lava-project-ci create $distro (for distro: lucid, maverick, natty).


After that you can build the 'versiontools' package and see the recipes 
for more hints. I started porting all our packages over. I'll finish 
this tomorrow and finalize the release. HELP wanted here! Please port 
django (look at my code branches to lookup the relevant django backport) 
to speed up the process.



Best regards
ZK

___
linaro-dev mailing list
linaro-dev@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-dev