ubi cloning

2014-05-12 Thread Erez D
Hi

i need to clone a nand flash. which has ubifs on it

doing 'dd' didn't work as the source and dest have different bad sectors.

is there an easy way to clone a ubifs nand-flash ?


thanks
erez.
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il


Re: ubi cloning

2014-05-12 Thread Amos Shapira
How about ddrescue (the GNU one I think, there are multiple implementations
with same name) into an image file then try to fix the fs around the bad
sectors?


On 12 May 2014 18:46, Erez D erez0...@gmail.com wrote:

 Hi

 i need to clone a nand flash. which has ubifs on it

 doing 'dd' didn't work as the source and dest have different bad sectors.

 is there an easy way to clone a ubifs nand-flash ?


 thanks
 erez.

 ___
 Linux-il mailing list
 Linux-il@cs.huji.ac.il
 http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il




-- 
 [image: View my profile on LinkedIn]
http://www.linkedin.com/in/gliderflyer
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il


Re: ubi cloning

2014-05-12 Thread Erez D
On Mon, May 12, 2014 at 11:51 AM, Amos Shapira amos.shap...@gmail.comwrote:

 How about ddrescue (the GNU one I think, there are multiple
 implementations with same name) into an image file then try to fix the fs
 around the bad sectors?

 ubifs already handles the bad sectors, and i do not want to mess with it.


 On 12 May 2014 18:46, Erez D erez0...@gmail.com wrote:

  Hi

 i need to clone a nand flash. which has ubifs on it

 doing 'dd' didn't work as the source and dest have different bad sectors.

 is there an easy way to clone a ubifs nand-flash ?


 thanks
 erez.

 ___
 Linux-il mailing list
 Linux-il@cs.huji.ac.il
 http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il




 --
  [image: View my profile on LinkedIn]
 http://www.linkedin.com/in/gliderflyer

___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il


Re: ubi cloning

2014-05-12 Thread Baruch Siach
Hi Erez,

On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote:
 i need to clone a nand flash. which has ubifs on it
 
 doing 'dd' didn't work as the source and dest have different bad sectors.

dd is not the way to go with raw NAND flash access; it's not aware of bad 
blocks.

 is there an easy way to clone a ubifs nand-flash ?

You may be able get a working system using nanddump/nandwrite (see 
http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but read 
the whole thread). Generally, tough, this is not what you want to do with 
UBI/UBIFS. You should use ubiformat on the target, and copy the content with 
tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat.

baruch

-- 
 http://baruch.siach.name/blog/  ~. .~   Tk Open Systems
=}ooO--U--Ooo{=
   - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il -

___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il


Re: ubi cloning

2014-05-12 Thread Erez D
On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il wrote:

 Hi Erez,

 On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote:
  i need to clone a nand flash. which has ubifs on it
 
  doing 'dd' didn't work as the source and dest have different bad sectors.

 dd is not the way to go with raw NAND flash access; it's not aware of bad
 blocks.

  is there an easy way to clone a ubifs nand-flash ?

 You may be able get a working system using nanddump/nandwrite (see
 http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but
 read
 the whole thread). Generally, tough, this is not what you want to do with
 UBI/UBIFS. You should use ubiformat on the target, and copy the content
 with
 tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat
 .

will tar preserve uid/gid hard links, special files, /dev extended attr etc
?


 baruch

 --
  http://baruch.siach.name/blog/  ~. .~   Tk Open
 Systems
 =}ooO--U--Ooo{=
- bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il -

___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il


Re: ubi cloning

2014-05-12 Thread Baruch Siach
Hi Erez,

On Mon, May 12, 2014 at 12:14:14PM +0300, Erez D wrote:
 On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il wrote:
  On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote:
   i need to clone a nand flash. which has ubifs on it
  
   doing 'dd' didn't work as the source and dest have different bad sectors.
 
  dd is not the way to go with raw NAND flash access; it's not aware of bad
  blocks.
 
   is there an easy way to clone a ubifs nand-flash ?
 
  You may be able get a working system using nanddump/nandwrite (see
  http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but
  read
  the whole thread). Generally, tough, this is not what you want to do with
  UBI/UBIFS. You should use ubiformat on the target, and copy the content
  with
  tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat

 will tar preserve uid/gid hard links, special files, /dev

Yes, by default.

 extended attr etc ?

Yes. Use --xattrs.

baruch

-- 
 http://baruch.siach.name/blog/  ~. .~   Tk Open Systems
=}ooO--U--Ooo{=
   - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il -

___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il


Re: ubi cloning

2014-05-12 Thread Erez D
On Mon, May 12, 2014 at 12:28 PM, Baruch Siach bar...@tkos.co.il wrote:

 Hi Erez,

 On Mon, May 12, 2014 at 12:14:14PM +0300, Erez D wrote:
  On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il
 wrote:
   On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote:
i need to clone a nand flash. which has ubifs on it
   
doing 'dd' didn't work as the source and dest have different bad
 sectors.
  
   dd is not the way to go with raw NAND flash access; it's not aware of
 bad
   blocks.
  
is there an easy way to clone a ubifs nand-flash ?
  
   You may be able get a working system using nanddump/nandwrite (see
   http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but
   read
   the whole thread). Generally, tough, this is not what you want to do
 with
   UBI/UBIFS. You should use ubiformat on the target, and copy the content
   with
   tar. See
 http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat
 
  will tar preserve uid/gid hard links, special files, /dev

 Yes, by default.

  extended attr etc ?

 Yes. Use --xattrs.

 baruch


thanks, i'll try that.

can I ubiformat + untar from u-boot ?


 --
  http://baruch.siach.name/blog/  ~. .~   Tk Open
 Systems
 =}ooO--U--Ooo{=
- bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il -

___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il


Re: ubi cloning

2014-05-12 Thread Baruch Siach
Hi Erez,

On Mon, May 12, 2014 at 02:14:34PM +0300, Erez D wrote:
 On Mon, May 12, 2014 at 12:28 PM, Baruch Siach bar...@tkos.co.il wrote:
  On Mon, May 12, 2014 at 12:14:14PM +0300, Erez D wrote:
   On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il
  wrote:
On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote:
 i need to clone a nand flash. which has ubifs on it

 doing 'dd' didn't work as the source and dest have different bad
  sectors.
   
dd is not the way to go with raw NAND flash access; it's not aware of
  bad
blocks.
   
 is there an easy way to clone a ubifs nand-flash ?
   
You may be able get a working system using nanddump/nandwrite (see
http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but
read
the whole thread). Generally, tough, this is not what you want to do
  with
UBI/UBIFS. You should use ubiformat on the target, and copy the content
with
tar. See
  http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat
  
   will tar preserve uid/gid hard links, special files, /dev
 
  Yes, by default.
 
   extended attr etc ?
 
  Yes. Use --xattrs.
 
  baruch
 
 thanks, i'll try that.
 
 can I ubiformat + untar from u-boot ?

I don't see support for either in mainline U-Boot. Barebox supports ubiformat 
but not tar extraction.

Your best option is to boot into RAM using a kernel combined with a minimal 
Busybox based initramfs, and extract you tar from there. Note tough that 
Busybox tar does not support extended attributes, so you must use GNU tar for 
this. Buildroot can generate a minimal initramfs image for you quite easily.

baruch

-- 
 http://baruch.siach.name/blog/  ~. .~   Tk Open Systems
=}ooO--U--Ooo{=
   - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il -

___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il


Re: Announce: OSv, a new open-source operating system for virtual machines

2014-05-12 Thread Nadav Har'El
On Mon, Sep 16, 2013, Nadav Har'El wrote about Announce: OSv, a new 
open-source operating system for virtual machines:
 Hi, today we've made the first release of OSv, a new operating system for
 running applications on virtual machines.
 
 OSv is free software, released under the BSD license, and you can find it in
 https://github.com/cloudius-systems/osv and http://www.osv.io.
 There is also a mailing list: osv-...@googlegroups.com.

For those interested in meeting some of the OSv developers, shortly
hearing about it and trying it on their own laptop and their own
application, we are holding a meetup on Wednesday May 28th, 5:30pm,
in our office in Herzliyya:

http://www.meetup.com/OSv-Developer-Meetup/events/181683582/

It's a free meeting (of course), but we'll appreciate it if people RSVP
on the meetup.com site so we'll have an estimate on how many are coming.

See you,
Nadav.

 
 These days, most applications running on virtual machines in the cloud run
 on top of Linux. We all love Linux, but as an all-encompassing operating
 system for everything from phones to supercomputers, Linux was never
 really designed for virtual machines; It is big and complex, and it
 offers features (such as multi-user and multi-process) which are today
 made redundant by the hypervisor and slow it down. Linux's APIs are many
 times set in stone by decades of legacy code.
 All these cost in application performance, and make it harder to innovate.
 
 This is why we developed OSv, a new operating system designed to run
 a single application on a virtual machine. As it runs a single application
 there is no need for kernel-userspace isolation, reducing context switch
 costs and unnecessary copying. A design from scratch allowed us to
 experiment with new ideas like lock-free mutexes (solving the Lock-Holder
 Preemption problem that plagues operating systems on virtual machines),
 extremely fast context switches, Van Jacobson's network channels (see
 http://www.lemis.com/grog/Documentation/vj/lca06vj.pdf), and more.
 Also, OSv is released under the more permissive BSD license (not GPL
 like Linux), is tiny compared to Linux, and takes less than one second
 to boot and start the user's application.
 
 OSv can run ordinary Linux shared objects, such as, for example, an
 unmodified JVM (e.g., OpenJDK) executable, and of course on that you can
 run any application written in Java, JRuby , Clojure, or any other JVM
 language. Even at this early stage of OSv's development, OSv can already
 successfully run several interesting workloads such as Netperf, Memcached,
 Cassandra and SpecJVM - and usually match or even beat Linux's performance.
 
 Another refreshing feature of OSv is that is written in C++.
 It's been 40 years since Unix was (re)written in C, and the time has
 come for something better.
 C++ is not about writing super-complex type hierarchies (as some people
 might have you believe). Rather, it allowed us to write shorter code
 with less boiler-plate repetition and less chances for bugs. It allowed
 us to more easily reuse quality code and data structures. And using
 newly standardized C++11 features, we were able to write safe concurrent
 code with standard language features instead of processor-specific
 hacks. And all of this with zero performance overheads - most of C++'s
 features, most notably templates, are compile-time features which result
 in no run-time overhead compared to C code.
 
 OSv was developed by Cloudius Systems, a small Israeli startup led by
 Dor Laor and Avi Kivity (of KVM fame) but it is an open-source project -
 developed since its inception on github
 (https://github.com/cloudius-systems/osv), and released under the BSD
 license. We would like to take this opportunity to invite everyone to use
 OSv, and to help drive its development forward. OSv is a fantastic
 playground for kernel developers, and also for people involved in cloud
 development, devops, and so on. Tell us what your dream VM operating
 system will do, and maybe your dream will come true :-) Maybe you can even
 help us make that dream come true.
 
 If you want to try OSv, check out the announcement and usage instructions
 on the OSv mailing list:
 https://groups.google.com/forum/#!topic/osv-dev/enqdqN2A0as
 
 
 -- 
 Nadav Har'El|  Monday, Sep 16 2013, 13 Tishri 5774
 n...@math.technion.ac.il 
 |-
 Phone +972-523-790466, ICQ 13349191 |A computer once beat me at chess, but it
 http://nadav.harel.org.il   |was no match for me at kickboxing.

-- 
Nadav Har'El|   Monday, May 12 2014, 12 Iyyar 5774
n...@math.technion.ac.il |-
Phone +972-523-790466, ICQ 13349191 |Politics, n: from Greek, poly=many,
http://nadav.harel.org.il   |ticks=blood sucking parasites.

___
Linux-il mailing list
Linux-il@cs.huji.ac.il

Re: ubi cloning

2014-05-12 Thread Erez D
thanks for your help


On Mon, May 12, 2014 at 2:53 PM, Baruch Siach bar...@tkos.co.il wrote:

 Hi Erez,

 On Mon, May 12, 2014 at 02:14:34PM +0300, Erez D wrote:
  On Mon, May 12, 2014 at 12:28 PM, Baruch Siach bar...@tkos.co.il
 wrote:
   On Mon, May 12, 2014 at 12:14:14PM +0300, Erez D wrote:
On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il
   wrote:
 On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote:
  i need to clone a nand flash. which has ubifs on it
 
  doing 'dd' didn't work as the source and dest have different bad
   sectors.

 dd is not the way to go with raw NAND flash access; it's not aware
 of
   bad
 blocks.

  is there an easy way to clone a ubifs nand-flash ?

 You may be able get a working system using nanddump/nandwrite (see
 http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024,
 but
 read
 the whole thread). Generally, tough, this is not what you want to
 do
   with
 UBI/UBIFS. You should use ubiformat on the target, and copy the
 content
 with
 tar. See
   http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat
   
will tar preserve uid/gid hard links, special files, /dev
  
   Yes, by default.
  
extended attr etc ?
  
   Yes. Use --xattrs.
  
   baruch
 
  thanks, i'll try that.
 
  can I ubiformat + untar from u-boot ?

 I don't see support for either in mainline U-Boot. Barebox supports
 ubiformat
 but not tar extraction.

 Your best option is to boot into RAM using a kernel combined with a minimal
 Busybox based initramfs, and extract you tar from there. Note tough that
 Busybox tar does not support extended attributes, so you must use GNU tar
 for
 this. Buildroot can generate a minimal initramfs image for you quite
 easily.

 baruch

 --
  http://baruch.siach.name/blog/  ~. .~   Tk Open
 Systems
 =}ooO--U--Ooo{=
- bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il -

___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il