ubi cloning
Hi i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. is there an easy way to clone a ubifs nand-flash ? thanks erez. ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: ubi cloning
How about ddrescue (the GNU one I think, there are multiple implementations with same name) into an image file then try to fix the fs around the bad sectors? On 12 May 2014 18:46, Erez D erez0...@gmail.com wrote: Hi i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. is there an easy way to clone a ubifs nand-flash ? thanks erez. ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il -- [image: View my profile on LinkedIn] http://www.linkedin.com/in/gliderflyer ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: ubi cloning
On Mon, May 12, 2014 at 11:51 AM, Amos Shapira amos.shap...@gmail.comwrote: How about ddrescue (the GNU one I think, there are multiple implementations with same name) into an image file then try to fix the fs around the bad sectors? ubifs already handles the bad sectors, and i do not want to mess with it. On 12 May 2014 18:46, Erez D erez0...@gmail.com wrote: Hi i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. is there an easy way to clone a ubifs nand-flash ? thanks erez. ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il -- [image: View my profile on LinkedIn] http://www.linkedin.com/in/gliderflyer ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: ubi cloning
Hi Erez, On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote: i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. dd is not the way to go with raw NAND flash access; it's not aware of bad blocks. is there an easy way to clone a ubifs nand-flash ? You may be able get a working system using nanddump/nandwrite (see http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but read the whole thread). Generally, tough, this is not what you want to do with UBI/UBIFS. You should use ubiformat on the target, and copy the content with tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat. baruch -- http://baruch.siach.name/blog/ ~. .~ Tk Open Systems =}ooO--U--Ooo{= - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il - ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: ubi cloning
On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il wrote: Hi Erez, On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote: i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. dd is not the way to go with raw NAND flash access; it's not aware of bad blocks. is there an easy way to clone a ubifs nand-flash ? You may be able get a working system using nanddump/nandwrite (see http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but read the whole thread). Generally, tough, this is not what you want to do with UBI/UBIFS. You should use ubiformat on the target, and copy the content with tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat . will tar preserve uid/gid hard links, special files, /dev extended attr etc ? baruch -- http://baruch.siach.name/blog/ ~. .~ Tk Open Systems =}ooO--U--Ooo{= - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il - ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: ubi cloning
Hi Erez, On Mon, May 12, 2014 at 12:14:14PM +0300, Erez D wrote: On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il wrote: On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote: i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. dd is not the way to go with raw NAND flash access; it's not aware of bad blocks. is there an easy way to clone a ubifs nand-flash ? You may be able get a working system using nanddump/nandwrite (see http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but read the whole thread). Generally, tough, this is not what you want to do with UBI/UBIFS. You should use ubiformat on the target, and copy the content with tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat will tar preserve uid/gid hard links, special files, /dev Yes, by default. extended attr etc ? Yes. Use --xattrs. baruch -- http://baruch.siach.name/blog/ ~. .~ Tk Open Systems =}ooO--U--Ooo{= - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il - ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: ubi cloning
On Mon, May 12, 2014 at 12:28 PM, Baruch Siach bar...@tkos.co.il wrote: Hi Erez, On Mon, May 12, 2014 at 12:14:14PM +0300, Erez D wrote: On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il wrote: On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote: i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. dd is not the way to go with raw NAND flash access; it's not aware of bad blocks. is there an easy way to clone a ubifs nand-flash ? You may be able get a working system using nanddump/nandwrite (see http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but read the whole thread). Generally, tough, this is not what you want to do with UBI/UBIFS. You should use ubiformat on the target, and copy the content with tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat will tar preserve uid/gid hard links, special files, /dev Yes, by default. extended attr etc ? Yes. Use --xattrs. baruch thanks, i'll try that. can I ubiformat + untar from u-boot ? -- http://baruch.siach.name/blog/ ~. .~ Tk Open Systems =}ooO--U--Ooo{= - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il - ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: ubi cloning
Hi Erez, On Mon, May 12, 2014 at 02:14:34PM +0300, Erez D wrote: On Mon, May 12, 2014 at 12:28 PM, Baruch Siach bar...@tkos.co.il wrote: On Mon, May 12, 2014 at 12:14:14PM +0300, Erez D wrote: On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il wrote: On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote: i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. dd is not the way to go with raw NAND flash access; it's not aware of bad blocks. is there an easy way to clone a ubifs nand-flash ? You may be able get a working system using nanddump/nandwrite (see http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but read the whole thread). Generally, tough, this is not what you want to do with UBI/UBIFS. You should use ubiformat on the target, and copy the content with tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat will tar preserve uid/gid hard links, special files, /dev Yes, by default. extended attr etc ? Yes. Use --xattrs. baruch thanks, i'll try that. can I ubiformat + untar from u-boot ? I don't see support for either in mainline U-Boot. Barebox supports ubiformat but not tar extraction. Your best option is to boot into RAM using a kernel combined with a minimal Busybox based initramfs, and extract you tar from there. Note tough that Busybox tar does not support extended attributes, so you must use GNU tar for this. Buildroot can generate a minimal initramfs image for you quite easily. baruch -- http://baruch.siach.name/blog/ ~. .~ Tk Open Systems =}ooO--U--Ooo{= - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il - ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Re: Announce: OSv, a new open-source operating system for virtual machines
On Mon, Sep 16, 2013, Nadav Har'El wrote about Announce: OSv, a new open-source operating system for virtual machines: Hi, today we've made the first release of OSv, a new operating system for running applications on virtual machines. OSv is free software, released under the BSD license, and you can find it in https://github.com/cloudius-systems/osv and http://www.osv.io. There is also a mailing list: osv-...@googlegroups.com. For those interested in meeting some of the OSv developers, shortly hearing about it and trying it on their own laptop and their own application, we are holding a meetup on Wednesday May 28th, 5:30pm, in our office in Herzliyya: http://www.meetup.com/OSv-Developer-Meetup/events/181683582/ It's a free meeting (of course), but we'll appreciate it if people RSVP on the meetup.com site so we'll have an estimate on how many are coming. See you, Nadav. These days, most applications running on virtual machines in the cloud run on top of Linux. We all love Linux, but as an all-encompassing operating system for everything from phones to supercomputers, Linux was never really designed for virtual machines; It is big and complex, and it offers features (such as multi-user and multi-process) which are today made redundant by the hypervisor and slow it down. Linux's APIs are many times set in stone by decades of legacy code. All these cost in application performance, and make it harder to innovate. This is why we developed OSv, a new operating system designed to run a single application on a virtual machine. As it runs a single application there is no need for kernel-userspace isolation, reducing context switch costs and unnecessary copying. A design from scratch allowed us to experiment with new ideas like lock-free mutexes (solving the Lock-Holder Preemption problem that plagues operating systems on virtual machines), extremely fast context switches, Van Jacobson's network channels (see http://www.lemis.com/grog/Documentation/vj/lca06vj.pdf), and more. Also, OSv is released under the more permissive BSD license (not GPL like Linux), is tiny compared to Linux, and takes less than one second to boot and start the user's application. OSv can run ordinary Linux shared objects, such as, for example, an unmodified JVM (e.g., OpenJDK) executable, and of course on that you can run any application written in Java, JRuby , Clojure, or any other JVM language. Even at this early stage of OSv's development, OSv can already successfully run several interesting workloads such as Netperf, Memcached, Cassandra and SpecJVM - and usually match or even beat Linux's performance. Another refreshing feature of OSv is that is written in C++. It's been 40 years since Unix was (re)written in C, and the time has come for something better. C++ is not about writing super-complex type hierarchies (as some people might have you believe). Rather, it allowed us to write shorter code with less boiler-plate repetition and less chances for bugs. It allowed us to more easily reuse quality code and data structures. And using newly standardized C++11 features, we were able to write safe concurrent code with standard language features instead of processor-specific hacks. And all of this with zero performance overheads - most of C++'s features, most notably templates, are compile-time features which result in no run-time overhead compared to C code. OSv was developed by Cloudius Systems, a small Israeli startup led by Dor Laor and Avi Kivity (of KVM fame) but it is an open-source project - developed since its inception on github (https://github.com/cloudius-systems/osv), and released under the BSD license. We would like to take this opportunity to invite everyone to use OSv, and to help drive its development forward. OSv is a fantastic playground for kernel developers, and also for people involved in cloud development, devops, and so on. Tell us what your dream VM operating system will do, and maybe your dream will come true :-) Maybe you can even help us make that dream come true. If you want to try OSv, check out the announcement and usage instructions on the OSv mailing list: https://groups.google.com/forum/#!topic/osv-dev/enqdqN2A0as -- Nadav Har'El| Monday, Sep 16 2013, 13 Tishri 5774 n...@math.technion.ac.il |- Phone +972-523-790466, ICQ 13349191 |A computer once beat me at chess, but it http://nadav.harel.org.il |was no match for me at kickboxing. -- Nadav Har'El| Monday, May 12 2014, 12 Iyyar 5774 n...@math.technion.ac.il |- Phone +972-523-790466, ICQ 13349191 |Politics, n: from Greek, poly=many, http://nadav.harel.org.il |ticks=blood sucking parasites. ___ Linux-il mailing list Linux-il@cs.huji.ac.il
Re: ubi cloning
thanks for your help On Mon, May 12, 2014 at 2:53 PM, Baruch Siach bar...@tkos.co.il wrote: Hi Erez, On Mon, May 12, 2014 at 02:14:34PM +0300, Erez D wrote: On Mon, May 12, 2014 at 12:28 PM, Baruch Siach bar...@tkos.co.il wrote: On Mon, May 12, 2014 at 12:14:14PM +0300, Erez D wrote: On Mon, May 12, 2014 at 12:05 PM, Baruch Siach bar...@tkos.co.il wrote: On Mon, May 12, 2014 at 11:46:43AM +0300, Erez D wrote: i need to clone a nand flash. which has ubifs on it doing 'dd' didn't work as the source and dest have different bad sectors. dd is not the way to go with raw NAND flash access; it's not aware of bad blocks. is there an easy way to clone a ubifs nand-flash ? You may be able get a working system using nanddump/nandwrite (see http://thread.gmane.org/gmane.linux.drivers.mtd/45792/focus=46024, but read the whole thread). Generally, tough, this is not what you want to do with UBI/UBIFS. You should use ubiformat on the target, and copy the content with tar. See http://www.linux-mtd.infradead.org/faq/ubifs.html#L_why_ubiformat will tar preserve uid/gid hard links, special files, /dev Yes, by default. extended attr etc ? Yes. Use --xattrs. baruch thanks, i'll try that. can I ubiformat + untar from u-boot ? I don't see support for either in mainline U-Boot. Barebox supports ubiformat but not tar extraction. Your best option is to boot into RAM using a kernel combined with a minimal Busybox based initramfs, and extract you tar from there. Note tough that Busybox tar does not support extended attributes, so you must use GNU tar for this. Buildroot can generate a minimal initramfs image for you quite easily. baruch -- http://baruch.siach.name/blog/ ~. .~ Tk Open Systems =}ooO--U--Ooo{= - bar...@tkos.co.il - tel: +972.2.679.5364, http://www.tkos.co.il - ___ Linux-il mailing list Linux-il@cs.huji.ac.il http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il