Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 21/03/16 14:34, Aliaksei Sheshka wrote: > What is the point to pack single raw file into the tar.gz and to name it raw ? > Or it's just a mistake ? > > Johnny is looking at the cdn side of thigs, but effectively we will not have a .raw - we will have a .raw.tar.gz file ( which will itself only have a .raw file compressed inside it ) -- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 03/21/2016 09:51 AM, Karanbir Singh wrote: > On 21/03/16 14:34, Aliaksei Sheshka wrote: >> What is the point to pack single raw file into the tar.gz and to name it raw >> ? >> Or it's just a mistake ? >> >> > > Johnny is looking at the cdn side of thigs, but effectively we will not > have a .raw - we will have a .raw.tar.gz file ( which will itself only > have a .raw file compressed inside it ) > > It looks as if using 'Multiple Views' in the apache setup means that you can effectively download a file even leaving off the extension .. in your case, it left off the tar.gz but allowed you to download that file anyway. We are looking at changing the apache configuration to prevent this type of thing in the future. As an example: http://mirror.centos.org/centos/7/isos/x86_64/CentOS-7-x86_64-Everything-1511 that pulls down the .torrent file even though there is no .torrent The bottom line is, please download the .raw.tar.gz file and not the .raw file and we are working on the configs. signature.asc Description: OpenPGP digital signature ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 21 March 2016 at 11:51, Karanbir Singh wrote: > On 21/03/16 14:34, Aliaksei Sheshka wrote: > > What is the point to pack single raw file into the tar.gz and to name it > raw ? > > Or it's just a mistake ? > > > > > > Johnny is looking at the cdn side of thigs, but effectively we will not > have a .raw - we will have a .raw.tar.gz file ( which will itself only > have a .raw file compressed inside it ) > > > -- > Karanbir Singh > +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh > GnuPG Key : http://www.karan.org/publickey.asc > > Why not a compressed qcow2? Like: CentOS-7-x86_64-GenericCloud.qcow2c This way, we can add it as-is to OpenStack Glance, that it will be downloaded by demand, when required and, OpenStack Nova will automatically uncompress the image for runtime. Cheers! Thiago ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 21/03/16 15:34, Aliaksei Sheshka wrote: > Hello! > > Is anyone aware why CentOS-7-x86_64-GenericCloud.raw has such unusual format ? > > root@test-srv:~# wget > http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw > --2016-03-21 13:16:31-- > http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw > Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138 > Connecting to cloud.centos.org > (cloud.centos.org)|162.252.80.138|:80... connected. > HTTP request sent, awaiting response... 200 OK > Length: 374668382 (357M) [application/x-gzip] > Saving to: 'CentOS-7-x86_64-GenericCloud.raw' > CentOS-7-x86_64-GenericCloud.raw > 100%[=>] > 357.31M 12.9MB/sin 30s > 2016-03-21 13:17:03 (11.9 MB/s) - 'CentOS-7-x86_64-GenericCloud.raw' > saved [374668382/374668382] > > Download reports [application/x-gzip] for raw file > > And indeed > root@test-srv:~# file CentOS-7-x86_64-GenericCloud.raw > CentOS-7-x86_64-GenericCloud.raw: gzip compressed data, last modified: > Sat Feb 27 02:14:37 2016, from Unix > > Ok, lets uncompress: > root@test-srv:~# zcat -d CentOS-7-x86_64-GenericCloud.raw > > CentOS-7-x86_64-GenericCloud.a > > And check again > root@test-srv:~# file CentOS-7-x86_64-GenericCloud.a > CentOS-7-x86_64-GenericCloud.a: POSIX tar archive (GNU) > > Ok. it's a tar archive. > > root@test-srv:~# tar -xf CentOS-7-x86_64-GenericCloud.a -v > CentOS-7-x86_64-GenericCloud-1602.raw > > Now it's CentOS-7-x86_64-GenericCloud-1602.raw file which is indeed raw > > What is the point to pack single raw file into the tar.gz and to name it raw ? > Or it's just a mistake ? > > Thanks! So I found yesterday that the MultiViews option was active in the template used by cfgmgmt for those vhosts, and was the root cause of that behaviour. I confirm that such .raw image wasn't even present on those cloud.centos.org, but httpd served the .raw.tar.gz instead. Fix for this was pushed earlier today so you'll now have a 404 if you try to download that .raw file again. That brings though another question : why trying specifically to download a .raw file that isn't listed on that page ? -- Fabian Arrotin The CentOS Project | http://www.centos.org gpg key: 56BEC54E | twitter: @arrfab signature.asc Description: OpenPGP digital signature ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
What you mean is not listed ? Click 1) https://www.centos.org/download/ there click 2) More download choices it goes to 3) https://wiki.centos.org/Download there you see 4) Cloud / Containers , http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw raw files are very useful, they are very convenient to tweak by simply mounting using losetup. And there is no good reason to put 1 file inside tar.gz, just compressed raw.gz would be fine. On Tue, Mar 22, 2016 at 8:35 AM, Fabian Arrotin wrote: > On 21/03/16 15:34, Aliaksei Sheshka wrote: >> Hello! >> >> Is anyone aware why CentOS-7-x86_64-GenericCloud.raw has such unusual format >> ? >> >> root@test-srv:~# wget >> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw >> --2016-03-21 13:16:31-- >> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw >> Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138 >> Connecting to cloud.centos.org >> (cloud.centos.org)|162.252.80.138|:80... connected. >> HTTP request sent, awaiting response... 200 OK >> Length: 374668382 (357M) [application/x-gzip] >> Saving to: 'CentOS-7-x86_64-GenericCloud.raw' >> CentOS-7-x86_64-GenericCloud.raw >> 100%[=>] >> 357.31M 12.9MB/sin 30s >> 2016-03-21 13:17:03 (11.9 MB/s) - 'CentOS-7-x86_64-GenericCloud.raw' >> saved [374668382/374668382] >> >> Download reports [application/x-gzip] for raw file >> >> And indeed >> root@test-srv:~# file CentOS-7-x86_64-GenericCloud.raw >> CentOS-7-x86_64-GenericCloud.raw: gzip compressed data, last modified: >> Sat Feb 27 02:14:37 2016, from Unix >> >> Ok, lets uncompress: >> root@test-srv:~# zcat -d CentOS-7-x86_64-GenericCloud.raw > >> CentOS-7-x86_64-GenericCloud.a >> >> And check again >> root@test-srv:~# file CentOS-7-x86_64-GenericCloud.a >> CentOS-7-x86_64-GenericCloud.a: POSIX tar archive (GNU) >> >> Ok. it's a tar archive. >> >> root@test-srv:~# tar -xf CentOS-7-x86_64-GenericCloud.a -v >> CentOS-7-x86_64-GenericCloud-1602.raw >> >> Now it's CentOS-7-x86_64-GenericCloud-1602.raw file which is indeed raw >> >> What is the point to pack single raw file into the tar.gz and to name it raw >> ? >> Or it's just a mistake ? >> >> Thanks! > > So I found yesterday that the MultiViews option was active in the > template used by cfgmgmt for those vhosts, and was the root cause of > that behaviour. > I confirm that such .raw image wasn't even present on those > cloud.centos.org, but httpd served the .raw.tar.gz instead. > Fix for this was pushed earlier today so you'll now have a 404 if you > try to download that .raw file again. > That brings though another question : why trying specifically to > download a .raw file that isn't listed on that page ? > > > -- > Fabian Arrotin > The CentOS Project | http://www.centos.org > gpg key: 56BEC54E | twitter: @arrfab > > > ___ > CentOS mailing list > CentOS@centos.org > https://lists.centos.org/mailman/listinfo/centos > ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 03/22/2016 08:15 AM, Aliaksei Sheshka wrote: > What you mean is not listed ? > Click 1) https://www.centos.org/download/ > there click 2) More download choices > it goes to 3) https://wiki.centos.org/Download > there you see 4) Cloud / Containers , > http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw > > raw files are very useful, they are very convenient to tweak by simply > mounting using losetup. > And there is no good reason to put 1 file inside tar.gz, just > compressed raw.gz would be fine. The reason is that some big cloud guys need it as a tgz because that is what they use. It is just as easy for anyone else (not specifically needing tgz) to extract the image to obtain a raw file from tgz format as from gz format. (one command, you end up with the raw file). This way, we only need one compressed raw image file, not 2 or 3 raw images compressed in different ways. Thanks, Johnny Hughes signature.asc Description: OpenPGP digital signature ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 22/03/16 01:06, Martinx - ジェームズ wrote: > On 21 March 2016 at 11:51, Karanbir Singh wrote: > >> On 21/03/16 14:34, Aliaksei Sheshka wrote: >>> What is the point to pack single raw file into the tar.gz and to name it >> raw ? >>> Or it's just a mistake ? >>> >>> >> >> Johnny is looking at the cdn side of thigs, but effectively we will not >> have a .raw - we will have a .raw.tar.gz file ( which will itself only >> have a .raw file compressed inside it ) >> >> >> -- >> Karanbir Singh >> +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh >> GnuPG Key : http://www.karan.org/publickey.asc >> >> > Why not a compressed qcow2? > > Like: CentOS-7-x86_64-GenericCloud.qcow2c > > This way, we can add it as-is to OpenStack Glance, that it will be > downloaded by demand, when required and, OpenStack Nova will automatically > uncompress the image for runtime. We do publish a qcow2c, the always updated version ( updated each month end ) is at : http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c This is a symlink that points to the latest image. At the moment this is : http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qcow2c There will be a 1603 by the end of this week -- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
> > > Why not a compressed qcow2? > > > > Like: CentOS-7-x86_64-GenericCloud.qcow2c > > > > This way, we can add it as-is to OpenStack Glance, that it will be > > downloaded by demand, when required and, OpenStack Nova will > automatically > > uncompress the image for runtime. > > We do publish a qcow2c, the always updated version ( updated each month > end ) is at : > http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c > > This is a symlink that points to the latest image. At the moment this is > : > > http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qcow2c > > There will be a 1603 by the end of this week > > > -- > Karanbir Singh > +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh > GnuPG Key : http://www.karan.org/publickey.asc Sounds awesome! Thanks for sharing the symlink... I'll use it instead.. Cheers! ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
Problem re-appeared again. At that time I'm unable to download Cloud Image linked from https://wiki.centos.org/Download http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz $ wget http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz --2016-10-10 11:21:32-- http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138, 2607:1680:0:1::2 Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:80... connected. HTTP request sent, awaiting response... 404 Not Found 2016-10-10 11:21:32 ERROR 404: Not Found. As before I'm looking for a raw image, or a tar of the corresponding file system, Thanks! On Tue, Mar 29, 2016 at 12:57 PM, Martinx - ジェームズ wrote: >> >> > Why not a compressed qcow2? >> > >> > Like: CentOS-7-x86_64-GenericCloud.qcow2c >> > >> > This way, we can add it as-is to OpenStack Glance, that it will be >> > downloaded by demand, when required and, OpenStack Nova will >> automatically >> > uncompress the image for runtime. >> >> We do publish a qcow2c, the always updated version ( updated each month >> end ) is at : >> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c >> >> This is a symlink that points to the latest image. At the moment this is >> : >> >> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qcow2c >> >> There will be a 1603 by the end of this week >> >> >> -- >> Karanbir Singh >> +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh >> GnuPG Key : http://www.karan.org/publickey.asc > > > Sounds awesome! Thanks for sharing the symlink... I'll use it instead.. > Cheers! > ___ > CentOS mailing list > CentOS@centos.org > https://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 10/10/2016 8:28 AM, Aliaksei Sheshka wrote: $ wgethttp://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz --2016-10-10 11:21:32-- http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138, 2607:1680:0:1::2 Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:80... connected. HTTP request sent, awaiting response... 404 Not Found 2016-10-10 11:21:32 ERROR 404: Not Found. As before I'm looking for a raw image, or a tar of the corresponding file system, did you look in the directory to see what is there? http://cloud.centos.org/centos/7/images/ -- john r pierce, recycling bits in santa cruz ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
> -Original Message- > From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On > Behalf Of John R Pierce > Sent: Monday, October 10, 2016 1:31 PM > To: centos@centos.org > Subject: Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual > format > > On 10/10/2016 8:28 AM, Aliaksei Sheshka wrote: > > $ > > wgethttp://cloud.centos.org/centos/7/images/CentOS-7-x86_64- > GenericClo > > ud.raw.xz > > --2016-10-10 11:21:32-- > > http://cloud.centos.org/centos/7/images/CentOS-7-x86_64- > GenericCloud.r > > aw.xz Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138, > > 2607:1680:0:1::2 > > Connecting to cloud.centos.org > > (cloud.centos.org)|162.252.80.138|:80... connected. > > HTTP request sent, awaiting response... 404 Not Found > > 2016-10-10 11:21:32 ERROR 404: Not Found. > > > > > > As before I'm looking for a raw image, or a tar of the corresponding > > file system, > > did you look in the directory to see what is there? > > http://cloud.centos.org/centos/7/images/ > Hello, Just a question, what exactly are these images? I see it mentioned on the CentOS website but not a lot of info on exactly what it is and what it does. How does this differ from a CentOS 7 VM installed from an ISO? Are these just pre-made images? thanks ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
> > did you look in the directory to see what is there? > > http://cloud.centos.org/centos/7/images/ > Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare with CentOS-7-x86_64-GenericCloud.raw.xz ) But again link is not good, and why put raw disk inside the tar? It would me more natural to have compressed image so one can do {z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example. Official wiki link is broken regardless. ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 11/10/16 03:21, TE Dukes wrote: > Just a question, what exactly are these images? > > I see it mentioned on the CentOS website but not a lot of info on exactly > what it is and what it does. > > How does this differ from a CentOS 7 VM installed from an ISO? Are these > just pre-made images? these are images prebuilt to work in cloud infrastructure like openshift / amazon ec2 etc. they are pre-setup with cloud-init tools and are formatted in different backing filetypes. you can use them for local VM's as well, but you will just need to do a bit more work since there is no way to login to the images without exporting the metadata externally to setup passwords and keys etc. -- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 11/10/16 13:16, Aliaksei Sheshka wrote: >> >> did you look in the directory to see what is there? >> >> http://cloud.centos.org/centos/7/images/ >> > > Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare > with CentOS-7-x86_64-GenericCloud.raw.xz ) > > > But again link is not good, and why put raw disk inside the tar? This is how OracleCloud works, they are unable to consume a raw file directly. I agree, its a bit odd. > It would me more natural to have compressed image so one can do > {z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example. for the sake of size, lots of people prefer to download the qcow2c image ( note the compressed flag ), and qemu-img convert on their own end. Is that an option for your usecase ? > > Official wiki link is broken regardless. will try and get that fixed. -- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On Tue, Oct 11, 2016 at 08:16:14AM -0400, Aliaksei Sheshka wrote: > Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare > with CentOS-7-x86_64-GenericCloud.raw.xz ) > But again link is not good, and why put raw disk inside the tar? > It would me more natural to have compressed image so one can do > {z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example. Earlier versions of xz (RHEL 5, I think?) didn't handle sparse files, and we put the Fedora raw cloud image inside a tar for that reason. I don't know if the same applies here, but it might. -- Matthew Miller Fedora Project Leader ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
> -Original Message- > From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On > Behalf Of Karanbir Singh > Sent: Tuesday, October 11, 2016 5:21 PM > To: centos@centos.org > Subject: Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual > format > > On 11/10/16 03:21, TE Dukes wrote: > > Just a question, what exactly are these images? > > > > I see it mentioned on the CentOS website but not a lot of info on > > exactly what it is and what it does. > > > > How does this differ from a CentOS 7 VM installed from an ISO? Are > > these just pre-made images? > > these are images prebuilt to work in cloud infrastructure like openshift / > amazon ec2 etc. they are pre-setup with cloud-init tools and are formatted in > different backing filetypes. > > you can use them for local VM's as well, but you will just need to do a bit > more work since there is no way to login to the images without exporting the > metadata externally to setup passwords and keys etc. > Sorry I haven't replied sooner. Still trying to digest this. I appreciate your response. I have no idea what you said or what use they would be if you couldn't login except via SSH. How would you add content? I did see something about having to change the root password or something. Might spin one up to see, I'm still lost. Is there a demo site? TIA ___ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos