Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[TE Dukes]

> -Original Message-
> From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On
> Behalf Of Karanbir Singh
> Sent: Tuesday, October 11, 2016 5:21 PM
> To: centos@centos.org
> Subject: Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual
> format
> 
> On 11/10/16 03:21, TE Dukes wrote:
> > Just a question, what exactly are these images?
> >
> > I see it mentioned on the CentOS website but not a lot of info on
> > exactly what it is and what it does.
> >
> > How does this differ from a CentOS 7 VM installed from an ISO? Are
> > these just pre-made images?
> 
> these are images prebuilt to work in cloud infrastructure like openshift /
> amazon ec2 etc. they are pre-setup with cloud-init tools and are formatted
in
> different backing filetypes.
> 
> you can use them for local VM's as well, but you will just need to do a
bit
> more work since there is no way to login to the images without exporting
the
> metadata externally to setup passwords and keys etc.
> 

Sorry I haven't replied sooner. Still trying to digest this.

I appreciate your response. I have no idea what you said or what use they
would be if you couldn't login except via SSH. How would you add content? I
did see something about having to change the root password or something.

Might spin one up to see, I'm still lost.

Is there a demo site?

TIA

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Matthew Miller]

On Tue, Oct 11, 2016 at 08:16:14AM -0400, Aliaksei Sheshka wrote:
> Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare
> with CentOS-7-x86_64-GenericCloud.raw.xz )
> But again link is not good, and why put raw disk inside the tar?
> It would me more natural to have compressed image so one can do
> {z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example.

Earlier versions of xz (RHEL 5, I think?) didn't handle sparse files,
and we put the Fedora raw cloud image inside a tar for that reason. I
don't know if the same applies here, but it might.

-- 
Matthew Miller

Fedora Project Leader
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Karanbir Singh]

On 11/10/16 13:16, Aliaksei Sheshka wrote:
>>
>> did you look in the directory to see what is there?
>>
>> http://cloud.centos.org/centos/7/images/
>>
> 
> Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare
> with CentOS-7-x86_64-GenericCloud.raw.xz )
> 
> 
> But again link is not good, and why put raw disk inside the tar?

This is how OracleCloud works, they are unable to consume a raw file
directly. I agree, its a bit odd.

> It would me more natural to have compressed image so one can do
> {z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example.

for the sake of size, lots of people prefer to download the qcow2c image
( note the compressed flag ), and qemu-img convert on their own end. Is
that an option for your usecase ?

> 
> Official wiki link is broken regardless.

will try and get that fixed.


-- 
Karanbir Singh
+44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
GnuPG Key : http://www.karan.org/publickey.asc
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Karanbir Singh]

On 11/10/16 03:21, TE Dukes wrote:
> Just a question, what exactly are these images?
> 
> I see it mentioned on the CentOS website but not a lot of info on exactly
> what it is and what it does.
> 
> How does this differ from a CentOS 7 VM installed from an ISO? Are these
> just pre-made images?

these are images prebuilt to work in cloud infrastructure like openshift
/ amazon ec2 etc. they are pre-setup with cloud-init tools and are
formatted in different backing filetypes.

you can use them for local VM's as well, but you will just need to do a
bit more work since there is no way to login to the images without
exporting the metadata externally to setup passwords and keys etc.

-- 
Karanbir Singh
+44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
GnuPG Key : http://www.karan.org/publickey.asc
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Aliaksei Sheshka]

>
> did you look in the directory to see what is there?
>
> http://cloud.centos.org/centos/7/images/
>

Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare
with CentOS-7-x86_64-GenericCloud.raw.xz )


But again link is not good, and why put raw disk inside the tar?
It would me more natural to have compressed image so one can do
{z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example.

Official wiki link is broken regardless.
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[TE Dukes]

> -Original Message-
> From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On
> Behalf Of John R Pierce
> Sent: Monday, October 10, 2016 1:31 PM
> To: centos@centos.org
> Subject: Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual
> format
> 
> On 10/10/2016 8:28 AM, Aliaksei Sheshka wrote:
> > $
> > wgethttp://cloud.centos.org/centos/7/images/CentOS-7-x86_64-
> GenericClo
> > ud.raw.xz
> > --2016-10-10 11:21:32--
> > http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-
> GenericCloud.r
> > aw.xz Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138,
> > 2607:1680:0:1::2
> > Connecting to cloud.centos.org
> > (cloud.centos.org)|162.252.80.138|:80... connected.
> > HTTP request sent, awaiting response... 404 Not Found
> > 2016-10-10 11:21:32 ERROR 404: Not Found.
> >
> >
> > As before I'm looking for a raw image, or a tar of the corresponding
> > file system,
> 
> did you look in the directory to see what is there?
> 
> http://cloud.centos.org/centos/7/images/
> 

Hello,

Just a question, what exactly are these images?

I see it mentioned on the CentOS website but not a lot of info on exactly
what it is and what it does.

How does this differ from a CentOS 7 VM installed from an ISO? Are these
just pre-made images?

thanks

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[John R Pierce]

On 10/10/2016 8:28 AM, Aliaksei Sheshka wrote:

$ 
wgethttp://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz
--2016-10-10 11:21:32--
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz
Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138,
2607:1680:0:1::2
Connecting to cloud.centos.org
(cloud.centos.org)|162.252.80.138|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2016-10-10 11:21:32 ERROR 404: Not Found.


As before I'm looking for a raw image, or a tar of the corresponding
file system,


did you look in the directory to see what is there?

http://cloud.centos.org/centos/7/images/



--
john r pierce, recycling bits in santa cruz

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Aliaksei Sheshka]

Problem re-appeared again.

At that time I'm unable to download  Cloud Image linked from

https://wiki.centos.org/Download

http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz

$ wget 
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz
--2016-10-10 11:21:32--
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz
Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138,
2607:1680:0:1::2
Connecting to cloud.centos.org
(cloud.centos.org)|162.252.80.138|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2016-10-10 11:21:32 ERROR 404: Not Found.


As before I'm looking for a raw image, or a tar of the corresponding
file system,

Thanks!




On Tue, Mar 29, 2016 at 12:57 PM, Martinx - ジェームズ
 wrote:
>>
>> > Why not a compressed qcow2?
>> >
>> > Like: CentOS-7-x86_64-GenericCloud.qcow2c
>> >
>> > This way, we can add it as-is to OpenStack Glance, that it will be
>> > downloaded by demand, when required and, OpenStack Nova will
>> automatically
>> > uncompress the image for runtime.
>>
>> We do publish a qcow2c, the always updated version ( updated each month
>> end ) is at :
>> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c
>>
>> This is a symlink that points to the latest image. At the moment this is
>> :
>>
>> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qcow2c
>>
>> There will be a 1603 by the end of this week
>>
>>
>> --
>> Karanbir Singh
>> +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
>> GnuPG Key : http://www.karan.org/publickey.asc
>
>
> Sounds awesome! Thanks for sharing the symlink... I'll use it instead..
> Cheers!
> ___
> CentOS mailing list
> CentOS@centos.org
> https://lists.centos.org/mailman/listinfo/centos
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Martinx - ジェームズ]

>
> > Why not a compressed qcow2?
> >
> > Like: CentOS-7-x86_64-GenericCloud.qcow2c
> >
> > This way, we can add it as-is to OpenStack Glance, that it will be
> > downloaded by demand, when required and, OpenStack Nova will
> automatically
> > uncompress the image for runtime.
>
> We do publish a qcow2c, the always updated version ( updated each month
> end ) is at :
> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c
>
> This is a symlink that points to the latest image. At the moment this is
> :
>
> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qcow2c
>
> There will be a 1603 by the end of this week
>
>
> --
> Karanbir Singh
> +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
> GnuPG Key : http://www.karan.org/publickey.asc


Sounds awesome! Thanks for sharing the symlink... I'll use it instead..
Cheers!
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Karanbir Singh]

On 22/03/16 01:06, Martinx - ジェームズ wrote:
> On 21 March 2016 at 11:51, Karanbir Singh  wrote:
> 
>> On 21/03/16 14:34, Aliaksei Sheshka wrote:
>>> What is the point to pack single raw file into the tar.gz and to name it
>> raw ?
>>> Or it's just a mistake ?
>>>
>>>
>>
>> Johnny is looking at the cdn side of thigs, but effectively we will not
>> have a .raw - we will have a .raw.tar.gz file ( which will itself only
>> have a .raw file compressed inside it )
>>
>>
>> --
>> Karanbir Singh
>> +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
>> GnuPG Key : http://www.karan.org/publickey.asc
>>
>>
> Why not a compressed qcow2?
> 
> Like: CentOS-7-x86_64-GenericCloud.qcow2c
> 
> This way, we can add it as-is to OpenStack Glance, that it will be
> downloaded by demand, when required and, OpenStack Nova will automatically
> uncompress the image for runtime.

We do publish a qcow2c, the always updated version ( updated each month
end ) is at :
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c

This is a symlink that points to the latest image. At the moment this is
:
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qcow2c

There will be a 1603 by the end of this week


-- 
Karanbir Singh
+44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
GnuPG Key : http://www.karan.org/publickey.asc
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Johnny Hughes]

On 03/22/2016 08:15 AM, Aliaksei Sheshka wrote:
> What you mean is not listed ?
> Click 1) https://www.centos.org/download/
> there click 2) More download choices
> it goes to 3) https://wiki.centos.org/Download
> there you see 4) Cloud / Containers ,
> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw
> 
> raw files are very useful, they are very convenient to tweak by simply
> mounting using losetup.
> And there is no good reason to put 1 file inside tar.gz, just
> compressed raw.gz would be fine.

The reason is that some big cloud guys need it as a tgz because that is
what they use.

It is just as easy for anyone else (not specifically needing tgz) to
extract the image to obtain a raw file from tgz format as from gz
format.  (one command, you end up with the raw file).

This way, we only need one compressed raw image file, not 2 or 3 raw
images compressed in different ways.

Thanks,
Johnny Hughes





signature.asc
Description: OpenPGP digital signature
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Aliaksei Sheshka]

What you mean is not listed ?
Click 1) https://www.centos.org/download/
there click 2) More download choices
it goes to 3) https://wiki.centos.org/Download
there you see 4) Cloud / Containers ,
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw

raw files are very useful, they are very convenient to tweak by simply
mounting using losetup.
And there is no good reason to put 1 file inside tar.gz, just
compressed raw.gz would be fine.






On Tue, Mar 22, 2016 at 8:35 AM, Fabian Arrotin  wrote:
> On 21/03/16 15:34, Aliaksei Sheshka wrote:
>> Hello!
>>
>> Is anyone aware why CentOS-7-x86_64-GenericCloud.raw has such unusual format 
>> ?
>>
>> root@test-srv:~# wget
>> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw
>> --2016-03-21 13:16:31--
>> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw
>> Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138
>> Connecting to cloud.centos.org
>> (cloud.centos.org)|162.252.80.138|:80... connected.
>> HTTP request sent, awaiting response... 200 OK
>> Length: 374668382 (357M) [application/x-gzip]
>> Saving to: 'CentOS-7-x86_64-GenericCloud.raw'
>> CentOS-7-x86_64-GenericCloud.raw
>> 100%[=>]
>> 357.31M  12.9MB/sin 30s
>> 2016-03-21 13:17:03 (11.9 MB/s) - 'CentOS-7-x86_64-GenericCloud.raw'
>> saved [374668382/374668382]
>>
>> Download reports [application/x-gzip] for raw file
>>
>> And indeed
>> root@test-srv:~# file CentOS-7-x86_64-GenericCloud.raw
>> CentOS-7-x86_64-GenericCloud.raw: gzip compressed data, last modified:
>> Sat Feb 27 02:14:37 2016, from Unix
>>
>> Ok, lets uncompress:
>> root@test-srv:~# zcat -d CentOS-7-x86_64-GenericCloud.raw >
>> CentOS-7-x86_64-GenericCloud.a
>>
>> And check again
>> root@test-srv:~# file CentOS-7-x86_64-GenericCloud.a
>> CentOS-7-x86_64-GenericCloud.a: POSIX tar archive (GNU)
>>
>> Ok. it's a tar archive.
>>
>> root@test-srv:~# tar -xf CentOS-7-x86_64-GenericCloud.a -v
>> CentOS-7-x86_64-GenericCloud-1602.raw
>>
>> Now it's CentOS-7-x86_64-GenericCloud-1602.raw file which is indeed raw
>>
>> What is the point to pack single raw file into the tar.gz and to name it raw 
>> ?
>> Or it's just a mistake ?
>>
>> Thanks!
>
> So I found yesterday that the MultiViews option was active in the
> template used by cfgmgmt for those vhosts, and was the root cause of
> that behaviour.
> I confirm that such .raw image wasn't even present on those
> cloud.centos.org, but httpd served the .raw.tar.gz instead.
> Fix for this was pushed earlier today so you'll now have a 404 if you
> try to download that .raw file again.
> That brings though another question : why trying specifically to
> download a .raw file that isn't listed on that page ?
>
>
> --
> Fabian Arrotin
> The CentOS Project | http://www.centos.org
> gpg key: 56BEC54E | twitter: @arrfab
>
>
> ___
> CentOS mailing list
> CentOS@centos.org
> https://lists.centos.org/mailman/listinfo/centos
>
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Fabian Arrotin]

On 21/03/16 15:34, Aliaksei Sheshka wrote:
> Hello!
> 
> Is anyone aware why CentOS-7-x86_64-GenericCloud.raw has such unusual format ?
> 
> root@test-srv:~# wget
> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw
> --2016-03-21 13:16:31--
> http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw
> Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138
> Connecting to cloud.centos.org
> (cloud.centos.org)|162.252.80.138|:80... connected.
> HTTP request sent, awaiting response... 200 OK
> Length: 374668382 (357M) [application/x-gzip]
> Saving to: 'CentOS-7-x86_64-GenericCloud.raw'
> CentOS-7-x86_64-GenericCloud.raw
> 100%[=>]
> 357.31M  12.9MB/sin 30s
> 2016-03-21 13:17:03 (11.9 MB/s) - 'CentOS-7-x86_64-GenericCloud.raw'
> saved [374668382/374668382]
> 
> Download reports [application/x-gzip] for raw file
> 
> And indeed
> root@test-srv:~# file CentOS-7-x86_64-GenericCloud.raw
> CentOS-7-x86_64-GenericCloud.raw: gzip compressed data, last modified:
> Sat Feb 27 02:14:37 2016, from Unix
> 
> Ok, lets uncompress:
> root@test-srv:~# zcat -d CentOS-7-x86_64-GenericCloud.raw >
> CentOS-7-x86_64-GenericCloud.a
> 
> And check again
> root@test-srv:~# file CentOS-7-x86_64-GenericCloud.a
> CentOS-7-x86_64-GenericCloud.a: POSIX tar archive (GNU)
> 
> Ok. it's a tar archive.
> 
> root@test-srv:~# tar -xf CentOS-7-x86_64-GenericCloud.a -v
> CentOS-7-x86_64-GenericCloud-1602.raw
> 
> Now it's CentOS-7-x86_64-GenericCloud-1602.raw file which is indeed raw
> 
> What is the point to pack single raw file into the tar.gz and to name it raw ?
> Or it's just a mistake ?
> 
> Thanks!

So I found yesterday that the MultiViews option was active in the
template used by cfgmgmt for those vhosts, and was the root cause of
that behaviour.
I confirm that such .raw image wasn't even present on those
cloud.centos.org, but httpd served the .raw.tar.gz instead.
Fix for this was pushed earlier today so you'll now have a 404 if you
try to download that .raw file again.
That brings though another question : why trying specifically to
download a .raw file that isn't listed on that page ?


-- 
Fabian Arrotin
The CentOS Project | http://www.centos.org
gpg key: 56BEC54E | twitter: @arrfab



signature.asc
Description: OpenPGP digital signature
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Martinx - ジェームズ]

On 21 March 2016 at 11:51, Karanbir Singh  wrote:

> On 21/03/16 14:34, Aliaksei Sheshka wrote:
> > What is the point to pack single raw file into the tar.gz and to name it
> raw ?
> > Or it's just a mistake ?
> >
> >
>
> Johnny is looking at the cdn side of thigs, but effectively we will not
> have a .raw - we will have a .raw.tar.gz file ( which will itself only
> have a .raw file compressed inside it )
>
>
> --
> Karanbir Singh
> +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
> GnuPG Key : http://www.karan.org/publickey.asc
>
>
Why not a compressed qcow2?

Like: CentOS-7-x86_64-GenericCloud.qcow2c

This way, we can add it as-is to OpenStack Glance, that it will be
downloaded by demand, when required and, OpenStack Nova will automatically
uncompress the image for runtime.

Cheers!
Thiago
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Johnny Hughes]

On 03/21/2016 09:51 AM, Karanbir Singh wrote:
> On 21/03/16 14:34, Aliaksei Sheshka wrote:
>> What is the point to pack single raw file into the tar.gz and to name it raw 
>> ?
>> Or it's just a mistake ?
>>
>>
> 
> Johnny is looking at the cdn side of thigs, but effectively we will not
> have a .raw - we will have a .raw.tar.gz file ( which will itself only
> have a .raw file compressed inside it )
> 
> 

It looks as if using 'Multiple Views' in the apache setup means that you
can effectively download a file even leaving off the extension .. in
your case, it left off the tar.gz but allowed you to download that file
anyway.

We are looking at changing the apache configuration to prevent this type
of thing in the future.

As an example:

http://mirror.centos.org/centos/7/isos/x86_64/CentOS-7-x86_64-Everything-1511

that pulls down the .torrent file even though there is no .torrent

The bottom line is, please download the .raw.tar.gz file and not the
.raw file and we are working on the configs.



signature.asc
Description: OpenPGP digital signature
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format

[Karanbir Singh]

On 21/03/16 14:34, Aliaksei Sheshka wrote:
> What is the point to pack single raw file into the tar.gz and to name it raw ?
> Or it's just a mistake ?
> 
> 

Johnny is looking at the cdn side of thigs, but effectively we will not
have a .raw - we will have a .raw.tar.gz file ( which will itself only
have a .raw file compressed inside it )


-- 
Karanbir Singh
+44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
GnuPG Key : http://www.karan.org/publickey.asc
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos