unsuscribe

2006-09-22 Thread Carlos M. Martinez
  

  Unsubribe


Re: Tracing IUCV

2006-09-22 Thread Peter Rothman
My apologies if I am just being ignorant.
This did not show anything either.
However if I use this to trace my own userid and use a RXsocket client that
I wrote then I get trace info in the console.

When I run the application I am trying to trace it does show up in a
NETSTAT CONN command. Is there any other 'communication' method that can be
used when communication with TCPIP? I mean anything that would not show up
as IUCV?

Thanks.




   
 Alan Altmark  
 [EMAIL PROTECTED] 
 ibm.com   To 
 Sent by: The IBM  IBMVM@LISTSERV.UARK.EDU 
 z/VM Operating cc 
 System
 [EMAIL PROTECTED] Subject 
 ARK.EDU  Re: Tracing IUCV
   
   
 09/21/2006 06:02  
 PM
   
   
 Please respond to 
   The IBM z/VM
 Operating System  
 [EMAIL PROTECTED] 
 ARK.EDU  
   
   




On Thursday, 09/21/2006 at 12:17 AST, Peter Rothman
[EMAIL PROTECTED] wrote:
 Thanks for the replies - I will try and debug the situation with the
info.

 BTW - I tried
 NETSTAT TRACEONLY userid ENDTRACEONLY
 NETSTAT OBEY MORETRACE IUCV SOCKET
 but still did not get any info displayed in the TCPIP console. Is this a
 problem?

Try NETSTAT OBEY SCREEN.

Alan Altmark
z/VM Development
IBM Endicott


Re: Tracing IUCV

2006-09-22 Thread Alan Altmark
On Friday, 09/22/2006 at 08:34 AST, Peter Rothman 
[EMAIL PROTECTED] wrote:
 My apologies if I am just being ignorant.
 This did not show anything either.
 However if I use this to trace my own userid and use a RXsocket client 
that
 I wrote then I get trace info in the console.
 
 When I run the application I am trying to trace it does show up in a
 NETSTAT CONN command. Is there any other 'communication' method that can 
be
 used when communication with TCPIP? I mean anything that would not show 
up
 as IUCV?

Yes, VMCF can be used.  It is used by Pascal programs, but is rarely seen 
in the wild.

NETSTAT OBEY MORETRACE TCPREQUEST UDPREQUEST

Are you sure the program you're using is talking to the same stack you're 
issuing NETSTAT requests to?

Alan Altmark
z/VM Development
IBM Endicott


A rose by any other name... Renaming the RSCS userid...

2006-09-22 Thread Nix, Robert P.
Title: A rose by any other name... Renaming the RSCS userid...






This is the first time we've brought up RSCS on our systems, and I got it running on one and waiting for the NJE connection from the other box.

On the other box, I need to have it run with a different userid (common CP Directory), and it starts to come up there, but abends with:

GCTABD232E Abend 0C2- occurred during abend ESTAE processing

GCTABD226E Application 'RSCS' failed - System abend B78-


The B78 CMS description talks about using an invalid subpool for a getmain. I couldn't find a GCS messages manual on the CDs.

Both RSCS and GRIZRSCS have the same amount of memory. Both had the same number of links and auths defined; I dropped a bunch of sample links from the GRIZRSCS config. I also thought that, possibly, the config filename needed to match the virtual machine name, so I copied RSCS CONFIG to GRIZRSCS CONFIG, with the same results.

Would anyone know what I need to do to get RSCS to run under a different userid?


-- 

.~. Robert P. Nix  Mayo Foundation

/V\ RO-OC-1-13   200 First Street SW

/( )\ 507-284-0844  Rochester, MN 55905

^^-^^ -

 In theory, theory and practice are the same, but

 in practice, theory and practice are different.






Re: A rose by any other name... Renaming the RSCS userid...

2006-09-22 Thread David Kreuter

Did you train the GCS segment to know about RSCSXXX ?
David
Nix, Robert P. wrote:

This is the first time we've brought up RSCS on our systems, and I got 
it running on one and waiting for the NJE connection from the other box.


On the other box, I need to have it run with a different userid 
(common CP Directory), and it starts to come up there, but abends with:


GCTABD232E Abend 0C2- occurred during abend ESTAE processing
GCTABD226E Application 'RSCS' failed - System abend B78-

The B78 CMS description talks about using an invalid subpool for a 
getmain. I couldn't find a GCS messages manual on the CDs.


Both RSCS and GRIZRSCS have the same amount of memory. Both had the 
same number of links and auths defined; I dropped a bunch of sample 
links from the GRIZRSCS config. I also thought that, possibly, the 
config filename needed to match the virtual machine name, so I copied 
RSCS CONFIG to GRIZRSCS CONFIG, with the same results.


Would anyone know what I need to do to get RSCS to run under a 
different userid?


--
 .~.Robert P. Nix   Mayo Foundation
 /V\RO-OC-1-13  200 First Street SW
/( )\   507-284-0844Rochester, MN 55905
^^-^^   -
In theory, theory and practice are the same, but
 in practice, theory and practice are different.




No virus found in this incoming message.
Checked by AVG Free Edition.
Version: 7.1.405 / Virus Database: 268.12.8/455 - Release Date: 22/09/2006
 



Re: A rose by any other name... Renaming the RSCS userid...

2006-09-22 Thread Rich Greenberg
On: Fri, Sep 22, 2006 at 09:47:37AM -0500,Nix, Robert P. Wrote:

} This is the first time we've brought up RSCS on our systems, and I got
} it running on one and waiting for the NJE connection from the other box.
} 
} On the other box, I need to have it run with a different userid (common
} CP Directory), and it starts to come up there, but abends with:
} 
} GCTABD232E Abend 0C2- occurred during abend ESTAE processing
} GCTABD226E Application 'RSCS' failed - System abend B78-
} 
} The B78 CMS description talks about using an invalid subpool for a
} getmain. I couldn't find a GCS messages manual on the CDs.
} 
} Both RSCS and GRIZRSCS have the same amount of memory. Both had the same
} number of links and auths defined; I dropped a bunch of sample links
} from the GRIZRSCS config. I also thought that, possibly, the config
} filename needed to match the virtual machine name, so I copied RSCS
} CONFIG to GRIZRSCS CONFIG, with the same results.
} 
} Would anyone know what I need to do to get RSCS to run under a different
} userid?

The abend is (probably) because GRIZRSCS is not listed in the GCS auth
list.  You can:

1) Update the list and regen GCS.

2) In the GCS profile, authorize GRIZRSCS.

3) Make the 191 r/o on both systems and use RSCS on both systems.  If
you do, then the PROFILE GCS would have to determine which system its
running on and start RSCS with the proper config file.  The A disk will
contain both config files.

-- 
Rich Greenberg  N Ft Myers, FL, USA richgr atsign panix.com  + 1 239 543 1353
Eastern time.  N6LRT  I speak for myself  my dogs only.VM'er since CP-67
Canines:Val, Red  Shasta (RIP),Red, Zero  Casey, Siberians  Owner:Chinook-L
Retired at the beach Asst Owner:Sibernet-L


Missing Interrupt on virtual LAN devices

2006-09-22 Thread Berry van Sleeuwen
Hello list,

Some time ago I noticed the performance toolkit reporting missing interru
pt
(s) on devices owned by a zLinux guest. It turned out this is on the 
virtual NIC. Also TCPIP appears to have MI on the virtual LAN devices.

How would this be possible? I wouldn't expect to find a missing interrupt
 
on the guest LAN devices.

What could we do to remove these errors?

We run z/VM 4.4 RSU 501. We have several zLinux guests running on a guest
 
LAN. The guest LAN will be defined as: DEFINE LAN NEPWERK TYPE QDIO 
OWNDERID SYSTEM. All guests have a special in the directory: SPECIAL 0F00
 
QDIO 3 SYSTEM NEPWERK.

Thanks in advance,
Berry.


Re: A rose by any other name... Renaming the RSCS userid...

2006-09-22 Thread Rick Barlow
The first obvious question is did you include GRIZRSCS in the GCS group on
your second system?


Rick Barlow
Systems Engineering Consultant
Nationwide Services Co., Enterprise Business Intelligence Services
Mainframe, z/VM and zSeries Linux Support
One Nationwide Plaza  3-20-13
Columbus OH 43215-2220   U.S.A
Voice: (614) 249-5213Fax: (614) 677-0821
mailto:[EMAIL PROTECTED]


The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on 09/22/2006
10:47:37 AM:

 IBMVM@LISTSERV.UARK.EDU

 This is the first time we've brought up RSCS on our systems, and I
 got it running on one and waiting for the NJE connection from the other
box.
 On the other box, I need to have it run with a different userid
 (common CP Directory), and it starts to come up there, but abends with:
 GCTABD232E Abend 0C2- occurred during abend ESTAE processing
 GCTABD226E Application 'RSCS' failed - System abend B78-
 The B78 CMS description talks about using an invalid subpool for a
 getmain. I couldn't find a GCS messages manual on the CDs.
 Both RSCS and GRIZRSCS have the same amount of memory. Both had the
 same number of links and auths defined; I dropped a bunch of sample
 links from the GRIZRSCS config. I also thought that, possibly, the
 config filename needed to match the virtual machine name, so I
 copied RSCS CONFIG to GRIZRSCS CONFIG, with the same results.
 Would anyone know what I need to do to get RSCS to run under a
 different userid?
 --
  .~.Robert P. Nix   Mayo Foundation
  /V\RO-OC-1-13  200 First Street SW
 /( )\   507-284-0844Rochester, MN 55905
 ^^-^^   -
 In theory, theory and practice are the same, but
  in practice, theory and practice are different.


Uncatalog Files in VM:Backup

2006-09-22 Thread Schuh, Richard
Does anyone know how to remove a specific user's data from the VM:Backup 
catalogs? Commands are preferred over brute force, but I have not found such a 
command - that or I didn't recognize it when I saw it. 

Regards,
Richard Schuh


Re: Uncatalog Files in VM:Backup

2006-09-22 Thread Mike Walter
Last I knew... no can do unless the user's data was in a specific backup 
job (in which case you can expire that job prematurely).

We had a similar legal requirement in which we were required to remove 
data.  The best we could do was to develop and write a new VM:Backup exit 
which prevented restore of specific userid and minidisk (fortunately did 
not have to deal with SFS spaces) backed up on specific dates.  I *think* 
that I opened a DAR with CA for a supported capability to do this, or 
remove such backups from an existing catalog and tapes (a much bigger 
job).

I can share the new exit if you want it.

Mike Walter 
Hewitt Associates 
Any opinions expressed herein are mine alone and do not necessarily 
represent the opinions or policies of Hewitt Associates. 



Schuh, Richard [EMAIL PROTECTED] 

Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU
09/22/2006 10:54 AM
Please respond to
The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU



To
IBMVM@LISTSERV.UARK.EDU
cc

Subject
Uncatalog Files in VM:Backup






Does anyone know how to remove a specific user's data from the VM:Backup 
catalogs? Commands are preferred over brute force, but I have not found 
such a command - that or I didn't recognize it when I saw it. 

Regards,
Richard Schuh




 
The information contained in this e-mail and any accompanying documents may 
contain information that is confidential or otherwise protected from 
disclosure. If you are not the intended recipient of this message, or if this 
message has been addressed to you in error, please immediately alert the sender 
by reply e-mail and then delete this message, including any attachments. Any 
dissemination, distribution or other use of the contents of this message by 
anyone other than the intended recipient 
is strictly prohibited.


Re: A rose by any other name... Renaming the RSCS userid...

2006-09-22 Thread Nix, Robert P.
Thank you; It's been a long time since I used GCS for anything :-) 


-- 
 .~.Robert P. Nix   Mayo Foundation
 /V\RO-OC-1-13  200 First Street SW
/( )\   507-284-0844Rochester, MN 55905
^^-^^   -
In theory, theory and practice are the same, but
 in practice, theory and practice are different.


-Original Message-
From: The IBM z/VM Operating System [mailto:[EMAIL PROTECTED] On
Behalf Of David Kreuter
Sent: Friday, September 22, 2006 9:56 AM
To: IBMVM@LISTSERV.UARK.EDU
Subject: Re: A rose by any other name... Renaming the RSCS userid...

Did you train the GCS segment to know about RSCSXXX ?
David


Re: Uncatalog Files in VM:Backup

2006-09-22 Thread Schuh, Richard
Thanks, Mike. At about the time you replied, Fran Hartmann (I apologize if I 
misspelled your name) called confirming your answer. I don't think I will need 
your exit, but I will keep the offer on the table just in case. 

Regards,
Richard Schuh


 -Original Message-
 From: The IBM z/VM Operating System [mailto:[EMAIL PROTECTED]
 Behalf Of Mike Walter
 Sent: Friday, September 22, 2006 9:07 AM
 To: IBMVM@LISTSERV.UARK.EDU
 Subject: Re: Uncatalog Files in VM:Backup
 
 
 Last I knew... no can do unless the user's data was in a 
 specific backup 
 job (in which case you can expire that job prematurely).
 
 We had a similar legal requirement in which we were required 
 to remove 
 data.  The best we could do was to develop and write a new 
 VM:Backup exit 
 which prevented restore of specific userid and minidisk 
 (fortunately did 
 not have to deal with SFS spaces) backed up on specific 
 dates.  I *think* 
 that I opened a DAR with CA for a supported capability to do this, or 
 remove such backups from an existing catalog and tapes (a much bigger 
 job).
 
 I can share the new exit if you want it.
 
 Mike Walter 
 Hewitt Associates 
 Any opinions expressed herein are mine alone and do not necessarily 
 represent the opinions or policies of Hewitt Associates. 
 
 
 
 Schuh, Richard [EMAIL PROTECTED] 
 
 Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU
 09/22/2006 10:54 AM
 Please respond to
 The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU
 
 
 
 To
 IBMVM@LISTSERV.UARK.EDU
 cc
 
 Subject
 Uncatalog Files in VM:Backup
 
 
 
 
 
 
 Does anyone know how to remove a specific user's data from 
 the VM:Backup 
 catalogs? Commands are preferred over brute force, but I have 
 not found 
 such a command - that or I didn't recognize it when I saw it. 
 
 Regards,
 Richard Schuh
 
 
 
 
  
 The information contained in this e-mail and any accompanying 
 documents may contain information that is confidential or 
 otherwise protected from disclosure. If you are not the 
 intended recipient of this message, or if this message has 
 been addressed to you in error, please immediately alert the 
 sender by reply e-mail and then delete this message, 
 including any attachments. Any dissemination, distribution or 
 other use of the contents of this message by anyone other 
 than the intended recipient 
 is strictly prohibited.
 


Re: A rose by any other name... Renaming the RSCS userid...

2006-09-22 Thread Fran Hensler
Robert -
 
Here's a quick and dirty way to get your RSCSXXX running without an
IPL of GCS:
 
I did this from my VM USER OPERATOR (I don't know what priviliges are
required):
 
cp set secuser gcs *
HCPCFX6768I SECUSER of GCS initiated.
Ready; T=0.01/0.01 13:54:23
 
cp send gcs  CONFIG AUTHUSER ADD RSCSXXX
GCS : 'RSCSXXX' can now IPL as an authorized virtual machine.
Ready; T=0.01/0.01 13:54:48
GCS : Ready;
 
 
o make this permanent add to your PROFILE GCS on the GCS
machine:
 
'CONFIG AUTHUSER ADD RSCSXXX'
 
/Fran Hensler at Slippery Rock University of Pennsylvania USA for 43 years
 [EMAIL PROTECTED] +1.724.738.2153
Yes, Virginia, there is a Slippery Rock
 
 
 
 
 
On Fri, 22 Sep 2006 09:47:37 -0500 Nix, Robert P. said:
This is the first time we've brought up RSCS on our systems, and I got
it running on one and waiting for the NJE connection from the other box.

On the other box, I need to have it run with a different userid (common
CP Directory), and it starts to come up there, but abends with:

GCTABD232E Abend 0C2- occurred during abend ESTAE processing
GCTABD226E Application 'RSCS' failed - System abend B78-

The B78 CMS description talks about using an invalid subpool for a
getmain. I couldn't find a GCS messages manual on the CDs.

Both RSCS and GRIZRSCS have the same amount of memory. Both had the same
number of links and auths defined; I dropped a bunch of sample links
from the GRIZRSCS config. I also thought that, possibly, the config
filename needed to match the virtual machine name, so I copied RSCS
CONFIG to GRIZRSCS CONFIG, with the same results.

Would anyone know what I need to do to get RSCS to run under a different
userid?

--
 .~.Robert P. Nix   Mayo Foundation
 /V\RO-OC-1-13  200 First Street SW
/( )\   507-284-0844Rochester, MN 55905
^^-^^   -
In theory, theory and practice are the same, but
 in practice, theory and practice are different.





One step further... RSCS NJE via FCTC

2006-09-22 Thread Nix, Robert P.
Once the second rscs starts, It's link immediately deactivates. The
message I see is:

DMTNCR916E Invalid NJE signon connection record received -- Link POLAR
is being deactivated.

On the other node's RSCS I see:

DMTNET951I Sign-off record received -- Link GRIZZLY being deactivated. 

After which it cycles and restarts.

I tried adding matching RLPASS, RNPASS, TLPASS, and TNPASS parms on the
PARM records for the two links. Same results.


-- 
 .~.Robert P. Nix   Mayo Foundation
 /V\RO-OC-1-13  200 First Street SW
/( )\   507-284-0844Rochester, MN 55905
^^-^^   -
In theory, theory and practice are the same, but
 in practice, theory and practice are different.


-Original Message-
From: The IBM z/VM Operating System [mailto:[EMAIL PROTECTED] On
Behalf Of Rick Barlow
Sent: Friday, September 22, 2006 10:00 AM
To: IBMVM@LISTSERV.UARK.EDU
Subject: Re: A rose by any other name... Renaming the RSCS userid...

The first obvious question is did you include GRIZRSCS in the GCS group
on
your second system?


Rick Barlow
Systems Engineering Consultant
Nationwide Services Co., Enterprise Business Intelligence Services
Mainframe, z/VM and zSeries Linux Support
One Nationwide Plaza  3-20-13
Columbus OH 43215-2220   U.S.A
Voice: (614) 249-5213Fax: (614) 677-0821
mailto:[EMAIL PROTECTED]


The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on
09/22/2006
10:47:37 AM:

 IBMVM@LISTSERV.UARK.EDU

 This is the first time we've brought up RSCS on our systems, and I
 got it running on one and waiting for the NJE connection from the
other
box.
 On the other box, I need to have it run with a different userid
 (common CP Directory), and it starts to come up there, but abends
with:
 GCTABD232E Abend 0C2- occurred during abend ESTAE processing
 GCTABD226E Application 'RSCS' failed - System abend B78-
 The B78 CMS description talks about using an invalid subpool for a
 getmain. I couldn't find a GCS messages manual on the CDs.
 Both RSCS and GRIZRSCS have the same amount of memory. Both had the
 same number of links and auths defined; I dropped a bunch of sample
 links from the GRIZRSCS config. I also thought that, possibly, the
 config filename needed to match the virtual machine name, so I
 copied RSCS CONFIG to GRIZRSCS CONFIG, with the same results.
 Would anyone know what I need to do to get RSCS to run under a
 different userid?
 --
  .~.Robert P. Nix   Mayo Foundation
  /V\RO-OC-1-13  200 First Street SW
 /( )\   507-284-0844Rochester, MN 55905
 ^^-^^   -
 In theory, theory and practice are the same, but
  in practice, theory and practice are different.


One step further... RSCS NJE via FCTC

2006-09-22 Thread Les Geer (607-429-3580)
Once the second rscs starts, It's link immediately deactivates. The
message I see is:

DMTNCR916E Invalid NJE signon connection record received -- Link POLAR
is being deactivated.

On the other node's RSCS I see:

DMTNET951I Sign-off record received -- Link GRIZZLY being deactivated.=20

After which it cycles and restarts.

I tried adding matching RLPASS, RNPASS, TLPASS, and TNPASS parms on the
PARM records for the two links. Same results.

Does the link name match the RSCS node name on the other side?  Or
have you used the node link parameter to indicate the name of the
node on the other side?


Best Regards,
Les Geer
IBM z/VM and Linux Development


Re: DFDSS

2006-09-22 Thread Jim Bohnsack
It appears from this thread that the question and most of the responses 
referred to backing up Linux volumes, but I discovered something last 
spring or so when we were polishing up our D/R backups.  We use DFDSS on 
z/OS to do full volume D/R dumps for both our MVS as well as our VM 
dumps.  My initial thought was that we could use S/A ADRDSSU to restore 
a single volume VM system and then get a bunch of restores running at 
the same time.  You can't do that, at least easily.  S/A ADRDSSU does 
not restore, at least correctly, the allocation bit map (rec 4 or 5??) 
on a CP owned volume that maps out space.  I guess you could use S/A 
ADRDSSU for the restore and then S/A ICKDSF to allocate, but if your 
record keeping is out of sync with what's on your tape, you're out of 
luck.  This is documented in the ADRDSSU manual, at least as far as not 
being able to correctly restore the allocation record for a VM volume.  
This is only the case for the S/A version of the program.


We ended up documenting the S/A restore of a starter MVS system and then 
we'll use it to restore everything else.  Wish we had FDR.


Jim

Marcy Cortes wrote:

This is a multi-part message in MIME format.

--_=_NextPart_001_01C6DCED.566D9DD0
Content-Type: text/plain;
charset=us-ascii
Content-Transfer-Encoding: quoted-printable

Anybody backing up VM volumes using this on z/OS? =20

Marcy Cortes
Enterprise Hosting Services - z/VM and z/Linux
(415) 243-6343
  

--
Jim Bohnsack
Cornell University
(607) 255-1760
[EMAIL PROTECTED]


Changing system name - does it affect anything?

2006-09-22 Thread Ranga Nathan
I am flash-copying our test  zvm 5.2 environment to create a new test 
environment, which eventually will become production. After I do the 
flash-copy, I want to adjust the system parameters including the 
System_Identifier_Default.  I did notice that I had to specify the 
system id when installing/configuring DVHMOVE, in the CONFIGAA DATADVH 
file. When I change the system id, are there other places that will be 
affected?


Re: Changing system name - does it affect anything?

2006-09-22 Thread Mike Walter
Ranga,

If you use RSCS, or CMS commands SENDFILE or NOTE, you may want to check 
SYSTEM NETID on the S-disk (MAINT 190).

The 'SYSTEM_IDentifier' is displayed in the lower-right hand corner of 
3270 screens.  Attentive CMS users may notice a change.

The 'SYSTEM_IDentifier' is also returned in the reply from 'CP QUERY 
USERID' - a fact that can, if desired, be used to change the way things 
get started up within the  PROFILE EXEC or elsewhere.  We use it to affect 
how things get done after IPL for disaster recovery.

Mike Walter 
Hewitt Associates 
Any opinions expressed herein are mine alone and do not necessarily 
represent the opinions or policies of Hewitt Associates. 






Ranga Nathan [EMAIL PROTECTED] 

Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU
09/22/2006 01:58 PM
Please respond to
The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU



To
IBMVM@LISTSERV.UARK.EDU
cc

Subject
Changing system name - does it affect anything?






I am flash-copying our test  zvm 5.2 environment to create a new test 
environment, which eventually will become production. After I do the 
flash-copy, I want to adjust the system parameters including the 
System_Identifier_Default.  I did notice that I had to specify the 
system id when installing/configuring DVHMOVE, in the CONFIGAA DATADVH 
file. When I change the system id, are there other places that will be 
affected?




 
The information contained in this e-mail and any accompanying documents may 
contain information that is confidential or otherwise protected from 
disclosure. If you are not the intended recipient of this message, or if this 
message has been addressed to you in error, please immediately alert the sender 
by reply e-mail and then delete this message, including any attachments. Any 
dissemination, distribution or other use of the contents of this message by 
anyone other than the intended recipient 
is strictly prohibited.


Some interesting developments in grid computing and other web services - cross-posted from Boston.pm mailing list

2006-09-22 Thread Ranga Nathan

Some interesting developments in grid computing
- Forwarded by Ranga Nathan/AMERICA/BAX on 09/22/2006 04:29 PM -
*Tom Metro [EMAIL PROTECTED]*

Sent by: [EMAIL PROTECTED]

09/22/2006 03:45 PM


To
L-boston-pm boston-pm@mail.pm.org
cc

Subject
[Boston.pm] Jeff Barr's talk: Amazon's web services









I wrote up my notes on Jeff Barr's talk to Boston.pm on 9/13/2006 for
some colleagues, and figured I might as well post a copy here for anyone
who wasn't able to attend.


Here are some of the highlights:


The Elastic Compute Cloud
http://www.amazon.com/b/ref=sc_fe_c_1_3435361_1/104-6093751-9591919?ie=UTF8node=201590011no=3435361me=A36L942TSJ2AJA

A general purpose grid or cluster of machines. It uses Xen virtualized
machines and they'll rent you the equivalent of a 1.7 GHz Xenon CPU
w/1.7 GB of RAM, 160 GB HD, and 256 Mbps network (probably 1/4 of a
blade) for 10 cents/hr. You provide your application as a Xen image, and
load it up onto as many machines as you need. This can be used for a
variety of tasks - from compute intensive operations, to bulk data
processing, to web hosting. One example the speaker mentioned was a
telephone company using it to process end-of-the-month billing, where
the compute capacity is only needed for a few days out of the month.

The Elastic Compute Cloud is only 4 weeks old (and still in limited
beta), but it potentially will have a big impact on Internet startups.
Now it is no longer necessary to pay for substantial infrastructure up
front. You just expand to more machines almost transparently as your
business grows. (Though you could always rent machines, the ability to
expand and contract capacity wasn't as flexible.) The speaker told a
story of a friend who declined a VC investment because this service
allowed him to avoid the up-front expenses.


Alexa web services
http://www.amazon.com/b/ref=sc_fe_l_2/104-6093751-9591919?ie=UTF8node=239513011no=3435361me=A36L942TSJ2AJA

It's basically the database and processing infrastructure of a search
engine that you rent, which you can then layer your specific search
engine design on top of. Their database includes a bunch of meta data on
the spidered sites, including a web map, which is the linking
relationships between sites. They also have a thumbnail service that
returns an image for a specific site. And they have a custom processing
cluster that can execute custom data processing code (at a rate of
$1/CPU/hour; the speaker speculated the price may drop now that the ECC
service is priced so much lower).


Amazon's Simple Storage Service (S3)
http://www.amazon.com/S3-AWS-home-page-Money/b/ref=sc_fe_l_2/104-6093751-9591919?ie=UTF8node=16427261no=3435361me=A36L942TSJ2AJA

Amazon's answer to online storage. This has been available for 6 months
or so, and already several startups (such as photo sharing services and
PC backup services) are using it as their back-end storage
infrastructure. It's been written about a lot, so I'll just mention that
the rates are 15 cents per GB per month, and 20 cents per GB for
transfers. It was also mentioned that S3 is on the same internal network
as The Elastic Compute Cloud, and that there are no transfer costs
between the two. Some related links:

JungleDisk (open standard/closed source/multi-platform, runs as a WebDAV
server, $0.15/GB)
http://jungledisk.com/

filicio.us (web-based file storage and sharing front-end for S3)
http://www.filicio.us/

Amazon Web Services Developer Connection:
s3sync -- a simple rsync look-alike
http://developer.amazonwebservices.com/connect/thread.jspa?messageID=37272tstart=0#37272

S3Fox Organizer (Firefox extension)
http://www.rjonna.com/ext/s3fox.php

s3/fuse (Linux file system for S3)
http://dev.extensibleforge.net/wiki/s3/fuse

Windows-only commercial backup services using S3:
http://elephantdrive.com/
http://altexa.com/


Amazon Mechanical Turk
http://www.amazon.com/Mechanical-Turk-AWS-home-page/b/ref=sc_fe_l_2/104-6093751-9591919?ie=UTF8node=15879911no=3435361me=A36L942TSJ2AJA
http://www.mturk.com/

Described as Artificial Artificial Intelligence or people as a
service. This service provides the infrastructure for automating the
process of assigning small tasks to people - tasks that are too
difficult or impossible for computers to do. An example of a task is
image processing: does this image contain a picture of a human? This
task can be given to thousands of people, with multiple people
processing the same images to improve accuracy. Another example is
transcribing podcasts. It can also be used for marketing surveys. (Who
would have thought Amazon would end up dominating the get paid to take
surveys market.) One entertaining example use was for an art project,
where people were paid to draw sheep (http://www.thesheepmarket.com/).

HIT-Builder for Amazon's Mechanical Turk (a tool for creating tasks)
http://www.hit-builder.com/

CastingWords (podcast transcription services that uses AMT)