Re: Best way to add a huge dataset?

2010-03-13 Thread Daniele
This is an hard step and depend by the size of default dataset (?).

Just an idea (I've not tested it):

* Create a controller for the update with an upload field.
* Upload a DB with the basic dataset only. The file will update in
the /temp dir.
* Find out you postgres config reading the config/database.yml
* Execute (within the controller or by console) `psql ...` to import
tables. Two ways:
** Realtime overwriting (perhaps you have to put the app in
maintenance mode)
** Import with a different name, then delete the originals table and
rename the new ones

I don't know if Heroku folks are happy about this a bit system level
procedure :P

On 13 Mar, 01:46, Mike mikel...@gmail.com wrote:
 Those are really good ideas. Would there be any way you can think of
 to push data back up to the server?

-- 
You received this message because you are subscribed to the Google Groups 
Heroku group.
To post to this group, send email to her...@googlegroups.com.
To unsubscribe from this group, send email to 
heroku+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/heroku?hl=en.



Change Console Prompt?

2010-03-13 Thread Ray
Hi

Not being a true IRB the Heroku console doesn't seem to respond to the
normal techniques for customising the prompt.  I sometimes have
multiple consoles open on different apps and would love to be able to
customise the prompt to help me see which app I'm talking to.

I Googled and searched this group, expecting to find an immediate
solution to what I thought would be a trivial problem, but found
nothing!  Has anyone done this before?

Cheers

Ray

-- 
You received this message because you are subscribed to the Google Groups 
Heroku group.
To post to this group, send email to her...@googlegroups.com.
To unsubscribe from this group, send email to 
heroku+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/heroku?hl=en.



Using Zerigo to simplify S3 urls

2010-03-13 Thread DAZ
Hi,

I'm storing some pdf documents on Amazon S3. To access them I use urls
like:
http://energie.documents.s3.amazonaws.com/news.pdf

Is it possible I can configure Zerigo (or anything else) to map
http://www.energiehelpline.co.uk/documents/

to

http://energie.documents.s3.amazonaws.com/

This would help to simplify the urls used for these documents.

Thanks,

DAZ

-- 
You received this message because you are subscribed to the Google Groups 
Heroku group.
To post to this group, send email to her...@googlegroups.com.
To unsubscribe from this group, send email to 
heroku+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/heroku?hl=en.



Cron Job to save bundles

2010-03-13 Thread DAZ
I'm using the free bundle addon that has the limitation of only one
bundle saved at a time.

Is it possible to create a Cron Job that does the following:
deleted the current bundle
save a new bundle
downloaded it each day

cheers,

DAZ

-- 
You received this message because you are subscribed to the Google Groups 
Heroku group.
To post to this group, send email to her...@googlegroups.com.
To unsubscribe from this group, send email to 
heroku+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/heroku?hl=en.



Re: Using Zerigo to simplify S3 urls

2010-03-13 Thread Matt Buck
http://docs.amazonwebservices.com/AmazonS3/latest/VirtualHosting.html#VirtualHostingCustomURLs

HTH,
Matt Buck

On Sat, Mar 13, 2010 at 10:38 AM, DAZ daz4...@gmail.com wrote:

 Hi,

 I'm storing some pdf documents on Amazon S3. To access them I use urls
 like:
 http://energie.documents.s3.amazonaws.com/news.pdf

 Is it possible I can configure Zerigo (or anything else) to map
 http://www.energiehelpline.co.uk/documents/

 to

 http://energie.documents.s3.amazonaws.com/

 This would help to simplify the urls used for these documents.

 Thanks,

 DAZ

 --
 You received this message because you are subscribed to the Google Groups
 Heroku group.
 To post to this group, send email to her...@googlegroups.com.
 To unsubscribe from this group, send email to
 heroku+unsubscr...@googlegroups.comheroku%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/heroku?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Heroku group.
To post to this group, send email to her...@googlegroups.com.
To unsubscribe from this group, send email to 
heroku+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/heroku?hl=en.



Re: Cron Job to save bundles

2010-03-13 Thread Matt Buck
I use this rake task to accomplish that:
https://gist.github.com/1d2853b0a349768a8884

- Matt Buck

On Sat, Mar 13, 2010 at 10:56 AM, DAZ daz4...@gmail.com wrote:

 I'm using the free bundle addon that has the limitation of only one
 bundle saved at a time.

 Is it possible to create a Cron Job that does the following:
 deleted the current bundle
 save a new bundle
 downloaded it each day

 cheers,

 DAZ

 --
 You received this message because you are subscribed to the Google Groups
 Heroku group.
 To post to this group, send email to her...@googlegroups.com.
 To unsubscribe from this group, send email to
 heroku+unsubscr...@googlegroups.comheroku%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/heroku?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Heroku group.
To post to this group, send email to her...@googlegroups.com.
To unsubscribe from this group, send email to 
heroku+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/heroku?hl=en.



Not all processes could be identified - Error in logs

2010-03-13 Thread knodi
** [NewRelic] Connected to NewRelic Service at collector0.newrelic.com:
80
** [NewRelic] Reporting performance data every 60 seconds.
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
!! Unexpected error while processing request: undefined method `[]'
for nil:NilClass
** [NewRelic] Connected to NewRelic Service at collector0.newrelic.com:
80
** [NewRelic] Reporting performance data every 60 seconds.

Is this normal?

-- 
You received this message because you are subscribed to the Google Groups 
Heroku group.
To post to this group, send email to her...@googlegroups.com.
To unsubscribe from this group, send email to 
heroku+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/heroku?hl=en.



Heroku technical questions

2010-03-13 Thread Chris
I've been playing with Heroku for the last few weeks trying to get an
idea of whether I want to launch my next site on Heroku.  I have a
couple of questions for Oren (or anyone else at Heroku that can answer
them).

1) How often do problems like apps not being able to spin up like what
happened today happen?  In other words, I'd like to see real uptime
statistics for Heroku.
2) In the event that a new app can't be brought online (like what
happened on Heroku today) what systems/processes are in place at
Heroku for the administrators to become aware of the problem?  In
other words, is there an automated system, or is it reliant on users
like myself posting support requests?  (Note:  Todays outing had
nothing to do with my code, but was an internal Heroku error).
3) The Heroku status page http://status.heroku.com/ said the following:
[QUOTE]
App Spinup Interruption
MAR 14, 2010 – 2:19 UTC
New and idled apps can not be spun up. We are working on resolving the
problem immediately, and expect a fix in the next 30 minutes. All
running apps are currently fully operational.
[/QUOTE]

and a subsequent post said:
[QUOTE]
All Systems Go
MAR 14, 2010 – 3:30 UTC
No known issues at this time.
[/QUOTE]

However, my app would still not start at Mar 14, 2010 - 4:25 UTC.

So, what exactly is the definition of New and idled apps.   My
understanding is that as long as I'm paying for dynos that my app will
not go idle, but if I increase the dynos from say 4 to 10 are the 6
new dynos considered 'new' and won't start in such a situation?  What
about workers?

What about accidentally pushing a 'new' version of code during such an
outage?  I assume this would effectively bring my running app offline.

4) If I have a running app that is being concurrently hit by say 100
users.  What is the exact process the server takes when I push a new
version of code?  In other words, do those 100 users immediately get
disconnected, or does Heroku spin up the new app, redirecting all new
requests to the new version once it is online, and then terminate the
'old' version dynos after all existing requests to those dynos have
been satisfied?  Basically, what is the user experience for someone
who is in the middle of submitting their credit card info at the
precise time that I push a new version of code?

5) I'm a little concerned about recent posts dealing with getting
large datasets in and out of the database on Heroku.  I've read plenty
of creative ideas on how to get the data in and out, but nothing that
would really be considered acceptable for a high traffic site that
needs virtually zero downtime (especially with the posts saying that
Taps gets really slow after about 500 MB).  Does Heroku have any plans
of making it easier to get large datasets in and out of the database?
What about scaling the database?  It's easy to spin up app dynos, but
what about moving from a Fugu database to a Zilla?  What kind of
downtime are we looking at for such a transition?  (How about from
Ronin - Fugu?)  The faqs state: Switching to/from a dedicated
database usually takes one business day as our support staff processes
the requests, and verifies that data migrations completed
successfully.  I assume this is for switching between say Koi and
Ronin, but is it also true for Ronin-Fugu-Zilla?

6) I assume I would be looking to move away from Heroku long before I
reached 2TB of data limit on the database (since at that point I would
be looking for redundant systems that can have read/write traffic
separated, etc which Heroku doesn't appear to support), but how would
I get this data off Heroku?

7) What systems are used to store the database data?  In other words,
how safe is my data in the event of system failure (hard disk, etc)?
Single disk,  Raid 1, Raid 5, Raid 10, etc?

8) In the event of system failure, what kind of support can I expect
from Heroku to get the database back online?  (Meaning that a hard
disk failure with a response of restore from your backup bundle
would not be considered acceptable.  Transaction logs would need to be
replayed, etc.)

9) DNS related:  Is it possible to have say 2 set subdomains for a
given domain (ex: forums.mydomain.com, chat.mydomain.com) that point
to separate apps, and then have a catchall domain point to a 3rd app?
Ex:  subdomainXYZ.mydomain.com points to a given app for any value of
XYZ.  The docs seem to indicate that I need to use the heroku console
to add any subdomains, so what I'm looking for is how I would add a
catchall domain in Heroku.

Basically I'm debating using Heroku vs. Amazon EC2 directly vs.
running my own servers and want to understand all the variables
involved with Heroku.

Thanks in advance.
-Chris

-- 
You received this message because you are subscribed to the Google Groups 
Heroku group.
To post to this group, send email to her...@googlegroups.com.
To unsubscribe from this group, send email to 
heroku+unsubscr...@googlegroups.com.
For more options, visit this group at