Hi,
So, when a cloud machine fails does it get de-allocated/wiped out? or
does it is it still out there in a bad state? how do you recover your
data?
It depends. Sometimes it dies and you can't do anything with it. In
others you can restart it. As we store the data on EBS (which is a
network
Hi,
On Tue, Jun 16, 2009 at 11:05 AM, Greg Smithgsm...@gregsmith.com wrote:
You just have to recognize that the volumes are
statistically pretty fragile compared to a traditional RAID configuration on
dedicated hardware and plan accordingly.
I agree completely. I think the advantage is that
Hi,
I have more than a few Postgres instances on EC2. For reliability I
use EBS, and take regular snapshots while also streaming the WAL files
to S3. So far, the few times that my machine died, I had no issue with
getting it back from EBS or the EBS volume. I also take tar backups
every day, and
on the cloud, but not by a big margin. I might see it more
because I have hundreds of instances running.
Bye,
Guy.
On Mon, Jun 15, 2009 at 3:46 PM, David Kerrd...@mr-paradox.net wrote:
On Mon, Jun 15, 2009 at 12:11:54PM -0700, Just Someone wrote:
- Hi,
-
- I have more than a few Postgres instances
Hi,
I have a DB with a large number schemas (around 10K) and a large
number of tables (400K). The app became slow lately, and logging the
slow queries, I see more than a few like this:
SELECT: LOG: duration: 169547.424 ms statement: SELECT
attr.attname, name.nspname, seq.relname
Hi,
I'm wondering... just 4GB of ram?
What's the normal hammering -- a.k.a. user access -- to all of this?
PG, as expected, launches a separate process for each connection. this eats
up
resources quite quickly
Did you check your system processes with 'top' ? how's it looking for
Hi Tom,
Here is the result of explain analyze (though this one took 1500ms and
not 169000):
On Mon, Mar 31, 2008 at 7:37 AM, Tom Lane [EMAIL PROTECTED] wrote:
Just Someone [EMAIL PROTECTED] writes:
Any ideas how to start finding the culprit?
EXPLAIN ANALYZE?
explain analyze SELECT
Hi Tom,
Well, it's hard to be sure what the problem is when you're not showing
us a problem case ... but I notice that this indexscan is estimated
awfully high:
Whenever I do it manually it works fast. But in the log I see lots of
slow ones. Could it be caused by auto vacuum? Or by check
I have a database with multiple schemas all with the same structure
(but of course different data...).
I want to create a view that will be created in a shared schema, and
when executed will be executed against the current schema. Whenever I
try it, it seems the view is linked to a specific
Cool!
That explains it fully. So i guess there will be a better performance
to the pre-generated views at the price of more views.
Thanks!
On 11/6/06, Merlin Moncure [EMAIL PROTECTED] wrote:
On 11/6/06, Just Someone [EMAIL PROTECTED] wrote:
I have a database with multiple schemas all
I am using a similar solution, and I tested it with a test containing
20K+ different schemas. Postgres didn't show slowness at all even
after the 20K (over 2 million total tables) were created. So I have
feeling it can grow even more.
Guy.
On 9/28/06, snacktime [EMAIL PROTECTED] wrote:
I'm re
If you rather keep SELinux on, you can still set the SELinux context
on the directory where you want the tablespaces to one postgres will
like.
To find what is the permissions you need, you can use ls -Z. It will
list the SELinux context. Check /var/lib/pgsql/data (or wherever
postgres data is
I'm trying to generate a query that will handle tags matching in a database.
The simplified structure is
create table contacts (
id serial primary key,
name varchar
);
create table books (
id serial primary key,
name varchar
);
create table tags (
id serial primary key,
name varchar
The schema can change, but I rather not.
The use case is a web app where you can tag items with tags
(many-2-many). There are multiple items you can tag: contacts,
schedules, lists, etc... And then you can search and categorize by
tags. The standard for this if you look aroung the web is to
I have a process for PITR backups running nicely. I'm pretty amazed by
the smoothness of it all!
Now I'm looking at the retrieval part, and I have something I'm
looking for clarification on.
The documentation say that a recovery.conf file is needed for the
restore. My tests indicate that I can
I implemented wal archiving and it seems to be working. The segments
are being copied by the shell script, and in the pg_log file I see
this line:
LOG: archived transaction log file 0001001D0096
But the file is still int he pg_xlog directory. In the documentation I
read that it
What is the best way to find the latest partial WAL file?
Based on my tests, using the mtime isn't 100% accurate, as if a
pg_start_backup/pg_stop_backup() operation is run, the .backup file
created might be newer than the last WAL file. It also seems that the
WAL file related to the backup is
Hi Tom,
If you sort first by mtime and second by file name you should find the
right one in all cases, ie, take the latest mtime among the
properly-named files, breaking ties by taking the higher filename.
It'd probably be better if we had a function to report this, but
you can get along
After exchanging a few emails regarding pgbench in the list, I was
thinking it'll be cool to have a place to post pgbench resulats from
all over the place. Just so people can get an idea of what others are
getting.
If more people think it's a good idea, I'll be glad to host it as part
of my blog.
Hi Magnus,
It might seem that I'm selling ext3 or something :) but it's the linux
filesystem I know best.
If you want ext3 to perform with large directories, there is an mkfs
option that enables directory hashing that you can try: -O dir_index.
Not at all (sell ext3 ;-) ). It's great to get
Hi,
I am creating a hosted solution that I want to base on separation by
schemas. So that each hosted family we will have, will have a schema
assigned to it (and a user). On login I will set the search path, and
so each family will see it's tables. This is all tested and works
fine.
But I would
Hi Jim,
Just make sure you increase max_fsm_relations, and that max_fsm_pages is
at least max_fsm_relations, because each relation must get at least
one page.
I increased it to 4 relations, should I go even higher?
--
Family management on rails: http://www.famundo.com - coming soon!
My
Hi Jim,
On 3/24/06, Jim Nasby [EMAIL PROTECTED] wrote:
You want max_fsm_relations to be greater than select count(*) from pg_class
where
relkind in ('i','t') *across all databases*. And you want max_fsm_pages to be
bigger than
that. That's the only way you can be assured that you'll be
the fsm part in a different way?
Bye,
Guy.
On 3/24/06, Jim C. Nasby [EMAIL PROTECTED] wrote:
On Fri, Mar 24, 2006 at 11:15:56AM -0800, Just Someone wrote:
Hi Jim,
On 3/24/06, Jim Nasby [EMAIL PROTECTED] wrote:
You want max_fsm_relations to be greater than select count(*) from
I was doing some load testing on a server, and decided to test it with
different file systems to see how it reacts to load/speed. I tested
xfs, jfs and ext3. The machine runs FC4 with the latest 2.6.15 kernel
from Fedora.
Hardware: Dual Opteron 246, 4GB RAM, Adaptec 2230 with battery backup,
2
, Bernhard Weisshuhn wrote:
Just Someone wrote:
2 10K SCSI disks in RAID1 for OS and WAL (with it's own partiton on
ext3),
You'll want the WAL on its own spindle. IIRC a separate partition
on a shared disc won't give you much benefit. The idea is to keep
the disc's head from moving away
Hi,
Did you re-initialize the test pgbench database between runs?
I get weird results otherwise since some integers gets overflowed in the
test (it doesn't complete the full 1 transactions after the first run).
No, I didn't. The reason is that I noticed that the first run is
always MUCH
now Average of 813.65tps with a standard
deviation of: 130.33.
I hope this kernel doesn't panic on me. But I'll know just tomorrow as
I'm pounding on the machine now.
Bye,
Guy.
On 3/23/06, Magnus Naeslund(f) [EMAIL PROTECTED] wrote:
Just Someone wrote:
Initialized the data with: pgbench -i
Hi Tom,
Hmm. That seems like a SELinux policy bug. It doesn't happen for me:
the pid file is created with the same context the other files have.
I agree! I have the latest FC4 policy update. So I downloaded the
sources as the new one didn't solve the issue. The policy source has
no mention
,
Guy.
On 3/3/06, Just Someone [EMAIL PROTECTED] wrote:
Hi Tom,
Hmm. That seems like a SELinux policy bug. It doesn't happen for me:
the pid file is created with the same context the other files have.
I agree! I have the latest FC4 policy update. So I downloaded the
sources as the new one
Hi,
I know this isn't directly a postgres issue, but it might help a few
other users, so here goes.
I did an upgrade on my Fedora Core 4 system, and postgres (8.1.2 from
the postgres packages, not FC packages) stopped working because of
permission issues when trying to create postmaster.pid in
for itself with ext2
* SELinux in targeted policy mode
Bye,
Guy.
On 3/1/06, Tom Lane [EMAIL PROTECTED] wrote:
Just Someone [EMAIL PROTECTED] writes:
I researched it a bit, and tried a few things, and discovered that the
problem is in the init script at /etc/init.d/postgres users runuser
Hi,
I'm looking into creating a hosted application with Postgres as the
SQL server. I would like to get some ideas and oppinions about the
different ways to separate the different clients, using postgres.
The options I had in mind:
1) Create a different database per client. How much overhead
33 matches
Mail list logo
