Re: [HACKERS] pg_regress inputdir

2008-09-22 Thread Peter Eisentraut

Peter Eisentraut wrote:

Tom Lane wrote:

But I think Alvaro is worried about something
at a higher level: the regression test process as a whole has some
directory layout assumptions built into it, particularly in regards
to where to find .so's.


The only information about the location of the .so's is in the test 
files themselves, which seems reasonable, because they are created and 
installed at the same time as the .so's that they are presumably 
supposed to test.  So I see no problem here.


Here is a more involved patch that fixes all these issues.  The major 
simplication is that the input files are looked for in both the build 
tree and the source tree (like a vpath search), which allowed me to 
remove a lot of redundant makefile code.  I could also remove the 
--srcdir option but added --dlpath to address the above mentioned issue 
and changed some option defaults.  Now you can run pg_regress inside and 
outside of the build tree.  It isn't quite ready for the general public, 
but a packager that wants to adopt this can use it.  Currently, you need 
to create the directories sql, expected, and testtablespace yourself, 
when running outside the build tree.  We can attempt to sort that out 
later, but SELinux might make it difficult.
diff -cr -x TAGS ../cvs-pgsql/src/makefiles/pgxs.mk ./src/makefiles/pgxs.mk
*** ../cvs-pgsql/src/makefiles/pgxs.mk  2008-04-07 17:15:58.0 +0300
--- ./src/makefiles/pgxs.mk 2008-09-22 20:40:39.0 +0300
***
*** 232,254 
  # where to find psql for running the tests
  PSQLDIR = $(bindir)
  
- # When doing a VPATH build, must copy over the test .sql and .out
- # files so that the driver script can find them.  We have to use an
- # absolute path for the targets, because otherwise make will try to
- # locate the missing files using VPATH, and will find them in
- # $(srcdir), but the point here is that we want to copy them from
- # $(srcdir) to the build directory.
- 
- ifdef VPATH
- abs_builddir := $(shell pwd)
- test_files_src := $(wildcard $(srcdir)/sql/*.sql) $(wildcard 
$(srcdir)/expected/*.out) $(wildcard $(srcdir)/data/*.data)
- test_files_build := $(patsubst $(srcdir)/%, $(abs_builddir)/%, 
$(test_files_src))
- 
- all: $(test_files_build)
- $(test_files_build): $(abs_builddir)/%: $(srcdir)/%
-   ln -s $< $@
- endif # VPATH
- 
  .PHONY: submake
  submake:
  ifndef PGXS
--- 232,237 
diff -cr -x TAGS ../cvs-pgsql/src/pl/plperl/GNUmakefile 
./src/pl/plperl/GNUmakefile
*** ../cvs-pgsql/src/pl/plperl/GNUmakefile  2008-04-07 17:15:58.0 
+0300
--- ./src/pl/plperl/GNUmakefile 2008-09-22 20:29:07.0 +0300
***
*** 50,76 
  SPI.c: SPI.xs
$(PERL) $(perl_privlibexp)/ExtUtils/xsubpp -typemap 
$(perl_privlibexp)/ExtUtils/typemap $< >$@
  
- # When doing a VPATH build, copy over the .sql and .out files so that the
- # test script can find them.  See comments in src/test/regress/GNUmakefile.
- ifdef VPATH
- 
- ifneq ($(PORTNAME),win32)
- abs_srcdir := $(shell cd $(srcdir) && pwd)
- abs_builddir := $(shell pwd)
- else
- abs_srcdir := $(shell cd $(srcdir) && pwd -W)
- abs_builddir := $(shell pwd -W)
- endif
- 
- test_files_src := $(wildcard $(srcdir)/sql/*.sql) $(wildcard 
$(srcdir)/expected/*.out)
- test_files_build := $(patsubst $(srcdir)/%, $(abs_builddir)/%, 
$(test_files_src))
- 
- all: $(test_files_build)
- $(test_files_build): $(abs_builddir)/%: $(srcdir)/%
-   ln -s $< $@
- 
- endif
- 
  install: all installdirs install-lib
  
  installdirs: installdirs-lib
--- 50,55 
diff -cr -x TAGS ../cvs-pgsql/src/pl/plpython/Makefile 
./src/pl/plpython/Makefile
*** ../cvs-pgsql/src/pl/plpython/Makefile   2008-04-07 17:15:58.0 
+0300
--- ./src/pl/plpython/Makefile  2008-09-22 20:30:40.0 +0300
***
*** 66,92 
  
  all: all-lib
  
- # When doing a VPATH build, copy over the .sql and .out files so that the
- # test script can find them.  See comments in src/test/regress/GNUmakefile.
- ifdef VPATH
- 
- ifneq ($(PORTNAME),win32)
- abs_srcdir := $(shell cd $(srcdir) && pwd)
- abs_builddir := $(shell pwd)
- else
- abs_srcdir := $(shell cd $(srcdir) && pwd -W)
- abs_builddir := $(shell pwd -W)
- endif
- 
- test_files_src := $(wildcard $(srcdir)/sql/*.sql) $(wildcard 
$(srcdir)/expected/*.out)
- test_files_build := $(patsubst $(srcdir)/%, $(abs_builddir)/%, 
$(test_files_src))
- 
- all: $(test_files_build)
- $(test_files_build): $(abs_builddir)/%: $(srcdir)/%
-   ln -s $< $@
- 
- endif
- 
  install: all installdirs install-lib
  
  installdirs: installdirs-lib
--- 66,71 
diff -cr -x TAGS ../cvs-pgsql/src/pl/tcl/Makefile ./src/pl/tcl/Makefile
*** ../cvs-pgsql/src/pl/tcl/Makefile2008-04-07 17:15:58.0 +0300
--- ./src/pl/tcl/Makefile   2008-09-22 20:31:13.0 +0300
***
*** 49,75 
  all: all-lib
$(MAKE) -C modules $@
  
- # When doing a VPATH build, copy over the .sql and .out files so that the
- # test script can find them.  

Re: [HACKERS] pg_regress inputdir

2008-09-15 Thread Peter Eisentraut

Tom Lane wrote:

But I think Alvaro is worried about something
at a higher level: the regression test process as a whole has some
directory layout assumptions built into it, particularly in regards
to where to find .so's.


The only information about the location of the .so's is in the test 
files themselves, which seems reasonable, because they are created and 
installed at the same time as the .so's that they are presumably 
supposed to test.  So I see no problem here.


--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-09-12 Thread Alvaro Herrera
Tom Lane wrote:
> Peter Eisentraut <[EMAIL PROTECTED]> writes:

> > I think the appropriate interface would be adding another option to 
> > pg_regress called --workdir or --tempdir, which defaults to PWD, and 
> > write the converted sql files there, and then look for the sql files to 
> > execute in workdir/sql and in inputdir/sql.  In some way, this copies 
> > the vpath search mechanism.
> 
> That would be required to make pg_regress run as far as its own
> facilities are concerned.  But I think Alvaro is worried about something
> at a higher level: the regression test process as a whole has some
> directory layout assumptions built into it, particularly in regards
> to where to find .so's.  If we don't have a workable solution for that
> it's not really going to help to change pg_regress like this.

Maybe the same work dir can be used as a place to store the shared
objects.  I think all it'd require is to change @abs_builddir@ to point
to workdir.

That should work fine as long as nobody attempts to put the workdir in
some mount point that's marked noexec (which is somewhat common with
/tmp)

-- 
Alvaro Herrerahttp://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-09-12 Thread Tom Lane
Peter Eisentraut <[EMAIL PROTECTED]> writes:
> Alvaro Herrera wrote:
>> I tried to run the test from another directory with this patch
>> installed, and found that it didn't work because it's replacing
>> @abs_builddir@ in the input files improperly (to the current path; it
>> should be using the output dir path, I think)

> I think the appropriate interface would be adding another option to 
> pg_regress called --workdir or --tempdir, which defaults to PWD, and 
> write the converted sql files there, and then look for the sql files to 
> execute in workdir/sql and in inputdir/sql.  In some way, this copies 
> the vpath search mechanism.

That would be required to make pg_regress run as far as its own
facilities are concerned.  But I think Alvaro is worried about something
at a higher level: the regression test process as a whole has some
directory layout assumptions built into it, particularly in regards
to where to find .so's.  If we don't have a workable solution for that
it's not really going to help to change pg_regress like this.

regards, tom lane

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-09-12 Thread Peter Eisentraut

Alvaro Herrera wrote:

Jorgen Austvik - Sun Norway wrote:

The attached patch makes pg_regress write converted files to  
/sql and /expected, which is one way to make it read  
and write to the same directory. Tested on Solaris x86 with pgsql "make  
check" and standalone.


Okay, so this patch does change it in a way that it still works, but
what else do you need to be able to run the test from another directory?
I tried to run the test from another directory with this patch
installed, and found that it didn't work because it's replacing
@abs_builddir@ in the input files improperly (to the current path; it
should be using the output dir path, I think)

So maybe this is a step in the right direction, but ISTM you need a
slightly larger patch for it to be actually useful.

If I am not making sense, then maybe I am not understanding what you
mean by running it standalone.  In that case, please explain.



I think the appropriate interface would be adding another option to 
pg_regress called --workdir or --tempdir, which defaults to PWD, and 
write the converted sql files there, and then look for the sql files to 
execute in workdir/sql and in inputdir/sql.  In some way, this copies 
the vpath search mechanism.


--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-09-11 Thread Alvaro Herrera
Jorgen Austvik - Sun Norway wrote:

> The attached patch makes pg_regress write converted files to  
> /sql and /expected, which is one way to make it read  
> and write to the same directory. Tested on Solaris x86 with pgsql "make  
> check" and standalone.

Okay, so this patch does change it in a way that it still works, but
what else do you need to be able to run the test from another directory?
I tried to run the test from another directory with this patch
installed, and found that it didn't work because it's replacing
@abs_builddir@ in the input files improperly (to the current path; it
should be using the output dir path, I think)

So maybe this is a step in the right direction, but ISTM you need a
slightly larger patch for it to be actually useful.

If I am not making sense, then maybe I am not understanding what you
mean by running it standalone.  In that case, please explain.

-- 
Alvaro Herrerahttp://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-09-09 Thread Tom Lane
Alvaro Herrera <[EMAIL PROTECTED]> writes:
> Peter Eisentraut wrote:
>> There is interest among packagers to run the regression tests or other  
>> tests after the build.  The Red Hat RPMs have shipped a postgresql-test  
>> package for years with a hacked-up makefile that will probably overwrite  
>> random files that it shouldn't in /usr/lib.  So I would rather be in  
>> favor of coming up with a solution that would make this work rather than  
>> removing the options.  The solution would probably be adding another  
>> option to place the generated files, but the exact behavior would need  
>> to be worked out.

> Hmm.  I took a look at the RPM makefiles and patches, and it doesn't
> seem like changing this part of pg_regress would solve anything.

Well, it would be interesting if it were possible for an unprivileged
user to run postgresql-test.  That would mean arranging for the tests to
not write anything in the regression source directory, but only in some
user-private directory; ie, keeping the modifiable and non-modifiable
files separate.  Which I think is what Peter is getting at above.

However, at least for Red Hat I don't think I could use such a feature
if I had it :-(.  You'll note that Makefile.regress has to fool around
with SELinux labeling, which I think isn't possible for any old random
user.  That's not something that could be avoided if we had a pg_regress
that was careful about modifiable vs non-modifiable files, because the
restriction is actually enforced against the installed postgresql
binaries.

regards, tom lane

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-09-09 Thread Alvaro Herrera
Peter Eisentraut wrote:

> There is interest among packagers to run the regression tests or other  
> tests after the build.  The Red Hat RPMs have shipped a postgresql-test  
> package for years with a hacked-up makefile that will probably overwrite  
> random files that it shouldn't in /usr/lib.  So I would rather be in  
> favor of coming up with a solution that would make this work rather than  
> removing the options.  The solution would probably be adding another  
> option to place the generated files, but the exact behavior would need  
> to be worked out.

Hmm.  I took a look at the RPM makefiles and patches, and it doesn't
seem like changing this part of pg_regress would solve anything.  The
RPM changes are about shared libraries, whereas this is just about
moving the generated files (equivalent to those in the "sql" directory).

For an example of the hacked-up makefiles and stuff, see here:
https://projects.commandprompt.com/public/pgcore/browser/rpm/redhat/8.3/postgresql/F-9/

The relevant files are Makefile.regress, postgresql-test.patch, and
postgresql-8.3.spec (lines 440ff).

-- 
Alvaro Herrerahttp://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-09-05 Thread Peter Eisentraut

Jorgen Austvik - Sun Norway wrote:

Alvaro Herrera wrote:

In my opinion, the need
for running tests outside the test dir is not very strong (or we would
have heard complaints before), and thus the solution is to remove
--inputdir and --outputdir.


Attached is a patch that removes --inputdir and --outputdir. I still 
prefere the first patch (that fixed my problem), but removing them is 
probably better than having them when they don't work.


There is interest among packagers to run the regression tests or other 
tests after the build.  The Red Hat RPMs have shipped a postgresql-test 
package for years with a hacked-up makefile that will probably overwrite 
random files that it shouldn't in /usr/lib.  So I would rather be in 
favor of coming up with a solution that would make this work rather than 
removing the options.  The solution would probably be adding another 
option to place the generated files, but the exact behavior would need 
to be worked out.



--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-08-04 Thread Jorgen Austvik - Sun Norway

Alvaro Herrera wrote:

In my opinion, the need
for running tests outside the test dir is not very strong (or we would
have heard complaints before), and thus the solution is to remove
--inputdir and --outputdir.


Attached is a patch that removes --inputdir and --outputdir. I still 
prefere the first patch (that fixed my problem), but removing them is 
probably better than having them when they don't work.


Tested with psql make check on solaris x86.

-J
--

Jørgen Austvik, Software Engineering - QA
Sun Microsystems Database Group
Index: src/test/regress/pg_regress_main.c
===
RCS file: /projects/cvsroot/pgsql/src/test/regress/pg_regress_main.c,v
retrieving revision 1.3
diff -u -r1.3 pg_regress_main.c
--- src/test/regress/pg_regress_main.c	1 Jan 2008 19:46:00 -	1.3
+++ src/test/regress/pg_regress_main.c	4 Aug 2008 11:19:04 -
@@ -34,12 +34,9 @@
 	char		expectfile[MAXPGPATH];
 	char		psql_cmd[MAXPGPATH * 3];
 
-	snprintf(infile, sizeof(infile), "%s/sql/%s.sql",
-			 inputdir, testname);
-	snprintf(outfile, sizeof(outfile), "%s/results/%s.out",
-			 outputdir, testname);
-	snprintf(expectfile, sizeof(expectfile), "%s/expected/%s.out",
-			 inputdir, testname);
+	snprintf(infile, sizeof(infile), "sql/%s.sql", testname);
+	snprintf(outfile, sizeof(outfile), "results/%s.out", testname);
+	snprintf(expectfile, sizeof(expectfile), "expected/%s.out", testname);
 
 	add_stringlist_item(resultfiles, outfile);
 	add_stringlist_item(expectfiles, expectfile);
Index: src/test/regress/pg_regress.c
===
RCS file: /projects/cvsroot/pgsql/src/test/regress/pg_regress.c,v
retrieving revision 1.46
diff -u -r1.46 pg_regress.c
--- src/test/regress/pg_regress.c	3 Aug 2008 05:12:38 -	1.46
+++ src/test/regress/pg_regress.c	4 Aug 2008 11:19:04 -
@@ -32,6 +32,9 @@
 #include "getopt_long.h"
 #include "pg_config_paths.h"
 
+#define LOG_DIRECTORY "log"
+#define RESULTS_DIRECTORY "results"
+
 /* for resultmap we need a list of pairs of strings */
 typedef struct _resultmap
 {
@@ -68,8 +71,6 @@
 /* options settable from command line */
 _stringlist *dblist = NULL;
 bool		debug = false;
-char	   *inputdir = ".";
-char	   *outputdir = ".";
 char	   *psqldir = NULL;
 static _stringlist *loadlanguage = NULL;
 static int	max_connections = 0;
@@ -560,8 +561,7 @@
 	FILE	   *f;
 
 	/* scan the file ... */
-	snprintf(buf, sizeof(buf), "%s/resultmap", inputdir);
-	f = fopen(buf, "r");
+	f = fopen("resultmap", "r");
 	if (!f)
 	{
 		/* OK if it doesn't exist, else complain */
@@ -1702,8 +1702,7 @@
 	FILE	   *difffile;
 
 	/* create the log file (copy of running status output) */
-	snprintf(file, sizeof(file), "%s/regression.out", outputdir);
-	logfilename = strdup(file);
+	logfilename = "regression.out";
 	logfile = fopen(logfilename, "w");
 	if (!logfile)
 	{
@@ -1713,8 +1712,7 @@
 	}
 
 	/* create the diffs file as empty */
-	snprintf(file, sizeof(file), "%s/regression.diffs", outputdir);
-	difffilename = strdup(file);
+	difffilename = "regression.diffs";
 	difffile = fopen(difffilename, "w");
 	if (!difffile)
 	{
@@ -1726,9 +1724,8 @@
 	fclose(difffile);
 
 	/* also create the output directory if not present */
-	snprintf(file, sizeof(file), "%s/results", outputdir);
-	if (!directory_exists(file))
-		make_directory(file);
+	if (!directory_exists(RESULTS_DIRECTORY))
+		make_directory(RESULTS_DIRECTORY);
 }
 
 static void
@@ -1799,14 +1796,12 @@
 	printf(_("Options:\n"));
 	printf(_("  --dbname=DB   use database DB (default \"regression\")\n"));
 	printf(_("  --debug   turn on debug mode in programs that are run\n"));
-	printf(_("  --inputdir=DIRtake input files from DIR (default \".\")\n"));
 	printf(_("  --load-language=lang  load the named language before running the\n"));
 	printf(_("tests; can appear multiple times\n"));
 	printf(_("  --create-role=ROLEcreate the specified role before testing\n"));
 	printf(_("  --max-connections=N   maximum number of concurrent connections\n"));
 	printf(_("(default is 0 meaning unlimited)\n"));
 	printf(_("  --multibyte=ENCODING  use ENCODING as the multibyte encoding\n"));
-	printf(_("  --outputdir=DIR   place output files in DIR (default \".\")\n"));
 	printf(_("  --schedule=FILE   use test ordering schedule from FILE\n"));
 	printf(_("(can be used multiple times to concatenate)\n"));
 	printf(_("  --srcdir=DIR  absolute path to source directory (for VPATH builds)\n"));
@@ -1844,11 +1839,9 @@
 		{"version", no_argument, NULL, 'V'},
 		{"dbname", required_argument, NULL, 1},
 		{"debug", no_argument, NULL, 2},
-		{"inputdir", required_argument, NULL, 3},
 		{"load-language", required_argument, NULL, 4},
 		{"max-connections", required_argument, NULL, 5},
 		{"multibyte", required_argument, NULL, 6}

Re: [HACKERS] pg_regress inputdir

2008-07-31 Thread Alvaro Herrera
Alvaro Herrera wrote:
> Jorgen Austvik - Sun Norway wrote:
> 
> > Do we also agree that if you set --inputdir to anything other than the  
> > default, pg_regress will not work (will write a file to one folder, and  
> > try to read the same file from another)?
> >
> > And if we agree above - should we make setting --inputdir work (read and  
> > write from/to same directory), remove the --inputdir parameter (since  
> > setting it to anything different from default value doesn't work), or  
> > keep it there (to confuse people)?
> 
> I think the problem here is that you have to set --outputdir too.

Huh, scratch that, I chose a bad test.  create_function_2 obviously fails as
you say:

$ LC_ALL=C /pgsql/build/00head/src/test/regress/pg_regress 
--inputdir=/pgsql/source/00head/src/test/regress 
--srcdir=/pgsql/source/00head/src/test/regress/ create_function_2
(using postmaster on Unix socket, port 55432)
== dropping database "regression" ==
DROP DATABASE
== creating database "regression" ==
CREATE DATABASE
ALTER DATABASE
== running regression test queries==
test create_function_2... /bin/sh: 
/pgsql/source/00head/src/test/regress/sql/create_function_2.sql: No such file 
or directory
diff: /pgsql/source/00head/src/test/regress/expected/create_function_2.out: No 
such file or directory
diff: ./results/create_function_2.out: No such file or directory
diff command failed with status 512: diff -w 
"/pgsql/source/00head/src/test/regress/expected/create_function_2.out" 
"./results/create_function_2.out" > "./results/create_function_2.out.diff"


I'm not sure if the problem here is --inputdir or --srcdir, or the fact
that we fail to provide a --builddir switch.  In my opinion, the need
for running tests outside the test dir is not very strong (or we would
have heard complaints before), and thus the solution is to remove
--inputdir and --outputdir.

-- 
Alvaro Herrerahttp://www.CommandPrompt.com/
The PostgreSQL Company - Command Prompt, Inc.

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-07-31 Thread Alvaro Herrera
Jorgen Austvik - Sun Norway wrote:

> Do we also agree that if you set --inputdir to anything other than the  
> default, pg_regress will not work (will write a file to one folder, and  
> try to read the same file from another)?
>
> And if we agree above - should we make setting --inputdir work (read and  
> write from/to same directory), remove the --inputdir parameter (since  
> setting it to anything different from default value doesn't work), or  
> keep it there (to confuse people)?

I think the problem here is that you have to set --outputdir too.

$ LC_ALL=C /pgsql/build/00head/src/test/regress/pg_regress 
--inputdir=/pgsql/source/00head/src/test/regress 
--outputdir=/pgsql/build/00head/src/test/regress timetz
(using postmaster on Unix socket, port 55432)
== dropping database "regression" ==
DROP DATABASE
== creating database "regression" ==
CREATE DATABASE
ALTER DATABASE
== running regression test queries==
test timetz   ... ok

=
 All 1 tests passed. 
=


Note that this is a VPATH build, so the input and output dirs are
different.

-- 
Alvaro Herrerahttp://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-07-30 Thread Jorgen Austvik - Sun Norway

Alvaro Herrera wrote:
Today, using --inputdir in pg_regress does not work for any other value  
than something that resolves to cwd, since it will write a file to  
"./sql", but try to read the same file from "/sql".


Maybe I'm missing something, but I don't see any reason why this is a
scenario worth supporting.  What's the problem with cd'ing into the
directory containing the tests?


I agree - cd or some symlinks to cover up that the --inputdir parameter 
does not work if you set it to anything except the default is a workaround.


Do we also agree that if you set --inputdir to anything other than the 
default, pg_regress will not work (will write a file to one folder, and 
try to read the same file from another)?


And if we agree above - should we make setting --inputdir work (read and 
write from/to same directory), remove the --inputdir parameter (since 
setting it to anything different from default value doesn't work), or 
keep it there (to confuse people)?


-J
--

Jørgen Austvik, Software Engineering - QA
Sun Microsystems Database Group
begin:vcard
fn;quoted-printable:J=C3=B8rgen Austvik
n;quoted-printable:Austvik;J=C3=B8rgen
org:Sun Microsystems;Database Group
adr:;;Haakon VII gt. 7b;Trondheim;;NO-7485;Norway
email;internet:[EMAIL PROTECTED]
title:Senior Engineer
tel;work:+47 73 84 21 10 
tel;fax:+47 73 84 21 01
tel;cell:+47 901 97 886
note:http://www.austvik.net/
x-mozilla-html:FALSE
url:http://blogs.sun.com/austvik/
version:2.1
end:vcard


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-07-30 Thread Alvaro Herrera
Jorgen Austvik - Sun Norway wrote:
> Alvaro Herrera wrote:

>> I think this breaks VPATH builds in both letter and spirit. 
>
> Letter:
>
> 8<---8<---8<---8<---8<---8<---
> bash-3.2$ ggrep -R "\-\-inputdir" *
> src/test/regress/pg_regress.c:  printf(_("  --inputdir=DIR take input 
> files from DIR (default \".\")\n"));
> Binary file src/test/regress/pg_regress.o matches
> Binary file src/test/regress/pg_regress matches
> Binary file  
> src/test/regress/tmp_check/install/usr/local/pgsql/lib/pgxs/src/test/regress/pg_regress
>  
> matches
> 8<---8<---8<---8<---8<---8<---
>
> Since it is not used in PostgreSQL build (only default value - "."), I  
> have problems seeing how writing to e.g. "./sql/file" instead of writing  
> to "sql/file" could break anything. Please explain.

Well, that's exactly my point -- because in a normal build, it is only
passed as . but in a VPATH dir it is passed as the source dir (relative
or absolute path as when you invoked configure).

> Spirit:
>
> Nobody has ever accuse me of being spiritual ;-), but if you have a URI  
> that explains the VPATH spirit, I'd be interested to read about it.

The VPATH spirit is that generated files should reside in the build
directory, not in the source directory.  Try creating an empty directory
somewhere, cd'ing to that, and calling /path/to/pgsqlsource/configure.
In the resulting dir try "make installcheck" and see what is passed as
--inputdir.

Hmm ... maybe I spoke too soon; I don't see --inputdir used anywhere.


> > Why do you need this anyway?
>
> I tried to explain that in the first mail, but let me try again.
>
> Use case:
> Running pg_regress outside of PostgreSQL build system. pg_regress is  
> installed in e.g. /usr/postgres/8.3/bin/, "input", "output", "sql" and  
> "expected" are installed in some other path, e.g.  
> /usr/postgres/8.3/share/test. User is in ~ and tries to run the  
> PostgreSQL regression tests. It doesn't work, in fact the only way to  
> make it work is to cd to the parent directory of "sql" and "expected".
>
> Today, using --inputdir in pg_regress does not work for any other value  
> than something that resolves to cwd, since it will write a file to  
> "./sql", but try to read the same file from "/sql".

Maybe I'm missing something, but I don't see any reason why this is a
scenario worth supporting.  What's the problem with cd'ing into the
directory containing the tests?

-- 
Alvaro Herrerahttp://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-07-30 Thread Jorgen Austvik - Sun Norway

Alvaro Herrera wrote:

Jorgen Austvik - Sun Norway wrote:

The attached patch makes pg_regress write converted files to  
/sql and /expected, which is one way to make it read  
and write to the same directory. Tested on Solaris x86 with pgsql "make  
check" and standalone.


I think this breaks VPATH builds in both letter and spirit. 


Letter:

8<---8<---8<---8<---8<---8<---
bash-3.2$ ggrep -R "\-\-inputdir" *
src/test/regress/pg_regress.c:  printf(_("  --inputdir=DIR 
take input files from DIR (default \".\")\n"));

Binary file src/test/regress/pg_regress.o matches
Binary file src/test/regress/pg_regress matches
Binary file 
src/test/regress/tmp_check/install/usr/local/pgsql/lib/pgxs/src/test/regress/pg_regress 
matches

8<---8<---8<---8<---8<---8<---

Since it is not used in PostgreSQL build (only default value - "."), I 
have problems seeing how writing to e.g. "./sql/file" instead of writing 
to "sql/file" could break anything. Please explain.


Spirit:

Nobody has ever accuse me of being spiritual ;-), but if you have a URI 
that explains the VPATH spirit, I'd be interested to read about it.


> Why do you need this anyway?

I tried to explain that in the first mail, but let me try again.

Use case:
Running pg_regress outside of PostgreSQL build system. pg_regress is 
installed in e.g. /usr/postgres/8.3/bin/, "input", "output", "sql" and 
"expected" are installed in some other path, e.g. 
/usr/postgres/8.3/share/test. User is in ~ and tries to run the 
PostgreSQL regression tests. It doesn't work, in fact the only way to 
make it work is to cd to the parent directory of "sql" and "expected".


Today, using --inputdir in pg_regress does not work for any other value 
than something that resolves to cwd, since it will write a file to 
"./sql", but try to read the same file from "/sql".


-J
--

Jørgen Austvik, Software Engineering - QA
Sun Microsystems Database Group

http://blogs.sun.com/austvik/
http://www.austvik.net/
begin:vcard
fn;quoted-printable:J=C3=B8rgen Austvik
n;quoted-printable:Austvik;J=C3=B8rgen
org:Sun Microsystems;Database Group
adr:;;Haakon VII gt. 7b;Trondheim;;NO-7485;Norway
email;internet:[EMAIL PROTECTED]
title:Senior Engineer
tel;work:+47 73 84 21 10 
tel;fax:+47 73 84 21 01
tel;cell:+47 901 97 886
note:http://www.austvik.net/
x-mozilla-html:FALSE
url:http://blogs.sun.com/austvik/
version:2.1
end:vcard


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] pg_regress inputdir

2008-07-29 Thread Alvaro Herrera
Jorgen Austvik - Sun Norway wrote:

> The attached patch makes pg_regress write converted files to  
> /sql and /expected, which is one way to make it read  
> and write to the same directory. Tested on Solaris x86 with pgsql "make  
> check" and standalone.

I think this breaks VPATH builds in both letter and spirit.  Why do you
need this anyway?

-- 
Alvaro Herrerahttp://www.CommandPrompt.com/
The PostgreSQL Company - Command Prompt, Inc.

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


[HACKERS] pg_regress inputdir

2008-07-29 Thread Jorgen Austvik - Sun Norway

Hi,

with regards to --inputdir, --srcdir, --outputdir and --schedule, 
pg_regress does something like this:


convert files in /input, and place them in ./sql
convert files in /output, and place them in ./expected
read schedule from 
for each test in schedule:
   read test from /sql/.sql
   read expected result from /expected/.out
   write results to /results/.out

My problem when running pg_regress standalone, is that converted files 
are written to e.g. ./sql, but read from e.g. /sql, which 
makes the --inputdir parameter pretty unusable if it is set to something 
different from some path leading to cwd.


Illustrated with code:

Writing converted source file (pg_regress.s:493):
snprintf(destfile, MAXPGPATH, "%s/%s.%s", dest, prefix, suffix);

(Where dest is "sql" or "expected".)

Reading files (pg_regress_main.c:37+38):
snprintf(infile, sizeof(infile), "%s/sql/%s.sql", inputdir, testname);

The attached patch makes pg_regress write converted files to 
/sql and /expected, which is one way to make it read 
and write to the same directory. Tested on Solaris x86 with pgsql "make 
check" and standalone.


-J
--

Jørgen Austvik, Software Engineering - QA
Sun Microsystems Database Group

http://blogs.sun.com/austvik/
http://www.austvik.net/
Index: src/test/regress/pg_regress.c
===
RCS file: /projects/cvsroot/pgsql/src/test/regress/pg_regress.c,v
retrieving revision 1.45
diff -u -r1.45 pg_regress.c
--- src/test/regress/pg_regress.c	17 May 2008 20:02:01 -	1.45
+++ src/test/regress/pg_regress.c	29 Jul 2008 12:36:38 -
@@ -490,7 +490,7 @@
 		/* build the full actual paths to open */
 		snprintf(prefix, strlen(*name) - 6, "%s", *name);
 		snprintf(srcfile, MAXPGPATH, "%s/%s", indir, *name);
-		snprintf(destfile, MAXPGPATH, "%s/%s.%s", dest, prefix, suffix);
+		snprintf(destfile, MAXPGPATH, "%s/%s/%s.%s", inputdir, dest, prefix, suffix);
 
 		infile = fopen(srcfile, "r");
 		if (!infile)

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers