Re: [HACKERS] PostgreSQL 8.3 index page count clarification

2015-06-01 Thread Jim Nasby
.html (that doesn't appear to support anything but HEAD, but I know there's other sites out there that provide similar tools for our code.) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hacker

Re: [HACKERS] about lob(idea)

2015-06-01 Thread Jim Nasby
Objects for this database are stored. There's also nothing preventing someone from creating a 'next generation' LO PGXN extension that could be brought into core if enough people show interest. That's probably the best route to get changes to the existing LO infrastructure ma

Re: [HACKERS] [PATCH] Document that directly callable functions may use fn_extra

2015-06-03 Thread Jim Nasby
in fn_extra. I realize you can figure it out from fn_mcxt, but I don't know that that's terribly obvious to others. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hacker

Re: [HACKERS] pg_xlog -> pg_xjournal?

2015-06-03 Thread Jim Nasby
the initdb option in the first place. #2 seems reasonable. #1 seems like it's partway up the molemountain. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresq

Re: [HACKERS] Further issues with jsonb semantics, documentation

2015-06-04 Thread Jim Nasby
arbitrary length and arrays don't support that. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www

Re: [HACKERS] RFC: Remove contrib entirely

2015-06-04 Thread Jim Nasby
would be overcome by the explicit testing we would need to have for approved modules. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] RFC: Remove contrib entirely

2015-06-05 Thread Jim Nasby
-tester.org/ results for all modules, which would help with that. In the meantime you can hit that site itself. Awesome work by Tomas Vondra. A number of modules also run Travis-CI. Might be worth having a way for a module to provide it's status .png. -- Jim Nasby, Data Architect, Blue T

Re: [HACKERS] [CORE] Restore-reliability mode

2015-06-05 Thread Jim Nasby
ting of edge cases (such as MXID wrap) and then combining that with other forms of testing, such as pg_upgrade and streaming rep. testing. Test things like "What happens if we pg_upgrade a cluster that's in danger of wraparound?" -- Jim Nasby, Data Architect, Blue Treble Consulti

Re: [HACKERS] [CORE] Restore-reliability mode

2015-06-05 Thread Jim Nasby
ning. ISTM that there's a lot of hand-waving that happens around use cases that could probably be clarified with end user input. FWIW, I don't think the blocker here is git or building from source. If someone has that amount of time to invest it's not much different than gr

Re: [HACKERS] pg_stat_*_columns?

2015-06-05 Thread Jim Nasby
ell you much; you want to know how much column data was actually pulled out. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make chan

Re: [HACKERS] Is it possible to have a "fast-write" Index?

2015-06-05 Thread Jim Nasby
;ll need to come up with some concrete scenarios and provide data on where all the performance hit actually is. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgr

Re: [HACKERS] RFC: Remove contrib entirely

2015-06-05 Thread Jim Nasby
On 6/5/15 10:49 AM, David E. Wheeler wrote: On Jun 5, 2015, at 12:34 AM, Jim Nasby wrote: A number of modules also run Travis-CI. Might be worth having a way for a module to provide it's status .png. Right. Just stick it in your README. http://blog.pgxn.org/post/116087351668/badge

Re: [HACKERS] Further issues with jsonb semantics, documentation

2015-06-05 Thread Jim Nasby
Postgres is essentially impossible. Your only option is to put implicit or assignment casts in and cross your fingers, or to do only explicit casts and force the user to cast everything (which is a PITA). Even a json_pointer type may not help this much unless we have some way to reliable tran

Re: [HACKERS] The Future of Aggregation

2015-06-09 Thread Jim Nasby
to have any kind of incremental matview update. Just trying to keep things in perspective. :) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To

Re: [HACKERS] Comfortably check BackendPID with psql

2015-06-11 Thread Jim Nasby
hugely helpful when using gdb. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Is it possible to have a "fast-write" Index?

2015-06-11 Thread Jim Nasby
workers. There's now enough parallelism infrastructure that it shouldn't be too hard to hack up a quick test of that. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-h

Re: [HACKERS] Need Multixact Freezing Docs

2015-06-15 Thread Jim Nasby
On 6/14/15 9:50 AM, Alvaro Herrera wrote: + values[0] = MultiXactState->oldestMultiXactId; What about oldestOffset and offsetStopLimit? Seems those would be useful too. Looks good other than that. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get

Re: [HACKERS] On columnar storage

2015-06-15 Thread Jim Nasby
e had the ability to access columns in a referenced FK table from a referring key; something like SELECT customer_id.first_name FROM invoice (which would be translated to SELECT first_name FROM invoice JOIN customer USING( customer_id )). -- Jim Nasby, Data Architect, Blue Treble Consul

Re: [HACKERS] pg_stat_*_columns?

2015-06-15 Thread Jim Nasby
be a problem as long as you don't read too often from it? The stats collector is a known problem under certain circumstances, so improving it would probably be a good thing. The first thing that comes to mind is splitting it into more files. -- Jim Nasby, Data Architect, Blue Treble Cons

Re: [HACKERS] On columnar storage

2015-06-17 Thread Jim Nasby
On 6/17/15 2:04 PM, Alvaro Herrera wrote: Jim Nasby wrote: Related to idea of an 'auto join', I do wish we had the ability to access columns in a referenced FK table from a referring key; something like SELECT customer_id.first_name FROM invoice (which would be translated to SELECT

Re: [HACKERS] GIN function of pageinspect has inconsistency data type.

2015-06-17 Thread Jim Nasby
int32 into a signed int32 (which is what the SQL int is). That's why it's returning a bigint. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)

Re: [HACKERS] Is it possible to have a "fast-write" Index?

2015-06-18 Thread Jim Nasby
On 6/12/15 9:17 PM, deavid wrote: (upper(codagencia::text) ); FWIW, you should consider using citext for these cases; it would let you cut down on the number of indexes (by 50%?). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http

Re: [HACKERS] Time to get rid of PQnoPasswordSupplied?

2015-06-21 Thread Jim Nasby
don't know where we'd put it (I doubt users would go looking in the libpq api docs to find it...) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgres

Re: [HACKERS] Extension support for postgres_fdw

2015-06-21 Thread Jim Nasby
cification though, so presumably this could be added later. (Presumably, only immutable functions would get transmitted, even if there are mutable functions present in a marked extension.) +1 -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Tr

Re: [HACKERS] checkpointer continuous flushing

2015-06-21 Thread Jim Nasby
etter to get this committed without more than we have now than to do without it though... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make

Re: [HACKERS] pretty bad n_distinct estimate, causing HashAgg OOM on TPC-H

2015-06-21 Thread Jim Nasby
bgworker could follow behind the seqscan. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org

Re: [HACKERS] Further issues with jsonb semantics, documentation

2015-06-22 Thread Jim Nasby
On 6/5/15 3:51 PM, Alvaro Herrera wrote: Jim Nasby wrote: On 6/5/15 2:08 PM, Petr Jelinek wrote: That's a good point, and it won't get any better if/when we add the json point support in 9.6 since the syntax would be something like select jsonb '{"a":"1",

Re: [HACKERS] Time to get rid of PQnoPasswordSupplied?

2015-06-22 Thread Jim Nasby
On 6/22/15 9:00 AM, Tom Lane wrote: Jim Nasby writes: On 6/19/15 10:35 AM, Tom Lane wrote: On the other hand, you could argue that improving the string is going to break clients that do the right thing (even if klugily) in order to help clients that are doing the wrong thing (ie, failing

Re: [HACKERS] RFC: replace pg_stat_activity.waiting with something more descriptive

2015-06-22 Thread Jim Nasby
what you're describing (though, I believe even more granular) and have a bgworker accumulating that information. [1] http://www.pgcon.org/2015/schedule/events/809.en.html -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -

Re: [HACKERS] [Proposal] Progress bar for pg_dump/pg_restore

2015-06-22 Thread Jim Nasby
nstrated[1] getting progress stats for long running queries[2] at pgCon 2013. Perhaps some of that code would be useful here (or better yet perhaps we could include at least the measuring portion of his stuff in core... ;) [1] https://www.pgcon.org/2013/schedule/events/576.en.html [2] https://

Re: [HACKERS] proposal: row_to_array function

2015-06-22 Thread Jim Nasby
ay the RI triggers do. What would be a lot better is if we had better control over function and operator resolution. [1] https://github.com/decibel/variant/commit/2b99067744a405da8a325de1ebabd213106f794f#diff-8aa2db4a577ee4201d6eb9041c2a457eR846 -- Jim Nasby, Data Architect, Blue Treble C

Re: [HACKERS] Hash index creation warning

2015-06-22 Thread Jim Nasby
K, updated patch attached. Patch applied. I only just noticed this item when I read the release notes. Should we bother warning when used on an unlogged table? Not really; but I think the bigger question at this point is if we want to change it this late in the game. -- Jim Nasby, Data Archi

Re: [HACKERS] less log level for success dynamic background workers for 9.5

2015-06-22 Thread Jim Nasby
be fixed in 9.5 - because it is limiting factor for bgworkers usage in 9.5. Anything ever happen with this? I agree that LOG is to high for reporting most (if not all) of these things. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http

Re: [HACKERS] less log level for success dynamic background workers for 9.5

2015-06-23 Thread Jim Nasby
uld turn on individual reports. If we had that we'd just make these particular ereports DEBUG1 and not worry about it because you could easily turn them on when needed. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com

Re: [HACKERS] pg_stat_*_columns?

2015-06-23 Thread Jim Nasby
Presumably handling that requires all the stuff that's discussed already and you might as well just handle the recording in user space. But maybe someone has some clever ideas there... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://

Re: [HACKERS] proposal: row_to_array function

2015-06-23 Thread Jim Nasby
On 6/23/15 9:45 AM, Pavel Stehule wrote: 2015-06-23 1:56 GMT+02:00 Jim Nasby mailto:jim.na...@bluetreble.com>>: On 6/22/15 2:46 AM, Pavel Stehule wrote: FOREACH key, val IN RECORD myrow LOOP IF pg_typeof(val) IN ('int4', 'double

Re: [HACKERS] checkpointer continuous flushing

2015-06-23 Thread Jim Nasby
both backends and bgwriter... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] proposal: row_to_array function

2015-06-23 Thread Jim Nasby
a float or a numeric?). But maybe JSON is good enough. [1] The one OO-ish data feature I'd like is the ability to de-reference a foreign key "pointer". So if CREATE TABLE b( a_id int REFERENCES a); then have SELECT a_id.some_field FROM b; transform to SELECT a.some_field FR

Re: [HACKERS] proposal: row_to_array function

2015-06-23 Thread Jim Nasby
boil the ocean, but if we keep piecemealing this without more though we're going to keep getting more warts (like a lot of the gotchas we have with arrays). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com

Re: [HACKERS] less log level for success dynamic background workers for 9.5

2015-06-24 Thread Jim Nasby
ugh, and really merits a separate thread. For Pavel's issue I'm all in favour of just changing the log message, I think LOG is way too high for something that's internal implementation detail. +1. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in

Re: [HACKERS] object_classes array is broken, again

2015-06-26 Thread Jim Nasby
something dumb... If I replace the StaticAssert with Assert(OidIsValid(object_classes[MAX_OCLASS - 1])) it works find and initdb will fail if that assert trips. I've attached the broken StaticAssert version. Also added a warning comment to the enum. -- Jim Nasby, Data Architect, Blue Treble

Re: [HACKERS] pg_stat_*_columns?

2015-06-26 Thread Jim Nasby
tty common scenario. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] UPSERT on partition

2015-06-26 Thread Jim Nasby
an to make *partitioning* work. It occurs to me that we could run the BEFORE triggers and then pass the new tuple to a user-supplied function that returns a regclass. That would allow us to know exactly which child/partition the UPSERT should be attempted in. -- Jim Nasby, Data Architect, Blue T

Re: [HACKERS] Re: [COMMITTERS] pgsql: psql: show proper row count in \x mode for zero-column output

2015-06-26 Thread Jim Nasby
-c 'select * from pg_class where false' -x (0 rows) $ Was that intentional? That's consistent with what > 0 rows does, so it seems the correct thing to do. Going from "(No rows)" to "(0 rows)" is going to break things anyway, so I don't see a ba

Re: [HACKERS] Oh, this is embarrassing: init file logic is still broken

2015-06-26 Thread Jim Nasby
e is https://github.com/slux/PostgreSQL-Performance-Farm; but it hasn't been touched in 5 years. :( -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To

Re: [HACKERS] [BUGS] BUG #13473: VACUUM FREEZE mistakenly cancel standby sessions

2015-06-26 Thread Jim Nasby
the new logic looks correct. It'd actually be nice if we also logged the most recent XID that actually got frozen. That's the XID that Hot Standby would actually care about (not the freeze limit). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in

Re: [HACKERS] pg_stat_*_columns?

2015-06-29 Thread Jim Nasby
inly necessary sometimes). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Bug in bttext_abbrev_convert()

2015-06-30 Thread Jim Nasby
fresher eyes than the last time I looked. Isn't this the kind of thing Coverty's supposed to find? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.or

[HACKERS] Determine operator from it's function

2015-07-02 Thread Jim Nasby
Is there a way to determine the operator that resulted in calling the operator function? I thought fcinfo->flinfo->fn_expr might get set to the OpExpr, but seems it can be a FuncExpr even when called via an operator... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX D

Re: [HACKERS] Determine operator from it's function

2015-07-03 Thread Jim Nasby
On 7/3/15 2:33 AM, Heikki Linnakangas wrote: On 07/03/2015 01:20 AM, Jim Nasby wrote: Is there a way to determine the operator that resulted in calling the operator function? I thought fcinfo->flinfo->fn_expr might get set to the OpExpr, but seems it can be a FuncExpr even when called

Re: [HACKERS] Bypassing SQL lexer and parser

2015-07-06 Thread Jim Nasby
ipulations on a SQL 2008-compliant DBMS. AFAIK HTSQL is very happy producing SQL; why not just let it hand SQL to Postgres (which it already does...) Have you by chance talked to Clark or Kirill about this? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Ge

Re: [HACKERS] Determine operator from it's function

2015-07-08 Thread Jim Nasby
On 7/4/15 12:33 AM, Tom Lane wrote: Jim Nasby writes: On 7/3/15 2:33 AM, Heikki Linnakangas wrote: On 07/03/2015 01:20 AM, Jim Nasby wrote: Is there a way to determine the operator that resulted in calling the operator function? I thought fcinfo->flinfo->fn_expr might get set to the

Re: [HACKERS] Freeze avoidance of very large table.

2015-07-08 Thread Jim Nasby
general use on production systems. +1. I don't think there's value to keeping this stuff away from DBAs. Perhaps it should default to only SU being able to execute it though. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://Blue

Re: [HACKERS] pg_upgrade + Ubuntu

2015-07-10 Thread Jim Nasby
ou can only have one "development" package installed at once. We've pushed to change this to no effect. :/ -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@post

Re: [HACKERS] Freeze avoidance of very large table.

2015-07-10 Thread Jim Nasby
h is a very short-term thing. It would be better to find a way to handle that differently. In any case, that should definitely be a separate discussion from this patch. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com

Re: [HACKERS] [PATCH] SQL function to report log message

2015-07-13 Thread Jim Nasby
talking about. It's talking about exposing ereport as a SQL function, without altering the rest of our logging behavior. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgs

Re: [HACKERS] [DESIGN] Incremental checksums

2015-07-13 Thread Jim Nasby
se case is using this to finally ditch all the old VACUUM FULL code in HeapTupleSatisfies*(). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make

Re: [HACKERS] [PATCH] SQL function to report log message

2015-07-13 Thread Jim Nasby
ch as a wrapper sql function for ereport. You might want to present a plan for that; it's not as trivial as it sounds due to how ereport works. In particular, I'd want to see (at minimum) the same functionality that plpgsql's RAISE command now provides (errdetail, errhint, etc). --

Re: [HACKERS] [DESIGN] Incremental checksums

2015-07-14 Thread Jim Nasby
On 7/13/15 4:02 PM, David Christensen wrote: On Jul 13, 2015, at 3:50 PM, Jim Nasby wrote: On 7/13/15 3:26 PM, David Christensen wrote: * Incremental Checksums PostgreSQL users should have a way up upgrading their cluster to use data checksums without having to do a costly pg_dump

Re: [HACKERS] patch : Allow toast tables to be moved to a different tablespace

2015-07-14 Thread Jim Nasby
(SSD) and the toast table on slow storage (spinning rust). I've seen humoungous toast tables that are barely ever read for tables that are constantly a couple times in the field. +1. I know of one case where the heap was ~8GB and TOAST was over 400GB. -- Jim Nasby, Data Architect, Blue Treble C

Re: [HACKERS] Implementation of global temporary tables?

2015-07-14 Thread Jim Nasby
h all the pain of handling this manually (as well as all the limitations that go with that). If it's easy to fix the bloat problem at the same time as adding GLOBAL TEMP then great! But there's no reason to reject this just because it doesn't fix that issue. -- Jim Nasby, Data A

Re: [HACKERS] [PROPOSAL] VACUUM Progress Checker.

2015-07-17 Thread Jim Nasby
nce_work_mem. ISTM that when that happens you'd definitely want a better idea of what's going on... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.

Re: [HACKERS] Support for N synchronous standby servers - take 2

2015-07-17 Thread Jim Nasby
u're at, while every alternative format I've seen is terse enough to be very clear on a single line. I'm guessing it'd be really ugly/hard to support at least this GUC being multi-line? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it

Re: [HACKERS] Support retrieving value from any sequence

2015-07-17 Thread Jim Nasby
view that's the equivalent of SELECT * FROM for every sequence in the database. That would let you get whatever info you needed. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing

Re: [HACKERS] Does people favor to have matrix data type?

2016-06-01 Thread Jim Nasby
W, take a look at MADlib svec[1]... ISTM that's just a special case of what you're describing with entire grids being zero (or vice-versa). There might be some commonality there. [1] https://madlib.incubator.apache.org/docs/v1.8/group__grp__svec.html -- Jim Nasby, Data Architec

Re: [HACKERS] Floating point comparison inconsistencies of the geometric types

2016-06-01 Thread Jim Nasby
ted if different projection methods are involved. I don't know if PostGIS depends on what these macros are doing or not. If it doesn't, perhaps it would be sufficient to lop of the last few bits of the significand. ISTM that'd be much better than what the macros currently do. BTW, I su

Re: [HACKERS] Rename max_parallel_degree?

2016-06-01 Thread Jim Nasby
e confusing, and I don't see any options for parallelism that are any clearer. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-

Re: [HACKERS] JSON[B] arrays are second-class citizens

2016-06-01 Thread Jim Nasby
o away, *especially* if the [] notation allowed things like a slice and a list of values (ie: json['foo', 'bar', 'baz'] = '[42,{"my": "nice object"},"with a random string"]'. Or = row(42, ...). -- Jim Nasby, Data Architect, Blu

Re: [HACKERS] Floating point comparison inconsistencies of the geometric types

2016-06-01 Thread Jim Nasby
not enough when different GRSes are involved? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hacke

Re: [HACKERS] regexp_match() returning text

2016-06-03 Thread Jim Nasby
On 5/30/16 1:01 PM, Andrew Gierth wrote: Returning an array containing the values of all capture groups might be more useful (substring returns the value of the first capture group if any, otherwise the matched string). +1. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX

Re: [HACKERS] array of domain types

2016-06-03 Thread Jim Nasby
as a table column So that's 5 x 2 (once for domain[], once for create type blah(x domain[])) test cases. There might be some other cases that are missing (what cast testing needs to happen?) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architectur

[HACKERS] Typo in parallel comment of heap_delete()

2016-06-05 Thread Jim Nasby
I'm pretty sure this is a typo... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 diff --git a/src/backend/access

Re: [HACKERS] [BUGS] Routine analyze of single column prevents standard autoanalyze from running at all

2016-06-07 Thread Jim Nasby
scover; I doubt most users are aware that you *can* analyze individual columns. Is there any significant advantage to not analyzing all columns? Only case I can think of is if you have a fair number of columns that have been toasted; otherwise I'd think IO would completely swamp any other

Re: [HACKERS] Reviewing freeze map code

2016-06-07 Thread Jim Nasby
n some of these scenarios, because it's so difficult to put the system into that state to begin with. Stuff that depends on burning through a large number of XIDs is an example of that. (To be clear, I'm talking about unit-test kind of stuff here, not validating an existing system.)

Re: [HACKERS] 10.0

2016-06-14 Thread Jim Nasby
ill has to support 3 numbers would also be a wart. We've lived with the parsing wart this long, so lets just add an explicit output version to 10.0. Any ideas on naming for such a function? version_detail()? I suppose while we're at this we might as well provide the compile details as

Re: [HACKERS] WIP: Data at rest encryption

2016-06-14 Thread Jim Nasby
ver an encrypted FS, other than a feature comparison checkmark...) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- S

Re: [HACKERS] gettimeofday is at the end of its usefulness?

2016-06-14 Thread Jim Nasby
that presumably the explain penalty would be a moot point. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent vi

Re: [HACKERS] 10.0

2016-06-14 Thread Jim Nasby
hat doesn't currently exist anyway. So no matter what, you won't be able to use it if you're interested in <10.0 (or <9.6 if we went with one of the other proposals). Unless folks were thinking this is something that would be backpatched? -- Jim Nasby, Data Architect, Blue Tr

Re: [HACKERS] Use of index for 50% column restriction

2016-06-14 Thread Jim Nasby
On 6/8/16 4:36 PM, Bruce Momjian wrote: Just a follow-up, but even with a randomized correlation order, it seems 25% restrictivity generates a Bitmap Index Scan: AFAIK we do the bitmap heap scan in heap order, thereby eliminating the effect of correlation? -- Jim Nasby, Data Architect, Blue

Re: [HACKERS] 10.0

2016-06-14 Thread Jim Nasby
On 6/14/16 3:38 PM, Joshua D. Drake wrote: On 06/14/2016 12:46 PM, Jim Nasby wrote: Any ideas on naming for such a function? version_detail()? I suppose while we're at this we might as well provide the compile details as well. version(detail) or version(verbose) I don't think tha

Re: [HACKERS] 10.0

2016-06-14 Thread Jim Nasby
On 6/14/16 3:56 PM, Tom Lane wrote: Jim Nasby writes: On 6/14/16 3:01 PM, Robert Haas wrote: This seems kind of silly, because anybody who is writing code that might have to run against an existing version of the database won't be able to use it. The one thing that absolutely has to be

Re: [HACKERS] 10.0

2016-06-15 Thread Jim Nasby
to pg_config? It's common to need to know what version you're handling in a Makefile, and today that's pretty ugly (especially when something is stamped as beta, since it breaks assumptions about numeric). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in

Re: [HACKERS] proposal: integration bloat tables (indexes) to core

2016-06-16 Thread Jim Nasby
views, but rather functions that serve specific purposes. For table bloat that means a function that returns what the heap size should be based on pg_stats. For locking, it means providing information about which PID is blocking which PID. After that, most everything else is just window dressing. --

Re: [HACKERS] Bug in to_timestamp().

2016-06-23 Thread Jim Nasby
ctions. Not the nicest way to handle this problem, but it is workable and having a regex example available for people to start with would be very helpful. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in T

[HACKERS] Bad behavior from plpython 'return []'

2016-06-30 Thread Jim Nasby
for everything that's varlena (AFAICT plperl already suffers from this). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-94

Re: [HACKERS] Bad behavior from plpython 'return []'

2016-07-01 Thread Jim Nasby
n't have a choice about that unless we expressly forbid arrays where any of the elements of *dims were 0 (which I suspect we should probably do anyway... I don't see how you can do anything with a 2x0x3 array...) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts

Re: [HACKERS] Reviewing freeze map code

2016-07-01 Thread Jim Nasby
s all-visible for index-only purposes. If it's an insert mostly table, it can be a long while till vacuum comes around. ISTM that's something that should be addressed anyway (and separately), no? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Archi

Re: [HACKERS] Reviewing freeze map code

2016-07-01 Thread Jim Nasby
On 7/1/16 3:43 PM, Andres Freund wrote: On 2016-07-01 15:42:22 -0500, Jim Nasby wrote: On 7/1/16 2:23 PM, Andres Freund wrote: The only cost of that is that vacuum will come along and mark the page all-visible again instead of skipping it, but that's probably not an enormous expense in

Re: [HACKERS] Bug in batch tuplesort memory CLUSTER case (9.6 only)

2016-07-02 Thread Jim Nasby
testing. Though I do think something that's sorely needed is the ability to test stuff at the C level. Sometimes SQL is jut too high a level to verify things. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Troubl

Re: [HACKERS] Constraint merge and not valid status

2016-07-16 Thread Jim Nasby
t may have some. Is that an oversight? Seen as how you used to be able to illegally twerk NOT NULL status on children (and maybe still can), I'd bet this is a bug... -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data

Re: [HACKERS] application_name in process name?

2016-07-16 Thread Jim Nasby
? In a lot of situations ("top" for instance) only a limited number of characters can be displayed from a process title. I'm hesitant to add fields to that string that we don't really need. Could we make this configurable, similar to log_line_prefix? -- Jim Nasby, Data Ar

Re: [HACKERS] A Modest Upgrade Proposal

2016-07-17 Thread Jim Nasby
because arrays are a PITA? Is it too hard to call functions? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent

Re: [HACKERS] A Modest Upgrade Proposal

2016-07-17 Thread Jim Nasby
ta, and because of it's binary nature the odds of some kind of a corruption event happening are far higher than with something like londiste. Certainly many environments don't have those concerns though. Having options are good. -- Jim Nasby, Data Architect, Blue Treble Consulti

Re: [HACKERS] One process per session lack of sharing

2016-07-17 Thread Jim Nasby
Depending on how it was structured, it might also insulate the database from having to panic if a function crashed it's process. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://Blu

Re: [HACKERS] A Modest Upgrade Proposal

2016-07-18 Thread Jim Nasby
a function in that extension: EXTENSION MODE citus; master_create_distributed_table 'github_events', 'created_at', 'append'; EXTENSION MODE; instead of SELECT master_create_distributed_table('github_events', 'created_at', 'append'); ob

Re: [HACKERS] PoC: Make it possible to disallow WHERE-less UPDATE and DELETE

2016-07-21 Thread Jim Nasby
On 7/21/16 11:46 AM, David Fetter wrote: > Can't you implement this as a extension? Yes. In that case, I'd want to make it a contrib extension, as it is at least in theory attached to specific major versions of the backend. Howso? -- Jim Nasby, Data Architect, Blue Treble Consu

[HACKERS] Bug with plpgsql handling of NULL argument of compound type

2016-07-22 Thread Jim Nasby
ot supported, but it would be nice if I could just do CREATE TYPE c AS (t text NOT NULL, i int); -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532)

Re: [HACKERS] Bug with plpgsql handling of NULL argument of compound type

2016-07-22 Thread Jim Nasby
L::c).t IS NULL might be allowed (special case retrieving field values from a composite that's not actually defined). -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com

Re: [HACKERS] Rethinking TupleTableSlot deforming

2016-07-22 Thread Jim Nasby
e additional support that would be needed in expanded objects themselves. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461

Re: [HACKERS] Rethinking TupleTableSlot deforming

2016-07-22 Thread Jim Nasby
On 7/22/16 1:58 PM, Andres Freund wrote: On 2016-07-22 13:51:31 -0500, Jim Nasby wrote: Another option would be to remember the tuple offsets (NOT attcacheoff) that have been computed as well as whether a varlena attribute has actually been deformed. That eliminates the need to pre-declare what

<    14   15   16   17   18   19   20   21   22   23   >