Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-10-02 Thread M.-A. Lemburg
Tony Schmidt wrote: > Hi, Marc-Andre - well, so far you seem to be the only one suggesting > that cross-database joins is the way to go - everyone else has been > telling me to build a warehouse. I initially was trying to avoid the > warehouse idea to "avoid going through the external temporary >

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-29 Thread Jim
On this post, you are talking about Talend and Informatica like both are comparable... indeed both tools are comparable in power and functionality. But keep in mind Informatica is a proprietary solution, with no access to the code. You have a license fee + other costs associated to the use of Infa.

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-24 Thread Tony Schmidt
Hi, Marc-Andre - well, so far you seem to be the only one suggesting that cross-database joins is the way to go - everyone else has been telling me to build a warehouse. I initially was trying to avoid the warehouse idea to "avoid going through the external temporary resource", as you say. But th

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-24 Thread M.-A. Lemburg
snfctech wrote: > @Lemburg: Thanks for the suggestion. I'm sure you make a fine > product, but my development platform is Linux, and I don't want any > additional Windows servers to deal with (than the ones I'm already > stuck with.) Strange, EasySoft used to support their product on Linux as wel

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-24 Thread Tony Schmidt
@Martin: Thanks for your great feedback. So do you think it would be very beneficial for me to start with an Inman or Kimball book? Or do you think it would be just leisure reading and not very practical at best - fill my head with needless jargon and inflexible dogmas, at worst? I took a datab

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread Martin P. Hellwig
Tony Schmidt wrote: So do you think it would be very beneficial for me to start with an Inman or Kimball book? Or do you think it would be just leisure reading and not very practical at best - fill my head with needless jargon and inflexible dogmas, at worst? You have an unique opportunity he

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread Martin P. Hellwig
snfctech wrote: @Martin: I originally thought that there was nothing "magical" about building a data warehouse, but then I did a little research and received all sorts of feedback about how data warehouse projects have notorious failure rates, that data warehouse design IS different than normal

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread snfctech
@Lemburg: Thanks for the suggestion. I'm sure you make a fine product, but my development platform is Linux, and I don't want any additional Windows servers to deal with (than the ones I'm already stuck with.) On Sep 23, 2:02 am, "M.-A. Lemburg" wrote: > snfctech wrote: > > Does anyone have expe

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread snfctech
@Martin: I originally thought that there was nothing "magical" about building a data warehouse, but then I did a little research and received all sorts of feedback about how data warehouse projects have notorious failure rates, that data warehouse design IS different than normal RDBMS - and then t

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread nn
On Sep 22, 4:00 pm, snfctech wrote: > Does anyone have experience building a data warehouse in python?  Any > thoughts on custom vs using an out-of-the-box product like Talend or > Informatica? > > I have an integrated system Dashboard project that I was going to > build using cross-vendor joins o

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread Martin P. Hellwig
snfctech wrote: Thanks for your replies, Sean and Martin. I agree that the ETL tools are complex in themselves, and I may as well spend that learning curve on a lower-level tool-set that has the added value of greater flexibility. Can you suggest a good book or tutorial to help me build a data

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread M.-A. Lemburg
snfctech wrote: > Does anyone have experience building a data warehouse in python? Any > thoughts on custom vs using an out-of-the-box product like Talend or > Informatica? > > I have an integrated system Dashboard project that I was going to > build using cross-vendor joins on existing DBs, but

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread Martin P. Hellwig
snfctech wrote: Does anyone have experience building a data warehouse in python? Any thoughts on custom vs using an out-of-the-box product like Talend or Informatica? I have an integrated system Dashboard project that I was going to build using cross-vendor joins on existing DBs, but I keep hea

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-22 Thread snfctech
Thanks for your replies, Sean and Martin. I agree that the ETL tools are complex in themselves, and I may as well spend that learning curve on a lower-level tool-set that has the added value of greater flexibility. Can you suggest a good book or tutorial to help me build a data warehouse in pytho

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-22 Thread Sean DiZazzo
On Sep 22, 1:00 pm, snfctech wrote: > Does anyone have experience building a data warehouse in python?  Any > thoughts on custom vs using an out-of-the-box product like Talend or > Informatica? > > I have an integrated system Dashboard project that I was going to > build using cross-vendor joins o

custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-22 Thread snfctech
Does anyone have experience building a data warehouse in python? Any thoughts on custom vs using an out-of-the-box product like Talend or Informatica? I have an integrated system Dashboard project that I was going to build using cross-vendor joins on existing DBs, but I keep hearing that a data w