In a project, which was the first one I architected as SO, we had a whole bunch of services, some using RMI, some Local->Local and two of them were large message based bulk load... ETL.
The Customer Service had a "child" service, CustomerUpdate and the ProductManagement Service had a child service of ProductUpdate. The two Update services were bulk uploaders (hence the reason for detaching them from the main service, although no services in the rest of the application could get to the Update Services which were only accessible from the Mainframe data dumps. The reason for this was to have a clear structure over what the domain was of the ETL, the Product guys built their uploader and the Customer guys build the Customer one. This made sure that the ETL fitted in with the data and behaviours of the overall customer and product services. So yes you can do ETL in an SOA way... but ask them what the _Services_ are and what the context of those services is, ETL _must_ be subservient to a wider business service or its just traditional data dumping in a new guise. Steve 2008/10/16 nibeck <[EMAIL PROTECTED]>: > I'm still trying to get my head wrapped around SOA and all it entails > in my industry, which is turning out to be quite a challenge! This > group has been a wealth of information and I thank all of the > contributors for that. > > I was recently reviewing some documents by the team that manages our > data warehouse project, and they stated that they are looking at a SOA > based approach to their ETL system. After pondering this for a while, > I'm not quite sure I get what they are trying to do. My gut tells me > they are simply using the term SOA so they sound important :-) > > Anyway, does anyone have any concrete example of how SOA and ETL > can/do relate? I can see that a discussion around data services may > involve ETL, as the ultimate source of the data, but a SOA driven ETL > process seems kinda upside down to me. > > Thought this may be an interesting discussion. > > _mike > >
