Re: [service-orientated-architecture] Re: SOA & ODS?

[Stefan Tilkov]

Thanks, lots of stuff to follow up for me.  I will try to post a summary of the findings and our final conclusion (once we have one) ... Stefan   On Jun 1, 2006, at 6:01 AM, Stuart Charlton wrote: My two cents (having built "single views of the customer" with both a classic ODS and a services-oriented approach backed by an ODS and EDW).... To me the use of an ODS is the same trade-off you have with caches:  how are you going to manage cache coherency?   You can do it fairly easily with batch updates, but then your ODS is always behind the curve.  You can do it with events, but then there is infrastructure and (traditionally) brittleness.  In either case, there are conflicts you have to resolve with complex rules & compensations.   In the context of SOA-based "master data management",  one can do parallel service invocations out to the "freshest data", certainly.  But there are some areas where an ODS is still needed: - a persistent cross-reference - master key management - a cache of canonicalized distributed data - a store for derived and/or invented fields (such as those created by a cleansing process) The service implementation that encapsulates the ODS must: - route requests to the appropriate services that contain the appropriately timed snapshot of data (some go to the ODS/cache, others to the service that houses the "book of record" for a field) - route updates to a cleansing service to ensure matching, data clustering, etc. occurs - ensure keys and links are generated and preserved - route cleansed updates to the ODS - route & transform notifications to other participating services An integration server comes in handy here, given the amount of routing and transforming going on.  I've seen successful implementations of this with WebLogic (server, integration) and AquaLogic Data Services (aka. Liquid Data) in concert with a cleansing server (e.g. Trillium, ISI, First Logic, or DataFlux).  Though some (SAP ,  IBM/DWL, Oracle) would claim this is what their MDM solutions actually "do" in one package, complete with pre-defined service interfaces, but I think they're a bit too new in the market. Cheers Stu ----- Original Message ---- From: Stefan Tilkov <[EMAIL PROTECTED]> To: service-orientated-architecture@yahoogroups.com Sent: Wednesday, May 31, 2006 2:13:00 PM Subject: Re: [service-orientated-architecture] Re: SOA & ODS? On May 31, 2006, at 3:46 PM, patrickdlogan wrote: >> What do you think? Is an ODS something that you would avoid in an >> ideal SOA scenario? Or do you consider it a vital piece an any >> decent company's IT environment? >> >> Personally, I'm still undecided. I have a strong fear of creating a >> huge, monolithic, centralized bottleneck and maintenance issue, >> while on the other hand I can't seem to be able to find a good "pure >> SOA" alternative. > > If your ODS is a huge, monolithic, centralized bottleneck and > maintenance issue, then by all means find a way to get rid of it. > Point taken; we have an ODS yet, though -- the question is whether  creating one is a good idea or not, and if it is, how to avoid its  turning into the problem I described. > On the other hand I think trading one fad for another is not a good > practice either. "Pure SOA" is a fad just as much, even more, than > "ODS" was a fad a half dozen years ago. > > If you have a set of services working on a common set of data, > executing business transactions, taking business measurements, and > gauging new decisions based on recent history, then those services may > benefit from sharing a well-defined database. Such a database may be > considered an "operational data store" and can be done well (performs > and is maintainable) or not. > > What is a well-defined ODS? Read Ralph Kimball. He always has clearly > presented ideas based on real experience. Avoid Bill Inmon, who rode > the DW/ODS fad like a Maui wave. > > For example, see http://www.dbmsmag.com/9712d05.html for some of > Kimball's ideas on ODS. > Thanks for the pointer, good read. Stefan > I am still looking for the Ralph Kimball of SOA to emerge. > > -Patrick > > > > > > > > > > ------------------------ Yahoo! Groups Sponsor -------------------- > ~--> > Protect your PC from spy ware with award winning anti spy  > technology. It's free. > http://us.click.yahoo.com/97bhrC/LGxNAA/yQLSAA/NhFolB/TM > -------------------------------------------------------------------- > ~-> > > > Yahoo! Groups Links > > > > > > > SPONSORED LINKS Computer software Computer aided design software Computer job Soa Service-oriented architecture YAHOO! GROUPS LINKS  Visit your group "service-orientated-architecture" on the web.    To unsubscribe from this group, send an email to:  [EMAIL PROTECTED]    Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service. SPONSORED LINKS Computer software Computer aided design software Computer job Soa Service-oriented architecture YAHOO! GROUPS LINKS  Visit your group "service-orientated-architecture" on the web.    To unsubscribe from this group, send an email to:  [EMAIL PROTECTED]    Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service. SPONSORED LINKS Computer software Computer aided design software Computer job Soa Service-oriented architecture YAHOO! GROUPS LINKS  Visit your group "service-orientated-architecture" on the web.    To unsubscribe from this group, send an email to:  [EMAIL PROTECTED]    Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service.