Re: Is Spark suited for this use case?

2017-10-25 Thread Gourav Sengupta
Saravanan Thirumalai [mailto:saravanan.thiruma...@gmail.com] > *Sent:* Monday, 16 October 2017 4:29 AM > *To:* user@spark.apache.org > *Subject:* Is Spark suited for this use case? > > > > We are an Investment firm and have a MDM platform in oracle at a vendor > location and use Oracle

Re: Is Spark suited for this use case?

2017-10-20 Thread JG Perrin
I have seen a similar scenario where we load data from a RDBMS into a NoSQL database… Spark made sense for velocity and parallel processing (and cost of licenses :) ). > On Oct 15, 2017, at 21:29, Saravanan Thirumalai > wrote: > > We are an Investment firm

Re: Is Spark suited for this use case?

2017-10-16 Thread Jörn Franke
as OGG can do files and direct table > loading then sqoop for the rest. > > Simpler is better. > > Hope this helps. > C. > > From: Saravanan Thirumalai [mailto:saravanan.thiruma...@gmail.com] > Sent: Monday, 16 October 2017 4:29 AM > To: user@spark.apache.org > Sub

RE: Is Spark suited for this use case?

2017-10-15 Thread van den Heever, Christian CC
From: Saravanan Thirumalai [mailto:saravanan.thiruma...@gmail.com] Sent: Monday, 16 October 2017 4:29 AM To: user@spark.apache.org Subject: Is Spark suited for this use case? We are an Investment firm and have a MDM platform in oracle at a vendor location and use Oracle Golden Gate to replicat data

Is Spark suited for this use case?

2017-10-15 Thread Saravanan Thirumalai
We are an Investment firm and have a MDM platform in oracle at a vendor location and use Oracle Golden Gate to replicat data to our data center for reporting needs. Our data is not big data (total size 6 TB including 2 TB of archive data). Moreover our data doesn't get updated often, nightly once