Hello,
This is *Bharath Kumar from Yochana IT*; We are looking for *Big data Consultant at Redmond WA *the below mentioned job description. Kindly forward me your resume, rate and contact details for further process at *bhara...@yochanait.com <bhara...@yochanait.com>* I also request you to forward this opportunity to your friends or colleagues; so that we can help someone who may be in search of a job or looking for a change. *Role :* Big data Consultant *Location :* Redmond WA *Note: We have F2f interview drive on Thursday(25th Aug) so need only locals to WA. * *Job description:* Need onsite resources with expertise in Big Data (EventHubs, Spark, Cassandra) Development Build the Event Hubs integration with Service Fabric micro services implementation. Streaming the processed files from blobs into EH for downstream processing. a. Anonymized files (~1000 of them and to a size of ~GB) will be given as input b. Service Fabric code portion will be provided. 2. Build the Spark processing reading off EventHubs, implementation in either Python or Scala would suffice. a. Look at the caching needs; leverage .cache to retain appropriate results from Spark ‘Actions’ in Spark executors 3. Our team will evaluate a set of data store that would be a landing spot post Spark – Blobs being a required one. We will pick 1 or 2 from this list -- SQL DW, Azure SQL DB, Cassandra and DocumentDB being other candidate stores and we will have code snippets and/or guidance Integration & Deployment 1. Integrate the items from above with completed items (Azure Data Factory with ARM provisioning, picking up from the ADF pipeline which lands files onto blobs) 2. Apply best practices for capacity planning, deployment for E2E 3. Integrate the deployment with existing set of tools and processes. Testing 1. Build a unit test framework that can test each building block in isolation (ADF à Blobs, Blobs à Service Fabric, Service Fabric à EH, EH à Spark, Spark à <Data Store> 2. Build an E2E test environment with telemetry on latency, throughout with percentiles. *Leverage APM tools as appropriate *Thanks & Regards,* *Bharath Kumar* *Sr. Technical Recruiter* *Yochana IT Solutions INC* *23000 Commerce Dr., Farmington hills, MI-48335* *Contact: 248-598-7509(Direct), 248- 213- 6465 Ext- 127(Office), 248-876-4228 (Fax) * *bhara...@yochanait.com <bhara...@yochanait.com> || www.yochanait.com <http://www.yochanait.com/>* *Skype ID: bharathyochanait || Yahoo!: chidurala_bharath* *Note: This is not an unsolicited mail. If you are not interested in receiving our e-mails then please reply with subject line Remove* -- You received this message because you are subscribed to the Google Groups "Open Source Erp & Crm" group. To unsubscribe from this group and stop receiving emails from it, send an email to open-source-erp-crm+unsubscr...@googlegroups.com. To post to this group, send email to open-source-erp-crm@googlegroups.com. Visit this group at https://groups.google.com/group/open-source-erp-crm. For more options, visit https://groups.google.com/d/optout.
