Big Data Engineer SFO CA Longterm contarct No H1S
Spark, Scala/Java, SQL, Hadoop Job Description: Ideally 5-8 years of experience as a Software Engineer, experience in building distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time. Strong knowledge of programming languages/tools including Java, Scala, Spark, SQL, Hive, ElasticSearch. Most tools within the Hadoop Ecosystem are necessary, but we're mainly looking for Spark and Scala (Java if not Scala). Experience with streaming technologies such as Spark Streaming, Flink, or Apache Bean. Experience with Kafka is a plus. Working experience with various NoSQL databases such as Cassandra, HBase, MongoDB, and/or Couchbase. Would be a plus if you have prior Machine Learning or Deep Learning knowledge (this will be learned in the job). You will be working with the Marketing and Supply Chain side working on a Personalization initiative and getting data feed work to and from 3rd party vendors doing the analytics, marketing, and operations for email campaigns and catalog campaigns. Eventually will get into Machine Learning in areas of Product Recommendations on the site. The team is working in Spark in Scala to ingest transaction and clickstream data to come up with associations and product recommendations. You'll be working on batch processing and real-time streaming projects. In batch processing, you'll be creating Spark Jobs & Azure Cloud using Azure tools to do some of the scheduling and workflow management for the batch jobs. Currently migrating from Teradata to Microsoft Azure. Overall, you'll be building a new Data Platform using Spark and building out a data pipeline from transactional systems and process them in Spark and the framework is written in Scala. (or Java) *Thanks&Regards* *Madhukar Reddy* *IT Recruiter2250 Satellite Blvd., * *Suite # 115Duluth, GA 30097Direct: 678-267-3994* *Fax: 678-379-2357* *Office:678 688 4891 ext:203* madhu...@acadiatechnologies.com www.acadiatechnologies.com -- You received this message because you are subscribed to the Google Groups "CorptoCorp" group. To unsubscribe from this group and stop receiving emails from it, send an email to corptocorp+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/corptocorp/7b6f6582-d356-4f49-b1e5-d654592989c3%40googlegroups.com.
