Hello Friends

Hope you are doing great



Please let me know if you have any Hadoop Developer with some Admin
Experience . Please share it on msha...@dtscinc.com



We are a looking for a strong HADOOP  developer with some admin . Good to
have Cloudera certified.



*Location: Eden Prairie, MN*

*Open for h1b s who can join immediately*

*Years of exp at least 10 +*


·         Implemented Spark streaming to receive real time data from the
Push agents and dump them to event hub

·         Handled importing data from the sources for data cleansing and
transformations

·         Created Spark batch jobs to move data from event hubs to anomaly
detection engine

·         Development of Spark streaming, SQL and batch jobs through Scala

·         Implemented Kafka message receiving for spark streaming job

·         Created Spark SQL queries for faster requests

·         Implemented Hive Queries for analyzing data using Hive QL

·         Converted the data into Parquet format and read the data from
Parquet format

·         Orchestrating Oozie Workflow Engine in running workflow jobs

·         Worked on creating RDDs, Data Frames and performed different
Actions and Transformations

·         Defined the data flow within Hadoop eco system and guide the team
with the implementation

·         Developed custom UDFS and implemented Pig scripts

·         Involved in Azure Data Factory (ADF) Pipeline creation for job
execution

·         Provided support to data analysts in running Hive queries to for
further anomaly analysis

·         Specifying the cluster size, allocating Resource pool,
Distribution of Hadoop by writing the specification texts in JSON and
Parquet file formats





*Best,*

*Mani Sharma*

*Team Lead*

*Dominion Technology Services Corp.*

3900 Westerre Parkway, Suite 300

Richmond, VA 23233

*msha...@dtscinc.com <msha...@dtscinc.com>* |www.dtscinc.com

-- 
You received this message because you are subscribed to the Google Groups "SAP 
BASIS" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to sap-basis+unsubscr...@googlegroups.com.
To post to this group, send email to sap-basis@googlegroups.com.
Visit this group at https://groups.google.com/group/sap-basis.
For more options, visit https://groups.google.com/d/optout.

Reply via email to