Hello Friends Hope you are doing great
Please let me know if you have any Hadoop Developer with some Admin Experience . Please share it on msha...@dtscinc.com We are a looking for a strong HADOOP developer with some admin . Good to have Cloudera certified. *Location: Eden Prairie, MN* *Open for h1b s who can join immediately* *Years of exp at least 10 +* · Implemented Spark streaming to receive real time data from the Push agents and dump them to event hub · Handled importing data from the sources for data cleansing and transformations · Created Spark batch jobs to move data from event hubs to anomaly detection engine · Development of Spark streaming, SQL and batch jobs through Scala · Implemented Kafka message receiving for spark streaming job · Created Spark SQL queries for faster requests · Implemented Hive Queries for analyzing data using Hive QL · Converted the data into Parquet format and read the data from Parquet format · Orchestrating Oozie Workflow Engine in running workflow jobs · Worked on creating RDDs, Data Frames and performed different Actions and Transformations · Defined the data flow within Hadoop eco system and guide the team with the implementation · Developed custom UDFS and implemented Pig scripts · Involved in Azure Data Factory (ADF) Pipeline creation for job execution · Provided support to data analysts in running Hive queries to for further anomaly analysis · Specifying the cluster size, allocating Resource pool, Distribution of Hadoop by writing the specification texts in JSON and Parquet file formats *Best,* *Mani Sharma* *Team Lead* *Dominion Technology Services Corp.* 3900 Westerre Parkway, Suite 300 Richmond, VA 23233 *msha...@dtscinc.com <msha...@dtscinc.com>* |www.dtscinc.com -- You received this message because you are subscribed to the Google Groups "SAP BASIS" group. To unsubscribe from this group and stop receiving emails from it, send an email to sap-basis+unsubscr...@googlegroups.com. To post to this group, send email to sap-basis@googlegroups.com. Visit this group at https://groups.google.com/group/sap-basis. For more options, visit https://groups.google.com/d/optout.