Hi, Please find this requirement and send me your consultant resume at manish.srivast...@idctechnologies.com and call me 408-844-3778.
*Title: Lead Big data ( Hadoop ) (Need GC/USC and Local consultant) * *Duration: 6+ Months * *Location: Basking Ridge NJ, and Boston MA * Project; Big data platform Data Lake Responsibilities: - Provide hands-on leadership for the design and development of ETL data flows using Hadoop and Spark ECO system components. Leading the develop of large-scale, high-speed, and low-latency data solutions in the areas of large scale data manipulation, long-term data storage, data warehousing, low-latency retrieval systems, real-time reporting and analytics Data applications - visualization, BI, dashboards, ad-hoc analytics - Design & implement work flow jobs using Talend & Unix / Linux scripting to perform ETL on Hadoop platform - Translate complex functional and technical requirements into detailed design - Perform analysis of data sets and uncover insights - Maintain security and data privacy - Propose best practices/standards - Work with the System Analyst and development manager on a day-to-day basis - Work with other team members to accomplish key development tasks - Work with service delivery (support) team on transition and stabilization - Design and develop optimal solutions for the implementation, maintenance and monitoring of all components of software - Responsible for integrating all development with the architecture used across the company - Help shape and augment team’s continuous delivery capabilities and utilize DevOps best practices to improve delivery automation, collaboration, and efficiency - Design and develop ETL data flows using Hive / Pig. - Loading from disparate data sets. - Pre-processing using Hive and Pig. - Translate complex functional and technical requirements into detailed design. - Perform analysis of data sets and uncover insights. - Maintain security and data privacy. - Implement data flow scripts using Unix / hive / pig scripting. - Propose best practices/standards. - Work with the System Analyst and Development Manager on a day-to-day basis - Work with other team members to accomplish key development tasks - Work with service delivery (support) team on transition and stabilization Required Software / Tools: - We are looking for a Lead Big Data Developer who will lead and work on the collecting, storing, processing, and analyzing of huge sets of data. - The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. - You will also be responsible for integrating them with the architecture used across the company. - Individual should have expertise and at least 5 years of hands-on experience in Java Enterprise ecosystem (Design, Development, Test, Deploy on Production) is required. - At least 4 years of hands-on experience with Hadoop/Hive/MapReduce/Pig/Sqoop/Flume (Design, Development, Test, Deploy on Production Hadoop cluster) , demonstrated ability to segment and organize data from disparate sources and knowledge of data security and encryption models is desirable. - Experience working with Hadoop/HBase/Hive/MRV1/MRV2 & ETL processing with HIVE/Pig scripts is required. - Demonstrate experience in implementing Unix scripting is required. - Any experience is health care insurance industry is a plus. Preferred Qualifications: · Team lead experience · ETL development experience · ETL data flows experience · Apache Spark · Talend experience · Unix/Linux Scripting experience · Shell Scripting experience · Python experience · HBase experience · NoSQL experience · Scala experience · JSON experience · REST experience · Sqoop experience · Flume experience · Data warehouse implementation experience *Thanks and Regards* *Manish Srivastava* *Sr. Technical Recruiter* *IDC Technologies, Inc.* *408-844-3778* -- You received this message because you are subscribed to the Google Groups "SAP Workflow" group. To unsubscribe from this group and stop receiving emails from it, send an email to sap-workflow+unsubscr...@googlegroups.com. To post to this group, send email to sap-workflow@googlegroups.com. Visit this group at https://groups.google.com/group/sap-workflow. For more options, visit https://groups.google.com/d/optout.
