Hi, Please find this requirement and send me your consultant resume at manish.srivast...@idctechnologies.com and call me 408-844-3778.
*Title: Lead Big data ( Hadoop ) (Need GC/USC and Local consultant) * *Duration: 6+ Months * *Location: Basking Ridge NJ, and Boston MA * Project; Big data platform Data Lake Responsibilities: - Provide hands-on leadership for the design and development of ETL data flows using Hadoop and Spark ECO system components. Leading the develop of large-scale, high-speed, and low-latency data solutions in the areas of large scale data manipulation, long-term data storage, data warehousing, low-latency retrieval systems, real-time reporting and analytics Data applications - visualization, BI, dashboards, ad-hoc analytics - Design & implement work flow jobs using Talend & Unix / Linux scripting to perform ETL on Hadoop platform - Translate complex functional and technical requirements into detailed design - Perform analysis of data sets and uncover insights - Maintain security and data privacy - Propose best practices/standards - Work with the System Analyst and development manager on a day-to-day basis - Work with other team members to accomplish key development tasks - Work with service delivery (support) team on transition and stabilization - Design and develop optimal solutions for the implementation, maintenance and monitoring of all components of software - Responsible for integrating all development with the architecture used across the company - Help shape and augment team’s continuous delivery capabilities and utilize DevOps best practices to improve delivery automation, collaboration, and efficiency - Design and develop ETL data flows using Hive / Pig. - Loading from disparate data sets. - Pre-processing using Hive and Pig. - Translate complex functional and technical requirements into detailed design. - Perform analysis of data sets and uncover insights. - Maintain security and data privacy. - Implement data flow scripts using Unix / hive / pig scripting. - Propose best practices/standards. - Work with the System Analyst and Development Manager on a day-to-day basis - Work with other team members to accomplish key development tasks - Work with service delivery (support) team on transition and stabilization Required Software / Tools: - We are looking for a Lead Big Data Developer who will lead and work on the collecting, storing, processing, and analyzing of huge sets of data. - The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. - You will also be responsible for integrating them with the architecture used across the company. - Individual should have expertise and at least 5 years of hands-on experience in Java Enterprise ecosystem (Design, Development, Test, Deploy on Production) is required. - At least 4 years of hands-on experience with Hadoop/Hive/MapReduce/Pig/Sqoop/Flume (Design, Development, Test, Deploy on Production Hadoop cluster) , demonstrated ability to segment and organize data from disparate sources and knowledge of data security and encryption models is desirable. - Experience working with Hadoop/HBase/Hive/MRV1/MRV2 & ETL processing with HIVE/Pig scripts is required. - Demonstrate experience in implementing Unix scripting is required. - Any experience is health care insurance industry is a plus. Preferred Qualifications: · Team lead experience · ETL development experience · ETL data flows experience · Apache Spark · Talend experience · Unix/Linux Scripting experience · Shell Scripting experience · Python experience · HBase experience · NoSQL experience · Scala experience · JSON experience · REST experience · Sqoop experience · Flume experience · Data warehouse implementation experience *Thanks and Regards* *Manish Srivastava* *Sr. Technical Recruiter* *IDC Technologies, Inc.* *408-844-3778* -- -- *************************************************************************************** For all SAP related tutorials,Articles,Faqs,Tips www.sapbrainsonline.com **************************************************************************************** You received this message because you are subscribed to the Google Groups "sapbrains" group. To post to this group, send email to sapbrains@googlegroups.com To unsubscribe from this group, send email to sapbrains-unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/sapbrains?hl=en --- You received this message because you are subscribed to the Google Groups "sapbrains" group. To unsubscribe from this group and stop receiving emails from it, send an email to sapbrains+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.