NOTE : Need Passport Number and Client ID ( BADGE ) for below 10 years profiles *Role : Python Developer with ( **Pyspark, AWS Developer )* *Location : Dallas, TX*
*JD : * *Technology stack:* • Strong hands on experience in pyspark core, pyspark sql, python,hive and apache airflow dag development • Ability to understand and write complex sql queries as per the client requirement. • Good knowledge on AWS EC2 instances, EMR clusters, s3 storage, Athena, snowflake and dynamodb. • Knowledge on Bitbucket and jenkins to deploy the code . • Knowledge on JIRA ticketing tool and Agile methodology. *Roles and Responsibilities:* • Develop spark jobs using python API • Writing spark SQL and HQL to accommodate the requirement • Fine tuning the spark jobs • Creating Hive DDLs • Develop the airflow dags to define the workflow. • Testing and validating the developed spark scripts and dags. • Deploy the code onto the dev and prod environments • Monitoring the max table dags in production • Monitoring the apollo process dags in the production • Working on any enhancements in the max tables and apollo process • Generating weekly and monthly post edge apollo report. -- *The common question that gets asked in business is, 'why?' That's a good question, but an equally valid question is, 'why not?'* *Thanks & Regards* *Mohd Azhar uddin* *4229 Lafayette Center Dr., Suite #1625, Chantilly, VA 20151* *Tel: 703-831-8282 Ext. 2526, Fax : 703-439-2550,* * Hangouts ID : [email protected] <[email protected]>* *Email: [email protected] <[email protected]> Web: www.canopyone.com <http://www.canopyone.com/>* -- You received this message because you are subscribed to the Google Groups "project managment" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/project-managment. To view this discussion on the web visit https://groups.google.com/d/msgid/project-managment/CAFp5OXiqNpu6oDguK0aXcMFrGdQoVk_wy6cQnkVDky%3Df7CDJmQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
