*Position: Data Engineer* *Location: Remote*
*Visa: No H1B* The Role: Emids are looking for an experienced Data Engineer who can help move on-prem Hadoop workloads to Google Cloud (GCP). Responsibilities: • Export data from the Hadoop ecosystem to ORC or Parquet file • Build scripts to move data from on-prem to GCP • Build Python/PySpark pipelines • Transform the data as per the outlined data model • Proactively improve pipeline performance and efficiency ‘Must Have’ Experience: • 4+ years of Data Engineering work experience • 2+ years of building Python/PySpark pipelines • 2+ years working with Hadoop/Hive • 4+ years of experience with SQL • Any cloud experience – AWS, Azure, GCP • Experience with Data Warehousing & Data Lake • Understanding of Data Modeling • Understanding of data files format like ORC, Parquet, Avro ‘Nice to Have’ Experience: • Google experience – Cloud Storage, Cloud Composer, Dataproc & BigQuery • Experience using Cloud Warehouses like BigQuery (preferred), Amazon Redshift, Snowflake • etc. • Working knowledge of Distributed file systems like GCS, S3, HDFS etc. • Understanding of Airflow / Cloud Composer • CI/CD and DevOps experience • ETL tools e.g., Informatica (IICS) Ab Initio, Infoworks, SSIS -- Regards ! ANSHUL ASTHANA *Direct: 803-818-3474 *EXT-136* E : **ans...@1pointsys.com* <ans...@1pointsys.com> Recruiter | 1 Point System LLC Connect on LinkedIn: linkedin.com/in/anshulasthana28 <https://www.linkedin.com/in/anshulasthana28> 115 Stone Village Drive • Suite C • Fort Mill, SC • 29708 An E-Verified company | An Equal Opportunity Employer Fax : 803-832-7973 | W : *www.1pointsys.com* <http://www.1pointsys.com/> -- You received this message because you are subscribed to the Google Groups "Android Discuss" group. To unsubscribe from this group and stop receiving emails from it, send an email to android-discuss+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/android-discuss/CAJ0r2jB8VmCya7i5AUt97ircbE%3DMro99hxYmnX2UybFfPxxU0g%40mail.gmail.com.
