Azure Data Engineer

Azure Data Engineer - Irving, TX Full-Time, Permanent - $110,000 - $120,000

Azure Data Engineer
Irving, TX
Full-Time, Permanent
$110,000 - $120,000

Required Skills:

                                  

  • Experience in GCP/Azure, Strong Data modelling, Python, Experience with RDBMS, Big Data processing frameworks and tools (Cloudera, Sqoop, Hive, Impala, Spark), DevOps tools and techniques (e.g. continuous integration, Jenkins, Puppet, etc)

                                                        

Preferred Skills:                                     

  • Experience building/migrating data pipeline from on-prem to Cloud (GCP or any cloud)

  • Understanding of cloud technologies

  • Unix Scripting

  • Tableau and Excel tool expertise

                                                     

Job description:                                     

  • Build data pipelines to ingest data from On-prem to cloud

  • Experience with Big Data processing frameworks and tools (Cloudera, Sqoop, Hive, Impala, Spark)

  • Experience with DevOps tools and techniques (e.g continuous integration, Jenkins, Puppet, etc)

  • Experience software development on a team using Agile methodology

  • Build data standardization & transformation logic using framework following Object Oriented Programming concept

  • Write Unit Test scripts

  • Implement standardized error handling & diagnostic logging

  • Schedule and maintain production workflows on-prem as well as cloud

  • Troubleshoot and resolve QA and Production defects

  • Handle code review and code deployment