Essential functions:
– Create and maintain ETL pipelines in Azure Data Factory
– Analyze and cleanse data for a variety of data sources
– Develop ETL and validation logic in Azure Databricks using python
– Create and optimize data transformations using SQL or python
– Ingest data into Azure Blob Storage
– Work with subject-matter-experts to gain business knowledge and adapt into working
requirements without in-depth documentation
– Develop Azure Logic Apps to notify team of exceptions or alerts requiring engineer intervention
– Communicate with IT / IT Security to maintain cloud environment following organizational
security governance models
– Manage weekend maintenance activities (~6x per year) with other IT personnel during
maintenance windows
– Attend daily stand-ups in PST morning time
Desired skills
– Minimum 2+ years data engineering experience
– BSCS, BSCE, BSEE, or a degree in Computer Science or work equivalent
– Minimum 2+ years working with SQL
– Minimum 2+ years working with python or other programming language
– Experience with Microsoft Azure is a must
– Ability to adapt to quickly changing requirements