Description:
Senior Azure Data Engineer Responsibilities
- Design and develop robust data pipelines to ingest, store, and process data from various sources.
- Create and maintain data models that support data analysis and reporting.
- Build and maintain Extract, Transform, Load (ETL) processes to ensure data quality and consistency.
- Communicate effectively and timely with customers, team members, and management.
- Provide consistent and effective production application support.
- Ensure required project documentation is developed and maintained.
- Adhere to Change Management policies and procedures.
- Quickly and effectively respond to operational issues.
- Understand business challenges and goals to drive solutions.
- Exhibit company values in daily work and collaboration.
Senior Azure Data Engineer Requirements
- Bachelor's degree highly preferred, preferably in Computer Science, MIS, Engineering, or a related technology field.
- Experience with Databricks, including notebooks, clusters, and jobs.
- Proficiency in a major cloud platform, preferably Microsoft Azure (CosmosDB, Azure Storage, Azure Key Vault, Azure Event Hubs).
- Experience with on-prem databases and ETL processes, including Oracle and SSIS.
- Familiarity with Agile, DevOps, and CI/CD methodologies.
- Experience with Power BI or similar data visualization tools.
- Ability to build relationships and work with all levels of management and external groups.
- Experience leading and managing technology projects across teams and business units.
- Hands-on experience with performance tuning in a lakehouse environment (partitioning, aggregations, materialized views).
- Knowledge of structured & unstructured data—databases, data warehouses, and data lakes.
- Strong project management, consulting, and communication skills.