Description:
The Data Engineer is responsible for implementing and maintaining the data infrastructure and systems that enable storage, retrieval, and processing of large volumes of data within the organization. This role involved working creatively and collaboratively with product managers, business analysts, and peer data engineers to ensure the availability, reliability, and efficiency of data pipelines and databases.
- This role is financed through external funding. The role exist as long as the grant funds are available and may be subject to renewal.
Essential Job Functions
- Implement robust data pipelines to ingest, process, and transform healthcare data from various sources, including electronic health records (EHR), claims data, and medical devices, into the Lurie Data Lake.
- Develop and maintain data warehouse models and schemas to support reporting and analytics needs.
- Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions.
- Ensure data quality, data security and data integrity through data validation and testing.
- Stay up-to-date with emerging technologies, industry trends, and best practices in data engineering and healthcare informatics.
- Collaborate with IT and infrastructure teams to manage and monitor data infrastructure components including databases, cloud services, and data processing frameworks.
- Other job functions as assigned.
Knowledge, Skills And Abilities
- Bachelor's degree in computer science, statistics, applied mathematics, data management, information systems, information science or a related quantitative field.
- 2+ years’ experience within data management disciplines including data integration, data modeling, data optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.
- Proficiency in one or more programming languages such as Python, Java, C# or Scala.
- Knowledge of to various data management architectures like data warehousing, data lakes, hub and spoke, and medallion architectures.
- Knowledge of data processes like data governance, master data management, and metadata management.
- Knowledge of big data technologies such as Hadoop, Spark, or Kafka.
- Knowledge of with cloud platforms and services, such as AWS, GCP or Azure.
- Knowledge of hybrid deployments: Cloud and On-Premises.
- Strong problem-solving and analytical thinking abilities.
- Effective communication and collaboration skills across departments in IT and Lurie business units.