Description:
You will be responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately
Responsibilities
- Collaborate with business and technology stakeholders to understand current and future data requirements
- Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
- Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
- Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
- Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
- Ensure optimum performance and identify improvement opportunities
Details: Experience Required
- 4+ Years of experience in Data Engineering
- Experience in Data ingestion for all types of data and data wrangling and transformations and land data in Big Query
- Experience in Stored procs, triggers, data modelling, Qlik View and cloud function and data fusion, astronomer and air flow
- Skilled in Data Analytics, Data Warehousing, Data Modeling