Description:
As a Director, Tech Lead for a data engineering team in Data Strategy & Stewardship solution, you will partner with product owners, engineers and solution architect engineers to support the FM Transformation model input data capability. This position is a true hands-on Data Engineer & Tech Lead role to build and enhance the FM lake-house platform which is 100% cloud native in AWS. You will have the opportunity to work with a group of talented cloud and software engineers to write infrastructure and application code for a mission-critical system. You will be lead an agile team that brings together a wide variety of backgrounds, experiences, and perspectives to solve complex problems within AWS environment.
- Design the overall technological architecture of the product with the support of the team
- Responsible for executing technical design and infrastructure / environments strategy, including deployments, ensuring that these are kept in-line with a Minimum Viable Product (MVP) mindset of ‘emerging architecture’.
- Guide teams on technology strategy related to coding practices, continuous integration, and automated deployment
- Collaborate with global technology partners, solution architecture engineer, tech lead, product owner and team members to drive outcomes with focus on enriched customer experience
- Have a rich coding background in Python, Java or C#. Coding should still be your daily routine and like communicating ideas through coding and prototyping.
- Use git and create pull request as part of your daily routine
- Can understand and update existing CloudFormation code or create new CloudFormation template.
- Work on multiple projects simultaneously and maintain accountability
- Can quickly prototype something in AWS and demonstrate the outcome.
- Identify and remove complex technical impediments.
- Work with Product Owner to align the roadmap with strengths and opportunities within the technical stack. Bring forward business acumen and knowledge to influence decisions.
- Deliver end to end solution using innovative approaches to complex design problems
- Work flexible hours as needed to accommodate onsite and offshore team needs
- Thrives to ensure code quality is high with supporting unit test and automation, and timely delivery
- Stay abreast of emerging technologies and new AWS services or features.
- Drives low-level design and contributes to high-level architecture.
The Skills & Expertise You Bring
- Must have degree with a concentration in Computer Science, Information Technology, or a related field
- 7-10 years of experience in the development and design of complex applications
- Have hands-on knowledge of CloudFormation, coded and deployed CloudFormation templates in real AWS environment before. Or you are an expert with Terraform.
- Experience in leading a team, preferrable with offshore members
- Must have experience with data platform, data lake and lake house architecture. Have hands-on experience of building data lake with AWS S3 in production environment.
- Deep proficiency in more than one programming language is required. Knowledge of AWS services, Python, PySpark will be required.
- Deep proficiency in Data Workflow and Data Pipeline, good knowledge of AWS Step Function or Apache Airflow.
- Able to disassemble thousands of lines of existing code and make good sense of it and break it down to meaningful components.
- Built serverless application before, fluent with coding in Lambda, Glue and API Gateway. Worked in Linux environment and familiar with shell scripting.
- Knowledge of Dev ops, CI/CD knowledge required. Understand AWS CodeBuild. CodePipeline services and automation.
- Good knowledge of AWS Redshift is required, (possibly with another RDMS service i.e., RDS, Aurora, etc.)
- Must have working knowledge of containers with ability to create docker file
- Experience with microservice-based architecture, have experience of building a ECS or ESK Cluster and deploying containers to it.
- Familiar with application load balancer, API Gateway and how to secure APIs.
- Familiar with security concepts (authentication, authorization, encryption, digital signature), SSL, web service proxies, firewalls, multi-protocol gateways
- Financial/Insurance industry experience is a plus, not a must