A Data Engineer, work closely with a multidisciplinary Agile team to build high quality data pipelines driving analytic solutions. These solutions will generate insights from our connected data, enabling the team to advance the data-driven decision-making capabilities of our enterprise.
This role requires deep understanding of data architecture, data engineering, data analysis, reporting, and a basic understanding of data science techniques and workflows
Collaborate with a cross-functional agile team conceiving and building data-based products and services.
Partner with Data Scientists to develop prototypes for proof-of-concept validation.
Be the guardian of Data Quality and the pipelines.
Architect and/or implement data pipelines using modern tools with huge data volume and frequency.
Partner with business users to develop complex solutions.
A degree in a quantitative discipline such as Computer Science, Engineering, Mathematics, Statistics.
Excellent Software Engineering skills.
You must have a good understanding of data structures, algorithms, and data architecture patterns.
Real-world experience building, deploying, and serving data pipelines.
Initial experience in data analysis and building simple models
Strong knowledge in Spark, Python/Scala. Azure experience is a plus
Experience with CI/CD and pipeline automation.