Summary:
The Senior Data Engineer works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. This role also partners with the data science team on special projects related to model development and deployment framework.?The Sr Data Engineer team supports marketing analytic teams with analytical tools that enable our analytics and business communities to do their job easier, faster and smarter. The team brings together data from different internal & external partners and builds a curated Marketing analytics focused data & tools ecosystem. The Sr Data Engineer plays a crucial role in building this ecosystem depending on the Marketing analytics communities need.
Minimum Qualifications:
? Bachelor?s Degree in computer science or engineering; or equivalent technical training and experience.
? 5+ years of experience building and deploying large-scale data processing pipelines.
? 5+ years of experience with AWS, Spark with Python/Scala, SQL with Redshift, Postgre SQL and Columnar Databases
? 5+ years of experience with Workflow & pipeline systems with Airflow.
? Experience in Databricks
? Experience in GIT
Preferred Qualifications:
? Master?s Degree in computer science, computer engineering, IT or another related field of study.
? 8+ years of experience in Data & Analytics
? Experience with message-based, loosely coupled architectures (e.g. Kafka).
? Experience developing systems intended for cloud deployments (AWS, EKS, lambda?s, etc.). DevOps experience. Experience with analytics platforms like Looker or Tableau.
? Experience in DevOps orchestration tools
? Databricks Certified Data Engineer Professional certification
Work Timings: 11 ? 8 PM IST