As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.
Skills:
· Knowledge and experience with relational and non-relational databases.
· Knowledge and experience with relational and non-relational databases.
· Strong hands-on experience with MongoDB, including schema design, aggregation pipelines, indexing strategies, sharding, replica sets, and performance optimization.
· Proficiency in Azure Cosmos DB, including multi-model data access (Cosmos DB API for MongoDB, SQL API), partitioning strategies, consistency levels, throughput management (RU/s), and global distribution.
· Strong experience in graph data modeling and querying using Azure Cosmos DB Gremlin API, including graph traversals, vertex/edge design, and relationship-driven analytics.
· Strong hands-on experience in building RESTful APIs using FastAPI, including async endpoint design, Pydantic models, middleware, dependency injection, background tasks, and auto-generated OpenAPI/Swagger documentation.
· Experience with Azure API Management (APIM) for API gateway configuration, policy enforcement, versioning, and monitoring.
· Strong analytic skills related to working with structured and unstructured datasets.
· Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
· Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
· Strong experience in Project Management will be considered as an additional advantage.
· Azure DevOps experience to deploy the data pipelines and FastAPI services through CI/CD.
· Familiarity with Azure Functions, Azure App Service, or Azure Container Apps for hosting and scaling API workloads.
Qualifications and Experience:
· Minimum 5-7 years of practical experience.
- Bachelor’s degree in computer science, software engineering, information technology, or a related field.
· Azure cloud stack in-production experience.