Critical Skills to Possess:
- Hands-on experience with Azure Databricks
- Strong experience developing Azure Logic Apps for workflow automation and integration.
- Proficiency in Azure Data Lake
- 5+ years of experience in data engineering or integration roles.
- Strong hands-on expertise in Azure Data Factory, Azure Logic Apps, Event Hub/Event Grid, and Service Bus.
- Proficiency in Azure Databricks – Spark, Delta Lake, notebooks, job clusters, and performance tuning.
- Experience with ETL/ELT design, data warehousing concepts, and big data technologies.
- Proficiency in SQL and one programming language (Python, Scala, or .NET).
- Solid understanding of Azure storage options (Data Lake, Blob Storage, SQL Database, Synapse).
- Experience with Git-based version control and DevOps pipelines.
- Knowledge of security and compliance in Azure environments.
- Strong problem-solving skills and ability to work independently or in teams.
Preferred Skills:
- Experience with Power BI, Azure Synapse Analytics, or other BI tools.
- Familiarity with REST APIs, JSON, and XML integrations.
- Exposure to event-driven architecture and streaming pipelines (Kafka, Azure Event Hubs).
- Knowledge of data governance tools such as Purview.
- Certifications: Azure Data Engineer Associate, Azure Solutions Architect, or Databricks Certified Developer.
Preferred Qualifications:
- BS degree in Computer Science or Engineering or equivalent experience