Data Engineer

Critical Skills to Possess:

�       Advanced working knowledge and experience with relational and non-relational databases.

�       Advanced working knowledge and experience with API data providers

�       Experience building and optimizing Big Data pipelines, architectures, and datasets.

�       Strong analytic skills related to working with structured and unstructured datasets.

�       Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.

�       Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.

�       Strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse.

�       Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.

�       Azure DevOps experience to deploy the data pipelines through CI/CD.

�       Minimum 5-7 years of practical experience as Data Engineer.

Bachelor?s degree in computer science, software engineering, information technology, or a related field.

�       Azure cloud stack in-production experience.

Preferred Qualifications:

  • BS degree in Computer Science or Engineering or equivalent experience
Not sure where to start? Ask IVY.
IVY