Big Data Engineer

Job Description

  • We are looking for a skilled Python Developer with 3 to 7 years of hands-on experience to join our growing engineering team, with a strong background in BigData processing and Python-based application development.
  • The ideal candidate will have deep expertise in Python programming, including proficiency with frameworks such as PySpark, Pandas, and NumPy for handling large-scale data pipelines and analytics workflows.
  • Hands-on experience with BigData ecosystems including Hadoop, Apache Spark, Hive, or Kafka is essential to support our data-intensive platform development and real-time data processing needs.
  • Proficiency with GitHub Copilot and AI-assisted development tools to accelerate code delivery, improve code quality, and contribute to an efficient and modern development workflow.
  • The candidate should have solid experience designing, building, and maintaining scalable ETL pipelines, data ingestion frameworks, and batch or streaming data processing systems.
  • Strong understanding of RESTful API development, microservices architecture, and integration patterns to support backend services that interact with BigData infrastructure.
  • Experience with cloud platforms such as AWS, GCP, or Azure for deploying Python-based applications and BigData solutions is highly preferred for this Pune-based role.
  • A commitment to writing clean, well-documented, and testable code following best practices such as code reviews, version control with Git, and CI/CD pipeline integration.
Not sure where to start? Ask IVY.
IVY