Critical Skills to Possess:
- Proven experience in DevOps/MLOps, with specialization in GenAI/LLM workloads.
- Strong expertise in cloud platforms (AWS, Azure, GCP) and IaC (Terraform, Pulumi).
- Skilled in containerization & orchestration (Kubernetes, Docker).
- Familiarity with LangChain, LangGraph, RAG patterns, vector DBs.
- Experience in infrastructure + LLM API cost optimization.
- Strong scripting and automation background (Python, Bash, SQL).
Nice to Have
- Hands-on deployment of open-source LLMs in production (Mistral, LLaMA, Phi, Qwen).
- Experience with multi-tenant SaaS infra and customer-specific deployments.
Knowledge of governance & compliance frameworks for AI/LLM in regulated industries
Preferred Qualifications:
- BS degree in Computer Science or Engineering or equivalent experience