Senior AI Backend Engineer

ob Title: Senior AI Backend Engineer
Key Skills: Python, FastAPI, REST APIs, Distributed Systems, LLM Orchestration, AWS, Docker, CI/CD, AI Evaluation Frameworks, STT Pipelines
Experience: +7 YOE
Location: LATAM (Exclusive)
Mode: Remote

We at Coforge are hiring a Senior AI Backend Engineer (21736) with the following skill set.

Key Responsibilities

• Build and operate the production backend for a Voice-to-Action AI pipeline, including Speech-to-Text (STT) and LLM orchestration services
• Design scalable and reliable backend systems within an existing distributed architecture
• Develop instrumentation, evaluation, and regression frameworks for AI workflows and LLM-based systems
• Define and monitor key quality metrics such as transcription accuracy, normalization drift, edit rate, and field-audio performance
• Establish feedback loops and calibration practices to optimize non-deterministic AI systems in production
• Evaluate and benchmark STT and LLM providers against internal performance metrics
• Build and maintain scalable cloud-native services using AWS, Docker, and CI/CD pipelines
• Collaborate with backend engineering teams to improve operational excellence and platform scalability
• Support the adoption of AI-assisted and agentic engineering workflows across the organization
• Contribute to broader backend platform initiatives after the Voice-to-Action pipeline reaches production readiness

Required Skills & Qualifications

• 7+ years of experience in backend engineering with strong expertise in Python
• Hands-on experience with FastAPI or similar backend frameworks
• Strong understanding of REST API development, service architecture, and distributed systems
• Proven experience deploying and operating production systems on AWS, GCP, or Azure
• Strong knowledge of Docker, CI/CD pipelines, cloud infrastructure, and operational best practices
• Experience building and maintaining production-grade AI/LLM systems
• Proven track record of implementing instrumentation, evaluation, regression testing, and monitoring for non-deterministic AI components
• Strong analytical and problem-solving mindset with focus on measurement and reliability
• Ability to quickly learn new domains and adapt to evolving technologies
• Experience working in fast-paced engineering environments with changing requirements

Preferred Skills

• Deep experience with LLM orchestration frameworks and AI evaluation infrastructure
• Experience with hosted LLM APIs such as OpenAI, Anthropic, Bedrock, or Vertex AI
• Familiarity with STT/ASR providers such as Whisper, Deepgram, or AssemblyAI
• Knowledge of MLOps and AI observability/monitoring tools
• Experience with agentic coding workflows such as Claude Code, Cursor, or similar platforms
• Backend experience in TypeScript or Node.js environments
• Experience with mobile voice pipelines or audio processing systems
• Bilingual or multilingual NLP experience
• Strong technical leadership and mentorship capabilities

Posted On: 05-06-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.