Technical Architect - AI

Job Description

 

Platform Architecture and Governance

• Design the enterprise AI platform architecture spanning the LLM API gateway, GPU and compute allocation pools, sandbox provisioning, model registry, and security gate automation
• Define infrastructure standards, API gateway patterns, and reference architectures consumed by all AI delivery towers and partner integrations
• Establish guardrails for token metering, rate limiting, audit logging, DLP validation, SAST, DAST, dependency scanning, and model card review embedded in CI/CD
• Review security posture across all AI workloads with mapping to NIST AI RMF, AWS Well-Architected (including the Machine Learning Lens), and applicable enterprise compliance baselines

Agentic AI and LLM Engineering

• Architect multi-agent systems using LangGraph, LangChain, and Model Context Protocol (MCP) for complex workflow orchestration, planning, and tool use
• Define patterns for ReAct, Chain-of-Thought, Tree-of-Thoughts, and agent-to-agent coordination across enterprise and customer-facing use cases
• Design and optimize Retrieval-Augmented Generation (RAG) systems, embedding strategies, and semantic search across structured and unstructured enterprise data
• Establish MLOps and AgentOps practices for deployment, evaluation, observability, and continuous improvement of agents and models in production

AWS-Native Implementation

• Architect solutions on Amazon Bedrock, Amazon SageMaker, Amazon Q, Bedrock Agents, and Bedrock Knowledge Bases
• Define infrastructure patterns using Amazon EKS, AWS Lambda, ECS Fargate, API Gateway, EventBridge, SNS/SQS, Kinesis, S3, DynamoDB, Aurora, Redshift, Athena, OpenSearch, and Kendra
• Establish CloudFormation and AWS CDK templates and Terraform modules for isolated VPC sandboxes provisioned per project and per third-party partner
• Implement observability and FinOps using CloudWatch, AWS Cost Explorer, AWS Budgets, and chargeback reporting by team, project, and model

Salesforce and SaaS AI Integration

• Define integration architecture with Salesforce Agentforce, Einstein, Data Cloud, and Service Cloud, including Apex, Flow, and Platform Event integration patterns with AWS-hosted agents and APIs
• Establish governance over enterprise SaaS AI licenses, including usage tracking, renewal governance, and redundancy elimination across business units
• Architect cross-system identity, authorization, and data exchange patterns spanning Salesforce, AWS, and partner endpoints

Stakeholder and Delivery Leadership

• Partner with AIDO leadership, delivery tower leads, security, compliance, procurement, and program management to ensure platform adoption and consistent operating standards
• Produce enterprise-grade architecture artifacts, decision records, and operating model documentation suitable
• Mentor engineers across delivery towers and partner teams; lead architecture reviews and technical due diligence on partner-built systems

 

Required Skills

 

Core AI Frameworks

• Expert proficiency with LangGraph, LangChain, and agent orchestration frameworks
• Deep experience with Amazon Bedrock, SageMaker, and Amazon Q, including Bedrock Agents and Knowledge Bases
• Hands-on experience with Model Context Protocol (MCP), function calling, tool use, and structured output patterns
• Strong command of prompt engineering, evaluation harnesses, fine-tuning, and model optimization
• Working knowledge of transformer architectures, attention mechanisms, and multi-modal systems

Machine Learning

• Classical ML (regression, tree-based ensembles, gradient boosting, clustering) and deep learning (CNNs, RNNs, transformers) across supervised, unsupervised, and reinforcement paradigms; feature engineering, hyperparameter optimization, cross-validation, drift detection, and model evaluation
• End-to-end ML lifecycle on SageMaker spanning data preparation, training, deployment, monitoring, and retraining

AWS Platform

• SageMaker (Studio, Pipelines, Model Registry, Inference), Bedrock, EKS, Lambda, ECS Fargate, API Gateway, Step Functions
• S3, DynamoDB, Aurora, Redshift, Athena, OpenSearch, Kendra
• EventBridge, SNS/SQS, Kinesis, MSK
• CloudWatch, X-Ray, CloudTrail, AWS Config, GuardDuty, Macie, Security Hub
• IAM, KMS, PrivateLink, VPC design, and AWS Organizations governance

Salesforce and Enterprise SaaS

• Salesforce Agentforce, Einstein, Data Cloud, Service Cloud, and Sales Cloud integration patterns
• Apex, Flow, Platform Events, and REST/Bulk API integration with external AI services
• Familiarity with enterprise identity providers, SSO, OAuth, and SCIM provisioning across SaaS estates

Programming and Development

• Advanced Python with deep FastAPI experience for scalable, async API development
• Java proficiency sufficient to integrate with existing enterprise backend services
• Strong CI/CD background using AWS CodePipeline, CodeBuild, GitHub Actions, and Infrastructure as Code via Terraform and AWS CDK
• Containerization with Docker and orchestration with Kubernetes (EKS)

Data and Vector Systems

• Vector store architectures using OpenSearch, Bedrock Knowledge Bases, Pinecone, Weaviate, or Chroma
• Embedding model selection, hybrid search, and reranking strategies
• Graph database experience (Amazon Neptune, Neo4j) for knowledge representation
• Data ingestion, masking, synthetic data generation, and DLP validation pipelines

 

Ideal Years Of Experience

• 20+ years in software engineering with 5+ years focused on AI/ML systems
• 3+ years hands-on experience architecting and shipping production LLM and agentic AI applications

 

Education

• Bachelor's or Master's degree in Computer Science, AI/ML, or a related technical field
• AWS Certified Solutions Architect Professional or AWS Certified Machine Learning Specialty preferred
• Salesforce Certified AI Associate, AI Specialist, or Application Architect credentials is a plus

 

Additional Requirements

• Demonstrated success leading enterprise-scale AI platform builds with measurable business outcomes
• Track record architecting scalable cloud-native systems on AWS in regulated or large-enterprise environments
• Experience leading technical teams, mentoring engineers, and engaging executive stakeholders