Back to jobs

AI Technical Architect

US - Washington DC

About the team:  

At the Capco Technology Delivery Center, we are dedicated to the financial services industries. Our professionals combine innovative thinking with unrivalled industry and domain expertise to offer our clients consulting expertise, complex technology and package integration, transformation delivery, and managed services, to move their organizations forward. Through our collaborative and efficient approach, we help our clients successfully innovate, increase revenue, manage risk and regulatory change, reduce costs, and enhance controls. Our teams stay at the forefront of industry trends and technologies that are driving innovation. From strategy to launch, we are adept at delivering across the full product lifecycle.   

About the Job:  

As a member of the Capco Technology Delivery Team, you’ll bring practical knowledge of agile development methodologies and engineering best practices. As an AI Architect, you’ll play an integral role using your experience and skills to contribute to the quality and implementation of our projects.  

We are seeking a visionary and highly skilled Generative AI Architect to lead the design and implementation of our next-generation AI systems, with a strong focus on foundation models and agentic AI. This role is pivotal in defining the architectural blueprint for enterprise-scale generative AI solutions, ensuring they are robust, scalable, secure, and aligned with our strategic business objectives. The ideal candidate will be a thought leader, capable of translating complex business challenges into innovative AI architectures and guiding cross-functional teams from conceptualization to production deployment.

What You’ll Get to Do:  

Generative AI Strategy & Architecture:

  • Define and evolve the enterprise-wide architectural vision and strategy for Generative AI and agentic systems, aligning with overall business goals and technology roadmaps.
  • Lead the design of modular, reusable, and scalable architectural patterns for GenAI and agentic applications across various domains.
  • Design and implement robust, secure solution patterns that can be operationalized across enterprise environments.

Foundation Models Expertise:

  • Deep expertise in various foundation models (e.g., LLMs, vision models, multimodal models) including their architectures, strengths, limitations, and fine-tuning techniques.
  • Evaluate, select, and integrate appropriate foundation models for specific use cases, considering factors like performance, cost, and ethical implications.
  • Develop strategies for model pre-training, fine-tuning, and continuous improvement.

Agentic AI Systems:

  • Architect and implement intelligent agentic AI systems using frameworks like LangChain, LangGraph, CrewAI, AutoGen, or similar.
  • Design complex agentic workflows, including planning, reasoning, tool integration, memory management, and human-in-the-loop interactions.
  • Lead the integration of agentic AI solutions with existing enterprise systems and define integration standards (e.g., RESTful APIs, microservices).

Prompt Engineering & Orchestration:

  • Apply advanced prompt engineering techniques to optimize AI model performance and steer outputs towards desired outcomes, minimizing bias and hallucinations.
  • Oversee orchestration of AI components and services, including LLM APIs, vector databases, and external tools.
  • Develop and implement Retrieval Augmented Generation (RAG) based solutions for enhanced contextual understanding and factual accuracy.

Scalable Infrastructure & MLOps:

  • Design and build cloud-native, containerized infrastructure (e.g., Kubernetes, ECS, EKS on AWS, Azure, GCP) for deploying GenAI models and agentic systems at scale.
  • Implement robust MLOps pipelines for the continuous integration, delivery, deployment, monitoring, and management of AI models in production.
  • Ensure AI solutions comply with regulatory requirements, data privacy, and ethical AI standards.

Innovation & Thought Leadership:

  • Stay abreast of the latest advancements in AI, machine learning, deep learning, and agentic systems, and apply this knowledge to drive innovation.
  • Rapidly develop Proofs of Concept (PoCs) and iterate solutions using an agile, experimental approach without compromising architectural integrity or long-term scalability.
  • Serve as a technical expert and mentor to junior AI engineers and architects, fostering a culture of continuous learning and improvement.
  • Contribute to internal workshops, knowledge sharing, and external forums as a thought leader.

Collaboration & Communication:

  • Collaborate effectively with cross-functional teams including product managers, data scientists, software engineers, security, and business stakeholders.
  • Articulate complex technical concepts to diverse audiences, both technical and non-technical.
  • Maintain detailed architectural documentation and operational playbooks.

What You’ll Bring with You:  

  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related quantitative field.
  • 10+ years of progressive experience in software architecture, with at least 2-3 years specifically focused on Generative AI and Machine Learning.
  • Demonstrated expertise in designing and implementing AI architectures with a strong focus on Generative AI and Agentic AI technologies.
  • Profound understanding of various foundation models (LLMs, vision models, multimodal models) and their underlying architectures (e.g., Transformers).
  • Hands-on experience with agentic AI frameworks such as LangChain, LangGraph, CrewAI, AutoGen, or similar.
  • Strong programming skills in Python is essential, with experience in relevant AI/ML frameworks (e.g., TensorFlow, PyTorch).
  • Experience with cloud platforms (AWS, Azure, GCP) and their AI/ML services (e.g., Amazon SageMaker, Azure Machine Learning, Google Cloud AI Platform, Vertex AI).
  • Familiarity with MLOps principles and tools for deploying, monitoring, and managing AI models and agentic systems in production (e.g., MLflow, Kubeflow).
  • Experience with vector databases (e.g., Pinecone, Weaviate, FAISS, Azure AI Search) and techniques for processing and ingesting unstructured data.
  • Excellent communication, interpersonal, and leadership skills, with the ability to influence and drive technical decisions.
  • Strong analytical and problem-solving abilities.
  • Willingness to work in the New York office 3 days per week.

Why Capco?  

A career at Capco is a chance to help reshape the competitive landscape in financial services. We launch new banks, transform existing ones, and help our clients navigate complex change. As consultants, we work on the front-end business design all the way through to technology implementation.   

We are the largest Financial Services focused consultancy in the world, serving everyone from global banks to emerging FinTechs, from strategy through digital transformation, design, business consulting, data and analytics, cyber, cloud, technology architecture, and engineering.   

Capco is a young and growing firm. We maintain an entrepreneurial spirit and growth mindset, and have minimal bureaucracy. We have no internal silos that get in the way of your career opportunities or ability to focus on our clients and make a difference to the business.   

We offer the opportunity for everyone to learn rapidly, take on tough challenges, and get promoted quickly. We take pride in our creative, collaborative, diverse, and inclusive culture, where everyone can #BYAW.  

We offer highly competitive benefits, including medical, dental, and vision insurance, a 401(k) plan, tuition reimbursement, and a work culture focused on innovation and creation of lasting value for our clients and employees. 

Ready to Take the Next Step?  

If this sounds like you, we would love to hear from you. This is an opportunity to make a difference and contribute to a highly successful company with a significant growth trajectory.  

LI-MB1

LI-HYBRID

US Pay Range

$152,000 - $174,000 USD

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Education

Select...
Select...
Select...
Select...
Select...
Select...

If you answered yes to the previous question, please provide additional details.

Select...

Capco Job Candidate Privacy Notice Acknowledgement 

I acknowledge that the information I provide will be processed and used for the purposes described in Capco’s Job Candidate Privacy Notice.

U.S. EQUAL OPPORTUNITY EMPLOYMENT INFORMATION

U.S. EQUAL OPPORTUNITY EMPLOYMENT INFORMATION (COMPLETION IS VOLUNTARY)

Individuals seeking employment at Capco are considered without regards to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation. You are being given the opportunity to provide the following information in order to help us comply with federal and state Equal Employment Opportunity/Affirmative Action record keeping, reporting, and other legal requirements.

Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

Form CC-305

OMB Control Number 1250-0005

Expires 04/30/2026

Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Capco’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.