New

Adversarial AI Engineer

San Francisco, CA

Want to help us help others? We’re hiring! 

GoFundMe is the world’s most powerful community for good, dedicated to helping people help each other. By uniting individuals and nonprofits in one place, GoFundMe makes it easy and safe for people to ask for help and support causes—for themselves and each other. Together, our community has raised more than $40 billion since 2010. Join us! 

Every day, millions turn to us in their most vulnerable moments, and our technology must be safe, resilient, and trustworthy. We’re looking for an Adversarial AI Engineer who combines offensive security expertise with machine learning depth. You will execute red team testing against our AI systems, build automated adversarial evaluation pipelines, and deploy defense mechanisms to keep our AI safe. Beyond technical execution, you’ll influence governance, partner with cross-functional stakeholders, and establish GoFundMe as a thought leader in AI security.

This role is foundational. You’ll lead red team operations and strengthen our AI/ML systems that power fraud detection, content moderation, and Trust & Safety at scale. You will also design adversarial testing frameworks, deploy real-time defenses, and set governance for secure AI deployment across GoFundMe’s platform—protecting billions in charitable giving from evolving attack vectors.

Candidates considered for this role will be located in the San Francisco, Bay Area. There will be an in-office requirement of 3x a week.

The Job

  • Adversarial Testing & Red Teaming
    • Execute adversarial testing of LLMs, Agentic AI systems, recommendation models, and fraud detection tools using techniques such as prompt injection, jailbreaking, data poisoning, model inversion, and membership inference attacks.
    • Develop synthetic attack datasets tailored to fundraising and trust & safety scenarios.
  •  Build Security Frameworks & Defenses
    • Develop automated adversarial testing pipelines integrated into CI/CD, create reusable robustness evaluation libraries, and generate synthetic attack datasets for fundraising scenarios.
    • Build reusable robustness evaluation libraries.
    • Deploy real-time detection for prompt injection and model evasion, implement input validation, output filtering, adversarial training, and differential privacy mechanisms.
  • Cross-Functional Security Leadership
    • Partner with Trust & Safety on fraud countermeasures.
    • Collaborate with Product Security on AI threat models and governance.
    • Work with Data Science to mitigate algorithmic bias and ensure robust defense.
  • Governance & Policy
    • Establish AI security policies, training, and deployment review processes aligned with NIST AI RMF.
    • Build monitoring and incident response systems for AI security.
  • Research & Innovation
    • Stay current with emerging attack vectors and defense mechanisms.
    • Contribute to open-source adversarial tools.
    • Publish and speak externally to advance GoFundMe’s leadership in AI security.

You 

  • 6–8 years in cybersecurity with a focus on AI/ML security or adversarial ML.
  • 2+ years specialized LLM security experience (prompt injection, jailbreaking, adversarial prompt crafting).
  • Proven red team / penetration testing background on AI systems.
  • Strong Python programming with ML frameworks (TensorFlow, PyTorch, Hugging Face).
  • Deep understanding of ML fundamentals, Neural Networks, transformers (GPT, LLaMA, Claude, BERT) and known vulnerabilities.
  • Experience testing Agentic AI security testing including agent frameworks (LangGraph, AutoGen, CrewAI, Google ADK, Pydantic AI).
  • Skilled in adversarial attack methods: data poisoning, model evasion, membership inference, model extraction.
  • Knowledge of defense mechanisms: adversarial training, input sanitization, differential privacy, robustness certification.
  • Hands-on adversarial attack experience: data poisoning, model evasion, membership inference, model extraction.
  • Familiarity with OWASP Top 10 for LLMs, MITRE ATLAS, NIST AI RMF.
  • Experience with threat modeling, security architecture, and cloud controls (AWS, GCP, Azure).

Preferred

  • Multimodal AI security experience (vision-language, audio).
  • Background in financial services, fintech, or sensitive transaction platforms.
  • AI compliance, audit, and regulatory experience.
  • Published AI security research or open-source contributions.
  • Trust & Safety or fraud detection systems experience.
  • Privacy-preserving ML techniques (federated learning, homomorphic encryption).

 

Why you’ll love it here

  • Make an Impact: Be part of a mission-driven organization making a positive difference in millions of lives every year.
  • Innovative Environment: Work with a diverse, passionate, and talented team in a fast-paced, forward-thinking atmosphere.
  • Collaborative Team: Join a fun and collaborative team that works hard and celebrates success together.
  • Competitive Benefits: Enjoy competitive pay and comprehensive healthcare benefits.
  • Holistic Support: Enjoy financial assistance for things like hybrid work, family planning, along with generous parental leave, flexible time-off policies, and mental health and wellness resources to support your overall well-being.
  • Growth Opportunities: Participate in learning, development, and recognition programs to help you thrive and grow.
  • Commitment to DEI: Contribute to diversity, equity, and inclusion through ongoing initiatives and employee resource groups.
  • Community Engagement: Make a difference through our volunteering and Gives Back programs.

We live by our core values: impatient to be great, find a way, earn trust every day, fueled by purpose. Be a part of something bigger with us!

GoFundMe is proud to be an equal opportunity employer that actively pursues candidates of diverse backgrounds and experiences.  We do not discriminate on the basis of race, color, religion, ethnicity, nationality or national origin, sex, sexual orientation, gender, gender identity or expression, pregnancy status, marital status, age, medical condition, mental or physical disability, or military or veteran status.

The total annual salary for this full-time position is $181,000 - $271,000 + equity + benefits.  As this is a hybrid position, the salary range was determined by role, level, and possible location across the US. Individual pay is determined by work location and additional factors including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range based on your location during the hiring process. 

If you require a reasonable accommodation to complete a job application or a job interview or to otherwise participate in the hiring process, please contact us at accommodationrequests@gofundme.com. 

Global Data Privacy Notice for Job Candidates and Applicants:

Depending on your location, the General Data Protection Regulation (GDPR) or certain US privacy laws may regulate the way we manage the data of job applicants. Our full notice outlining how data will be processed as part of the application procedure for applicable locations is available here. By submitting your application, you are agreeing to our use and processing of your data as required. 

Learn more about GoFundMe:

We’re proud to partner with GoFundMe.org, an independent public charity, to extend the reach and impact of our generous community, while helping drive critical social change. You can learn more about GoFundMe.org’s activities and impact in their FY ‘24 annual report.

Our annual “Year in Help” report reflects our community’s impact in advancing our mission of helping people help each other.

For recent company news and announcements, visit our Newsroom.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...

A little more about you

GoFundMe is where we help people help each other. Help comes in many different shapes and sizes, and so we aim to hire a team who reflects the diverse backgrounds, experiences, lifestyles and values of the people who come to the platform every day. 

You’ll see two sections below. The first section is a list of voluntary self-identification options so you can share what makes you, you! We want to understand the big picture of our employees’ identities, expressions, and abilities. The second section looks similar with slightly fewer specifics, and that one is for our company’s government reporting. Both of these sections are optional, and kept confidential. Your responses or your choice to opt-out have no influence on the hiring process for this role.

Select...
Select...
Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in GoFundMe’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.