Back to jobs
New

Software Architect, AI Applications

Tel Aviv

Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and workflows into a single, trusted system that observes, guides, and acts alongside the world’s most successful revenue teams. Powered by the Gong Revenue Graph, AI-powered intelligence, specialized agents, and trusted applications, Gong helps more than 5,000 companies around the world deeply understand their teams and customers, automate critical sales workflows, and close more deals with less effort. For more information, visit www.gong.io.

At Gong, you will join a company built on innovative products, ambitious goals, and passionate people. We are shaping the future of revenue intelligence and we want people who are excited to build what comes next. You will work with a team that dreams big, moves fast, and cares deeply about the craft and about each other. Here, transparency and trust are core to how we operate, and every person has the opportunity to make a visible impact. If you want to grow, stretch, and do work that truly matters, Gong is the place to do the best work of your career.

Software Architect, AI Applications

As an Architect in Gong's AI Applications group, you will lead the architecture and technical direction of the Revenue Harness, the agentic framework that powers an AI teammate for every revenue professional. The assistant understands a user's deals, customers, and pipeline. It can reason, plan, and act on the user's behalf, grounded in the richest revenue data in the world.

This is a hands-on role with broad influence. You will embed with teams where needed, guide design decisions, and help build scalable, extensible agentic systems on state-of-the-art AI technology.

What You'll Build

  • Agentic Core: Agent orchestration, planning and reasoning loops, multi-step execution, and multi-agent coordination for long-running revenue workflows.
  • Tools & Integrations: A secure, extensible tool ecosystem, including MCP-based tools and connectors, that lets agents read from and act on Gong data, CRMs, email, and calendars.
  • Context & Memory: Retrieval pipelines over calls, emails, deals, and accounts, using RAG, hybrid search, and knowledge graphs, plus short- and long-term memory.
  • Quality & Trust: Offline and online evaluation of accuracy, groundedness, and task success, along with guardrails, permissions, and human-in-the-loop controls.
  • Model Platform: Multi-provider model routing, streaming, LLM observability, and cost and latency management.
  • Runtime & Execution: High-concurrency infrastructure for stateful and stateless agents, including lifecycle management, isolated workers, task queues, and distributed state persistence.
  • Deployment & CI/CD: Cloud-native Kubernetes deployments with multi-region rollout, zero-downtime updates, canary releases for non-deterministic workflows, and strict tenant sandboxing.

You'll Own

  • Revenue Harness Architecture: Serve as the group's central technical leader. Define the reference architecture and the contracts between agents, tools, context, and models, so that teams build on a shared, scalable foundation.
  • Hands-On Engineering: Embed in teams across domains and contribute directly to design and code.
  • Quality & Reliability Standards: Set the group's eval methodology, regression gates, and production monitoring for non-deterministic systems.
  • Mentorship & Engineering Standards: Raise the bar on design quality and best practices across the group.
  • AI-Assisted Development: Drive adoption of coding agents, AI code review, and agentic workflows to improve velocity and quality.

You'll Solve

  • Reliability on Non-Deterministic Foundations: Make LLM behavior trustworthy through structured outputs, tool-call validation, fallbacks, and well-defined failure modes.
  • Context at Enterprise Scale: Get the right information into the context window efficiently when the data spans millions of conversations, deals, and accounts.
  • Secure, Permission-Aware Agents: Enforce data boundaries, user permissions, and tenant isolation, and defend against prompt injection and unintended actions.
  • Quality, Cost & Latency Trade-offs: Balance them through model selection, caching, and routing.
  • Ambiguity & Divergence Across Teams: Bring clarity to loosely defined cross-team problems, surface blind spots, and steer teams toward aligned, reusable patterns.
  • Speed vs. Long-Term Evolution: Catch architectural gaps early and make pragmatic trade-offs, so that systems keep pace with rapidly changing models and tooling.

You'll Impact

  • The Future of Revenue Work: Help sales professionals shift their time from busywork to selling.
  • A Higher Engineering Bar: Build stronger, more autonomous teams through better design practices and mentorship.
  • Consistent, Fast Delivery: Reduce duplication and accelerate execution without compromising long-term platform health.

How You'll Succeed

Requirements

  • 10+ years of backend development, with strong expertise in Java and modern frameworks such as Spring Boot.
  • Proven Staff or Principal-level impact across multiple teams, with the ability to lead through influence rather than authority.
  • Hands-on experience shipping production LLM applications, such as agents, tool calling, RAG, or structured generation, and an understanding of their failure modes.
  • Deep expertise in designing large-scale distributed systems, including asynchronous, event-driven, and streaming architectures.
  • Versatility in diving into unfamiliar codebases, switching context across teams, and spotting high-impact opportunities.
  • A passion for mentoring, and the ability to communicate complex ideas clearly to diverse stakeholders.
  • Genuine curiosity about the AI landscape, and a track record of driving adoption of AI-assisted development.

Nice to Have

  • Experience with agent frameworks and protocols (e.g., MCP, Spring AI, LangChain/LangGraph) or with building an in-house equivalent.
  • Experience with LLM evaluation (LLM-as-judge, golden datasets, online monitoring), observability, and multi-provider routing.
  • Experience with vector databases, search infrastructure (e.g., Elasticsearch/OpenSearch), or knowledge graphs.
  • Familiarity with AI security concerns, including prompt injection, data leakage, and agent permission models.
  • Working knowledge of Python alongside a JVM stack.
  • Background in B2B SaaS, CRM, or revenue technology.

We operate in a flexible hybrid work model.

What makes Engineering at Gong unique?

Here at Gong, we trust and empower our employees with ownership to solve complex problems, make the right decisions, and build the best products that create radical impact. We call this "Own. Solve. Impact." For our engineers, it means it's not just about writing code. You are involved and able to influence the entire process to create the best product.

If you are curious to discover Gong's wonderful and challenging world, what are you waiting for? Don't delay—fill in your application details. Who knows, maybe there's a Gongster in you!

About us

We encourage our employees to express their personality and identity (whether gender, ethnic, religious, or sexual), and we ensure fairness and equal opportunities. We follow a hybrid working model that combines working from home, on the go, or at the office. This allows us flexibility, autonomy, positive work relationships, and effective work habits.

If these considerations are important to you when choosing a workplace, we'd love to see you with us. To review Gong's privacy policy, visit www.gong.io/privacy-policy/ for more details.


#LI-MK3

Apply for this job

*

indicates a required field

Phone
Resume/CV

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf


Select...

Gong will collect and use your personal data (e.g. - name, email, resume info) to evaluate your application for employment. Gong will save your personal data for up to 2 years in order to consider you for other, future potential job opportunities. We are happy to delete your data upon request. 

For a list of personal data categories, how Gong uses your personal data, and rights you have to your personal data, please visit Gong’s Job Candidates Privacy Notice, available at https://www.gong.io/gong-io-job-candidates-privacy-notice/

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Gong.io’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...