
Senior AI Prompt Engineer
About Us
JustAnswer is the leading AI + Human professional services platform, on a mission to revolutionize how people access expert help. Since 2003, we’ve connected millions of customers across 196 countries with verified professionals in real time—anytime, anywhere. With a powerful combination of human expertise and cutting-edge AI, we’re transforming the future of professional services.
Rooted in boldness, humility, and innovation, we take a data-driven approach to solving complex problems and continuously improving through Lean principles.
About The Role
We're looking for a Senior AI Prompt Engineer who is equal parts strategist, scientist, and builder. You'll join a tight-knit, agile team focused on crafting, testing, and scaling LLM prompts that power high-impact user experiences. You'll use your expertise in Generative AI to process massive datasets, enhance our AI-powered expert platform, and unlock real business outcomes.
You'll drive how our AI understands customers, supports experts, and drives revenue. You'll partner with product, data, and engineering to take ideas from whiteboard to production, and you'll evangelize LLM best practices across the company.
What You'll Do
- Design, build, and scale advanced prompts for a variety of LLMs to enhance product experiences
- Create complex multi-part prompting systems with parameter optimization and implement advanced prompting techniques
- Develop comprehensive evaluation frameworks to measure performance across multiple dimensions, comparing techniques like RAG, fine-tuning, and advanced prompting methodologies
- Analyze and optimize LLM performance with A/B tests, usage metrics, and strategic feedback loops
- Develop AI-driven flows that improve user interaction and marketplace expert support
- Design and improve our expert playbooks
- Run experiments to validate ideas quickly and iterate based on performance and user insights
- Collaborate cross-functionally with product managers, engineers, and stakeholders to identify LLM opportunities across the company and translate technical capabilities into business value
- Manage stakeholder expectations and communicate complex technical concepts to both technical and non-technical audiences
- Implement LLMOps practices including model governance, lifecycle management, and performance monitoring to ensure production-ready AI systems
- Educate and enable internal teams to build better prompts and leverage AI tools effectively
What We're Looking For
- Master's or PhD in Computer Science, Computational Linguistics, Machine Learning, or a related field prefered
- Strong Python skills and a hands-on approach to building and testing complex prompting systems
- Deep understanding of LLMs and advanced frameworks including deep expertise across multiple LLM vendors and model versions
- Proven experience developing and using evaluation frameworks to test model outputs
- Production environment experience with RAG and fine-tuning models
- Demonstrated ability to automate large-scale API interactions and scripting for prompt testing rather than manual processes
- Experience with LLMOps practices including model governance, version control, performance monitoring, and lifecycle management
- Strong stakeholder management skills with ability to collaborate effectively across technical and business teams
- Proven track record of translating complex technical concepts into actionable business insights for diverse audiences
- Analytical mindset with experience in Excel, Power BI, or Google Analytics
- Solid grasp of NLP techniques
- Excellent judgment and the ability to prioritize and move projects forward independently while managing multiple stakeholder relationships
- Agile and sprint-based development experience; comfort with tools like Azure Boards or Asana
- Bonus: Team leadership or mentorship experience, and familiarity with open-source vs commercial LLMs
Why You'll Love Working With Us
Expert Network Advantage - Access a unique dataset of 25M+ real expert-client interactions and a network of 12,000+ licensed professionals—perfect for training and refining AI.
AI That Outperforms - Our AI is 22% more helpful than ChatGPT for professional services—proven via A/B testing with over 5,000 users. Helpful isn't a buzzword—it's our metric.
Over a Decade of Innovation - We've evolved from early NLP and ChatScript to today's LLMs and GenAI. Innovation is in our DNA—and we're just getting started.
Real Revenue, Real Impact - We're driving $50M+ in revenue with LLM-powered features and shipping updates in days—not quarters. This is AI at scale.
True Agile at Scale - We don't just talk agile—we live it. Expect rapid iteration, bold experiments, and constant delivery of impactful solutions.
Mission-Driven Culture - We're here to help people—one answer at a time. Our work directly improves lives, and our teams feel the purpose behind every feature.
Why Join Our Team
At JustAnswer, we blend the best of AI and human expertise to make a real impact. Our mission-driven culture values bold ideas, continuous learning, and global collaboration. We offer a flexible, remote-first environment with equitable rewards, career growth opportunities, and a supportive community where your contributions truly matter. Join us and be part of something bigger, helping people, one answer at a time.
Our JustAnswer Promise
We strive together to make the world a better place, one answer at a time. JustAnswer's mission is to help people. We do this by connecting our members with verified Experts to help answer life's questions and solve problems. It’s not every day in your life that you get to be a part of a simple yet powerful mission. We pride ourselves in doing things the JA Way.
• Data driven: Data decides, not egos
• Courageous: We take risks and challenge the status quo
• Innovative: We're constantly learning, creating, and adapting
• Lean: We focus on customers, using lean testing to learn how to serve them best
• Humble: Past success is not a guarantee of future success
If these things matter to you, come join the team here at JustAnswer!
Our Commitment to an Inclusive Workplace
We welcome people from all backgrounds who seek the opportunity to help build a future where professional services are readily available to all. If you have curiosity, passion, and a collaborative spirit, come work with us. JustAnswer is committed to an inclusive workplace. JustAnswer is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, disability, age, or other legally protected status.
AI Disclosure & Informed Consent
Artificial intelligence (AI) technology may be used during the hiring process to record, transcribe, analyze, and rank interview responses. By submitting your application and participating in the interview process, you acknowledge and consent to the use of AI technology in the hiring process. For more information see our AI Disclosure and Consent Policy.
#LI-Remote
Create a Job Alert
Interested in building your career at JustAnswer? Get future opportunities sent straight to your email.
Apply for this job
*
indicates a required field