Staff Software Engineer - AI

Overview

For the majority of 2024, ClosedLoop has been developing a new, not-yet-launched, consumer product aimed at helping people navigate their health, built on top of generative AI.

We are hiring an experienced Staff Software Engineer, AI to be a key owner of our AI and LLM initiatives in our new GenAI product line.

Our ideal candidate is someone who has:

• Enthusiasm for pushing the limits of how AI tech can benefit consumer healthcare. 
• Extensive experience in building and deploying software powered by AI / ML models, particularly with natural language processing (NLP) and large language models (LLMs).
• Proven ability to lead AI engineering initiatives from concept to production with a focus on quality, scalability, and performance.
• Strong collaboration skills and an interest in being part of a dynamic and supportive team

You bring a wealth of experience from previous jobs while partnering closely with the VP of Engineering, Chief Product Officer, and other senior leaders to set the product, technical direction, and roadmap for the company’s GenAI strategy. You will also be instrumental in mentoring and training the engineering team on best-in-class software and infrastructure practices. You’ll report to the Director of AI Engineering in this role.

Key elements of the role:

• Bring AI features from proof-of-concept all the way to production.
• Lead development of our frameworks for offline and real time AI quality evaluation.
• Contribute to AI thought leadership in the Engineering organization.
• Partner closely with Engineering and Product leadership on technical strategy and product roadmap.
• Bring and implement best-in-class software development practices across the product and engineering organizations including but not limited to: code review, CI/CD and test automation, system scalability and performance, Data Science quality controls and version management.
• Drive deliverables with ownership of identifying risks, mitigating them and providing suggestions for alternative routes when appropriate.
• Participate in code reviews and work as part of the team to make the whole group more efficient and productive.
• Stay up to date on the latest technologies and research which can add value to our product offering.
• Investigate potential errors and alerts in our platform and address outages in a timely manner to support SLA requirements.

Required Education and Experience:

• 8+ years in software development experience, most of which is in engineering or in an equivalent technical role.
• 1+ years experience building product capabilities rooted in LLMs and NLP techniques.
• 5+ years of experience building with Python-based machine learning frameworks such as scikit-learn, TensorFlow/PyTorch, Hugging Face, nltk etc.
• 2+ years of experience developing, testing, debugging and shipping Python-based software.
• Experience in bridging the gap between ML development practices and standard product development practices.
• Experience bringing algorithms developed by the Data Science team to production.
• Experience partnering with Product, Engineering, and leadership teams on product roadmapping.
• Experience in mentoring and building a sustainable engineering culture.

Bonus Qualifications:

• Prior experience with NLP techniques like topic modeling, entity extraction, bringing structure to LLM behavior.
• Prior experience in testing machine learning systems, particularly in evaluating and monitoring quality of natural language models, LLMs and chat systems.
• Prior experience in healthcare or in working with healthcare data.
• Prior experience building consumer chat applications.
• Prior experience with time series modeling and forecasting, and/or supervised ML
• AI research experience, machine learning or data science experience.
• Full-stack development experience.

About the Team:

Built and based in Austin, Texas, we are a small but mighty team of “Closers” who are passionate about changing the future of healthcare.  With numerous accolades in our trophy case, we have been repeatedly recognized by the Austin Business Journal as a “Best Places to Work” and Built In as a “Best Startups”  for our culture and employee-centric programming.  We believe in empowering our teams to do their work, offer generous employee benefits that include 100% paid medical insurance for employees and dependents, flexible PTO, paid parental leave, 401k, and ongoing learning and team building opportunities. 

We believe that diverse teams are stronger teams and understand that building for the future includes embracing and honoring different backgrounds and experiences.  Doing so creates the foundation for our ability to build systems that drive unbiased outcomes.

We strive to create a supportive team high in rigor, with a mindset of constant improvement.  We believe that teams high in trust innovate faster and better, collaborate more effectively, and love their work more.  

If this sounds like a place where you can see yourself building for a future that transforms healthcare, we’d love for you to join us!