Back to jobs
New

Senior Software Engineer - Machine Learning

Atlanta, Georgia, USA; Austin, Texas, USA; Portland, Oregon, USA

Your opportunity

At New Relic, we empower our customers with real-time insights to accelerate innovation. Our observability tools provide deep visibility into various technologies and distributed systems, enabling software engineering teams to proactively address issues, optimize performance, and enhance their infrastructure.

Join our Cloud Platform team to develop state-of-the-art cloud platforms and services that securely process over 2 billion telemetry events per minute across multi-cloud environments. We are seeking a Senior Software Engineer specializing in AI/ML to contribute to our expansion into AI and ML technologies, with a focus on Generative AI. This role involves implementing innovative Generative AI solutions that generate dynamic content, support automated decision-making, enhance anomaly detection, and deliver predictive analytics, transforming how businesses interact with data. You will collaborate with team leads to address complex technical challenges and participate in cross-team initiatives.

This position offers an excellent opportunity to advance your career, enhance your technical skills, and deepen your expertise in Generative AI and cloud technologies. The ideal candidate will have experience in AI infrastructure, particularly in Generative AI applications, and a demonstrated ability to solve challenging technical problems in today's digital landscape.

 


What you'll do

  • Implement Generative AI Solutions: Develop and implement generative AI capabilities within the Cloud Platform team, focusing on content creation, decision-making processes, and predictive analytics
  • Execute on Team Objectives: Work toward clear team objectives with a focus on project outcomes, system architecture optimization, and developer productivity
  • Analyze Data and Improve Systems: Conduct rigorous data analysis to deliver substantial improvements and refine strategic approaches
  • Develop AI Integration Components: Build components of a comprehensive generative AI SDK, integrating Large Language Models like OpenAI and Google AI with programming languages such as Python, Java, and Go
  • Build Scalable AI Systems: Design and implement highly scalable, resilient AI solutions capable of handling significant volume and maintaining performance at scale
  • Collaborate Across Teams: Work effectively across multiple teams to ensure technical initiatives meet high standards and integration requirements
  • Build AI Prototypes: Develop AI Proof of Concepts and contribute to Minimum Viable Products (MVPs) supporting multiple business domains
  • Support Technical Excellence: Participate in code reviews, technical discussions, and knowledge sharing to maintain high engineering standards

 

This role requires

  • 4+ years of professional work experience in software development and/or operations
  • Proficient coding skills in Python, Java, or Go with experience using AI-focused libraries such as TensorFlow, PyTorch, Hugging Face Transformers, or similar frameworks
  • Experience with cloud platforms that support deploying and scaling AI models and RAG knowledge bases
  • Strong background in designing and implementing scalable, distributed systems that can handle high throughput and maintain reliability
  • Experience with containerization (Docker), orchestration (Kubernetes), and microservices architecture
  • Knowledge of database optimization, caching strategies, and data storage solutions for large-scale applications
  • Skills in working with large datasets and implementing data processing pipelines for AI model training and fine-tuning
  • Practical experience applying generative techniques in applications such as content creation, data augmentation, or anomaly detection
  • Experience with enterprise AI services including OpenAI, AWS Bedrock, or equivalent platforms, with knowledge of NLP, Search, and AI Infrastructure
  • Solid understanding of generative models, including Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and Large Language Models (LLMs)
  • Ability to understand how AI initiatives align with business goals and outcomes

 

Bonus points if you have

  • Experience with recommender systems or ranking models that enhance user experiences
  • Familiarity with AI accelerator architectures
  • Background in platforms and tools such as Azure Semantic Kernel, Google's Vertex AI, or other machine learning technologies
  • Experience with stream processing frameworks (Kafka, Kinesis) for real-time data processing
  • Experience with auto-scaling systems and infrastructure-as-code practices
  • Knowledge of observability tools and performance monitoring for large-scale AI systems
  • Experience with LLM customization or fine-tuning techniques
  • Previous work with MLOps practices and tools
  • Contributed to open-source AI frameworks or projects


Please note that visa sponsorship is not available for this position.

#LI-JM2 #LI-Remote

The pay range below represents a reasonable estimate of the salary for the listed position. This role is eligible for a corporate bonus plan. Pay within this range varies by work location and may also depend on job-related factors such as an applicant’s skills, qualifications, and experience.

New Relic provides a variety of benefits for this role, including healthcare, dental, vision, parental leave and planning, and mental health benefits, a 401(k) plan and match, flex time-off, 11 paid holidays, volunteer time-off, a discounted employee stock purchase plan, and other competitive benefits designed to improve the lives of our employees.

Estimated Base Pay Range

$157,000 - $212,000 USD

Fostering a diverse, welcoming and inclusive environment is important to us. We work hard to make everyone feel comfortable bringing their best, most authentic selves to work every day. We celebrate our talented Relics’ different backgrounds and abilities, and recognize the different paths they took to reach us – including nontraditional ones. Their experiences and perspectives inspire us to make our products and company the best they can be. We’re looking for people who feel connected to our mission and values, not just candidates who check off all the boxes. 

If you require a reasonable accommodation to complete any part of the application or recruiting process, please reach out to resume@newrelic.com.

We believe in empowering all Relics to achieve professional and business success through a flexible workforce model. This model allows us to work in a variety of workplaces that best support our success, including fully office-based, fully remote, or hybrid.

Our hiring process

In compliance with applicable law, all persons hired will be required to verify identity and eligibility to work and to complete employment eligibility verification. Note: Our stewardship of the data of thousands of customers’ means that a criminal background check is required to join New Relic.

We will consider qualified applicants with arrest and conviction records based on individual circumstances and in accordance with applicable law including, but not limited to, the San Francisco Fair Chance Ordinance.

Headhunters and recruitment agencies may not submit resumes/CVs through this website or directly to managers. New Relic does not accept unsolicited headhunter and agency resumes, and will not pay fees to any third-party agency or company that does not have a signed agreement with New Relic.

Candidates are evaluated based on qualifications, regardless of race, religion, ethnicity, national origin, sex, sexual orientation, gender expression or identity, age, disability, neurodiversity, veteran or marital status, political viewpoint, or other legally protected characteristics. 

Review our Applicant Privacy Notice at https://newrelic.com/termsandconditions/applicant-privacy-policy

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...
Select...

If you do not live in the United States or Australia, please select "N/A"

Select...
Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in New Relic’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.