Back to jobs

Site Reliability Engineer - Vice President

Salt Lake City, Utah, United States

 

About the Role

 

iCapital is looking to hire a Site Reliability Engineer to join the Site Reliability Engineering team, which plays a critical role in ensuring the platform delivers consistent, reliable service to clients. The services run on Kubernetes in AWS, and this role is focused on maintaining the health, stability, and performance of production environments.

This position is ideal for a hands-on engineer who thrives in diagnosing complex production issues where the root cause is not immediately apparent. This role transforms insights gained from production incidents into stronger reliability standards, safer deployment practices, more effective alerting, and automation that helps prevent recurring issues. While metrics, logs, and traces are leveraged daily, the core focus is identifying, resolving, and learning from the issues they reveal.

 

 

Responsibilities

  • Act as a senior escalation point for complex production issues in Kubernetes-based services, leading hands-on investigation across application, container, Kubernetes, and AWS layers through to root cause.
  • Partner with the teams that own our cluster infrastructure to resolve platform-level issues, and feed what you learn back into reliability standards and improvements.
  • Define and implement reliability and operability standards for Kubernetes-based services, including resource sizing, health checks, scaling patterns, rollout safety, and baseline monitoring, as part of service onboarding.
  • Serve as the incident commander or senior technical lead for high-severity incidents, lead postmortems, and drive systemic improvements through action items and measurable follow-through.
  • Turn recurring investigations into runbooks, diagnostic tooling, and automated remediation that shorten time to resolution and eliminate toil.
  • Coach engineers in systematic troubleshooting and Kubernetes best practices through reviews, game days, and knowledge sharing.
  • Define, implement, and iterate service level objectives (SLOs) and service level indicators (SLIs) that reflect customer and business expectations.
  • Standardize monitoring and alerting through “monitors as code” (Terraform preferred), including quality gates such as severity, ownership, and runbook links.
  • Operate and tune OpenTelemetry pipelines, including sanitizing data, managing cardinality, and enriching telemetry with consistent fields.
  • Maintain the infrastructure behind our monitoring stack, including Helm charts, ArgoCD ApplicationSets, Kinesis streams, Lambda functions, and Prometheus.
  • Participate in on-call rotations with a focus on improving reliability, reducing alert noise, and increasing signal quality over time.

 

 

Qualifications

  • 5+ years in SRE or related roles, with evidence of technical seniority across multiple services and teams
  • 3+ years of hands-on experience running and troubleshooting production workloads on Kubernetes, with a deep understanding of how Kubernetes schedules, connects, scales, and rolls out workloads
  • Proven ability to independently diagnose complex failures in distributed systems running on Kubernetes, spanning application, configuration, resource, networking, and scaling issues, including cases where the root cause wasn't obvious
  • Strong Linux and networking fundamentals, with the ability to troubleshoot below the container layer
  • Strong production experience with AWS, including how cloud networking and access controls affect workloads running in Kubernetes
  • Strong incident response skills, including leading retrospectives and postmortems and following through on systemic fixes
  • Strong IaC skills (Terraform preferred), with examples of reusable modules, monitors-as-code patterns, or similar standardization work, and the coding ability to build automation and diagnostic tooling
  • Track record of defining SLOs/SLIs and using an observability stack (i.e. Prometheus and Grafana, New Relic, Splunk, or similar) to drive decisions and find root causes quickly
  • Clear written and verbal communication skills with the ability to influence engineering teams through standards, tooling, and practical guidance
  • Kubernetes certification (CKA or CKS) or equivalent depth
  • Experience improving rollout safety and autoscaling behavior for Kubernetes workloads
  • Familiar with common data stores (Postgres, MongoDB, DynamoDB) and how they fail in distributed systems
  • OpenTelemetry instrumentation experience at scale is preferred

 

 

 

Benefits

The base salary range for this role is $130,000 to $160,000 depending on level.  iCapital offers a compensation package which includes salary, equity for all full-time employees, and an annual performance bonus. Employees also receive a comprehensive benefits package that includes an employer matched retirement plan, generously subsidized healthcare with 100% employer paid dental, vision, telemedicine, and virtual mental health counseling, parental leave, and unlimited paid time off (PTO).

We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office Monday-Thursday, with the flexibility to work remotely on Friday.

For additional information on iCapital, please visit https://www.icapitalnetwork.com/about-us  Twitter: @icapitalnetwork | LinkedIn: https://www.linkedin.com/company/icapital-network-inc | Awards Disclaimer: https://www.icapitalnetwork.com/about-us/recognition/

iCapital is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, gender, sexual orientation, gender identity, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

Create a Job Alert

Interested in building your career at iCapital? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Education

Select...

This question is optional.

This question is optional.

Select...

This applies to full time roles only.

This applies to full time roles only.

Select...
iCapital is an office-first culture, as such all employees are required to work in the office Monday-Thursday, with the flexibility to work remotely on Friday, depending on the department. Please review the job description before applying, to identify the specified location/s for the role. *

This only applies to U.S. based roles.

Select...
Select...

This applies to full time roles only.

iCapital Voluntary Self-Identification Questions [U.S. Only]

Candidates are invited to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in iCapital Network ’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, and you voluntarily decide to complete this survey, please indicate by making the appropriate selection. We request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded.

Voluntary Self-Identification of Disability


Why are you being asked to complete this?

The law requires us to provide equal employment opportunity to qualified people with disabilities.  We request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake.

Completing this form is voluntary. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury

This survey should take about 5 minutes to complete.

Select...
Select...
Select...
Select...
Select...

iCapital uses AI-enabled technology to compare your application against our job requirements and to assist in our hiring process.

Learn more