The Datavant Way to measure and cultivate performance
We’ve all seen the silly jargon: rockstar, ninja, superstar, 10x’er. They all mean one thing: a very strong performing software engineer. We want to work with them; we want to be them. But how do you know it when you see it? In this piece, I’ll walk through the framework we use to assess and cultivate performance on the engineering team at Datavant.
We Grow Leaders
“We grow leaders” is one of our core values — this includes both individual contributors who lead initiatives and managers who lead teams. Career growth is generally defined as an increase in impact, skillfulness, and independence carrying out larger and larger scopes.
We use a simple rubric with 3 categories:
Accelerates the team
- Recruitment
- Team-first orientation
- Feedback
Gets things done
- Autonomy
- Communication
- Bias for speed
Demonstrates excellence in engineering
- Testing, tools, and infrastructure skills
- Programming skills
Each quarter, every engineer at Datavant is scored as “Skillful,” “More Skillful,” or “Super Skillful,” across each of the 8 metrics.
A representative engineer might have this profile:
Why we do this
We do this to provide clear expectations, actionable feedback, and answer the question that fuels many growth-oriented people: “So, how do I progress?” Clear expectations on how to be a high performer also mitigate bias because expectations are known, communicated, and universally applied.
Skillful corresponds to our baseline expectations for an engineer; a good way to think about this is that a new grad engineer at Datavant should be at least Skillful in every category.
For experienced engineers, we believe in playing to our strengths, which means we embrace people who are “well-lopsided.” As an engineer grows, we expect them to become Super Skillful in at least 1 category. Engineers can progress either by going beyond Super Skillful in 1–2 metrics, or becoming More Skillful across multiple areas. Both types of engineers are valuable and celebrated at Datavant.
What it looks like in practice
Accelerate the Team — what a “force multiplier” looks like
Success at Datavant means more than simply producing a lot of output in isolation. It means making your teammates more effective, supporting them when they need help, holding them to the same high expectations you hold yourself, and questioning processes that slow the team down. There are 3 areas we focus on:
Recruitment
Recruiting is a core aspect of every engineer’s job. Datavant is always hiring for exceptional engineers, and the team is responsible for both assessing and selling candidates.
- Skillful: conduct interviews and refer candidates
- More Skillful: write interview questions, train interviewers, and write blog posts
- Super Skillful: shape our recruitment process, making successful changes to how we hire talent
Team-First Orientation
Everything our engineering team has accomplished has been built upon the bedrock of a strong team-oriented culture. We’re a team of collaborators.
- Skillful: approach conflict with an open mind (not defensively), operate with a “no job too big/no job too small” attitude, and collaborate effectively with other engineers.
- More Skillful: encourage and invite quieter teammates to share their opinions, create a space where everyone feels ownership and can contribute.
- Super Skillful: mentor other engineers, successfully helping them level up their skills.
Feedback
“Feedback is a gift” is one of our values at Datavant, but it’s not just something you get from your manager. Everyone is responsible for giving and receiving direct, actionable feedback.
- Skillful: give meaningful feedback when requested and receive feedback with grace
- More Skillful: proactively deliver and seek out feedback
- Super Skillful: improve the ways our team provides feedback.
Get Things Done — what results oriented looks like
Datavant is a hyper growth company, and our engineers create value by getting things done. We believe in hustle as a strategy. Datavant engineers deliver value when they write high quality production code and ship new features and products to customers. In measuring this, we focus on 3 areas:
Autonomy
Autonomy is a measure of how big and hairy a problem we can give an engineer and have them find a way to solve it. Asking questions is a key part of this — most autonomous engineers are exceptional at identifying exactly which questions they need to ask to solve a problem. We hire talented, smart engineers who we can trust to self manage, that means our expectation is that you will ask for help when you need it and not stay stuck.
- Skillful: estimate tasks and work independently for a day or so at a time
- More Skillful: self-manage and work independently for a week
- Super Skill: identify problems and work independently more or less indefinitely when necessary
Communication
This can be a blurry word; what it means to us is:
Do they push information to stakeholders proactively?
Do they ask questions and pull information from experts when required?
- Skillful: share information effectively with their smaller, immediate team and sometimes ask for help when needed, but sometimes end up stuck and waiting for help.
- More Skillful: proactively share information with their broader team, including negative news, risks, and delays, and always ask for help when needed.
- Super Skillful: proactively build an understanding of people’s needs from across the team and establish alignment across the entire company, ultimately increasing the effectiveness of the engineering team.
Bias for Speed
“Perfect is Good, Done is Better,” is a Datavant value, and it means we bias toward speed. The behaviors in this metric are all about prioritization and volume. There’s always more to be done than we can expect to do, so prioritizing the highest value work is essential, and the expectation is that more experienced and skillful engineers will get more total volume of work done.
- Skillful: seek input on prioritization and balance work within a single project
- More Skillful: balance work across multiple projects and build alignment on prioritization
- Super Skillful: help the engineering, product, and design teams (the “tech org”) prioritize better; find ways to deliver success, even in the face of changing circumstances
Excellence in engineering — what the fundamentals look like
Excellence in engineering is what most teams typically think of engineering skills. While all the skills on our rubric are important, and we firmly believe in playing to strengths and not having a single engineering profile, it’s impossible to advance as an individual contributor without establishing your excellence in engineering.
Testing, Tools, and Infrastructure Skills
Source code alone isn’t very valuable. Testing, tools, and infrastructure skills are all about everything else that’s required to have a successful code base.
- Skillful: write high quality tests and generally understand production infrastructure
- More Skillful: debug, modify, and build production infrastructure
- Super Skillful: proactively plan and implement improvements to our infrastructure that improve the quality of our services across teams
Programming Skills
Programming skills are the most fundamental engineering competency.
- Skillful: write clean, correct, modular code and ask for advice when needed
- More Skillful: independently break down multi-week problems into manageable PRs and design and deliver high quality code
- Super Skillful: independently break down multi-month projects into components; write engineering plans that stretch out beyond a year; lead and mentor other engineers to design and implement these components.
Summary
Measuring performance is highly specific to the organization’s mission, culture, and structure. There is no one size fits all rubric, and a good rubric will grow and adapt with the organization. What is important is that your team knows exactly what it means to exceed expectations. I believe people want to perform at their best. If you paint a clear picture of what it means to perform and provide direct, actionable feedback, your team will exceed expectations.
Join us
If you’re reading the above post and thinking, “I wish I had clear expectations like this,” or “getting feedback that way sounds incredible!” then join us! We’re connecting the world’s health data to improve patient outcomes, and we’re hiring!
.svg)
