Scorecards | Custom levels | Voters

Scorecards | Custom levels

complete

Andrew C

Creating custom tiers for scorecards, without the limitation of the only existing 3 , and adding a custom color / icon to each one

Created by Matar Peles

September 13, 2023

David - Port team

marked this post as

complete

You can now define custom levels as part of the scorecard's configuration - including names and colors.
See the docs here - https://docs.getport.io/promote-scorecards/#levels
We would love to hear your feedback! :)

Gur Shafriri

marked this post as

in progress

Gur Shafriri

Update on this feature: We plan to enable creating custom tiers directly in a specific scorecard configuration, instead of globally. This will allow for multiple "tier groups" and global definitions will be added later on in the future.

Gur Shafriri

Amir Gal Or Our current plan is to configure the default set of scorecard levels: adding/deleting levels or changing their titles and colors. 
These can then be referenced from the scorecard configuration. 
We also consider the ability to manage multiple level-sets, but that might be in a later iteration.

Amir Gal Or

Hi, we are also interested in this Feature.
I'll elaborate our use-case.
We're creating a "Traffic Light" per running service to indicate various degradation status for running services, as such the terminology of bronze/silver/gold does not fit us, as well, we might need another tier - so the custom levels are still in ideation, but red/orange/yellow/green seems like a good place to start
As per the second question, we don't want a unified scale for all scorecards (perhaps at a later point a way to unify a few that work on the same metric system) - the reason being, some scorecards are indicators of maturity code/ownership/etc wise, while others are status indicators for production degradation - various/different org personas look at these scorecards so there's no point in unify them.

David - Port team

marked this post as

planned

We will start working on this feature in the near future! ✨

We would love to hear any feedback about this feature. For example

What types of custom levels you would like to create?
Would you like to create one unified scale for all scorecards, or a few different scales?

Thanks a lot

Amir Gal Or

David - Port team to answer your first question i can give a few examples
We've just implemented a "traffic light" model with 3 or 4 levels, the model is implemented in DataDog, per module per API point and is reflected in Port to show an over-whole of the current system status, to enable different personas (even those without DD understanding) to see what's going on, to measure the system impact, etc - this translates eventually into scorecard of module and entire system.
so - first - for this - we need more "levels", second - we want to customize the "label" of each, so it'll be closed to the "language" our teams speak in.
a second example - can be "healthiness" scorecard of module - where healthiness is our own measurement of healthcheck + module current "load" - here the important part is the labeling
as per your second question, i don't think a unified system would benefit here.

Gur Shafriri

Amir Gal Or thanks for the elaborated response!

Following this and other feedback we got, we will start with enabling any set of levels in the scorecard configuration, without any global settings for now.