[System] rework metric dashboards

[drewdaemon]

What does this PR do?

Reworks the metric system overview and host overview dashboards to use Lens.

Also leverages Lens features to represent current system state more reliably and clearly (especially, uses Lens Last value function instead of TSVB "Last value" mode to resolve #1437).

Checklist

• I have reviewed tips for building integrations and this pull request is aligned with them.
• I have verified that all data streams collect metrics or logs.
• I have added an entry to my package's changelog.yml file.
• I have verified that Kibana version constraints are current according to guidelines.

Author's Checklist

How to test this PR locally

Related issues

• Closes [System] Issue with short time frame (5min) #1437
• Relates Make system integration the gold standard for Kibana best practices #4868

Screenshots

Overview

Before

After

Host overview

Before

After

[elasticmachine]

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

• Start Time: 2023-10-09T13:32:22.350+0000

• Duration: 18 min 21 sec

Test stats 🧪

Test	Results
Failed	0
Passed	151
Skipped	0
Total	151

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

• /test : Re-trigger the build.

[P1llus]

/test

[botelastic]

Hi! We just realized that we haven't looked into this PR in a while. We're sorry! We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!

[drewdaemon]

Let's keep this open!

[botelastic]

Hi! We just realized that we haven't looked into this PR in a while. We're sorry! We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!

[drewdaemon]

Keep this open

[elasticmachine]

🌐 Coverage report

Name	Metrics % (covered/total)	Diff
Packages	100.0% (3/3)	💚
Files	100.0% (4/4)	💚
Classes	100.0% (4/4)	💚
Methods	63.415% (52/82)	👎 -36.585
Lines	99.863% (2924/2928)	👍 0.859
Conditionals	100.0% (0/0)	💚

[tommyers-elastic]

wonder if this warrants a bump to 2.0.0?

[drewdaemon]

Happy to change this (not sure what the criteria are for a major bump).

FWIW, I will be submitting a second PR to finish converting all the visualizations in the package to Lens. Does that change anything?

[tommyers-elastic]

this looks great, thanks! without reviewing the reams of JSON and just looking at the screenshots, this gets a +1 from me.

[fearful-symmetry]

Looks good, but the one thing that worries me is the Load metric. This is only available on non-Windows OSes, so Windows users just get a blank UI item. However, I'm not sure we have the capability to just say "remove the visualization if there's no data," hence why I'm approving this. If we can do that and no one told me, we definitely should.

[drewdaemon]

I'm not sure we have the capability to just say "remove the visualization if there's no data," hence why I'm approving this. If we can do that and no one told me, we definitely should.

We don't have that capability. It's an interesting feature request. I think our answer today is: create two dashboards. But, that doesn't always make sense (this case for example) so I'm going to raise this with the team to see if we are tracking an issue.

[muthu-mps]

LGTM!

[drewdaemon]

The screenshots I added here are quite large. Do we have any guidelines on screenshot size?

cc @efd6 @muthu-mps

[elasticmachine]

Package system - 1.42.0 containing this change is available at https://epr.elastic.co/search?package=system