Add VertexAI Auditlogs Dashboard

[ishleenk17]

In this PR we are doing the below:

1. Create new dashboard for Auditlogs
2. Link the metrics and logs dashboard to each other
3. Add geo field support in the pipeline as we use that for the dashboard

Proposed commit message

See title

Checklist

• I have reviewed tips for building integrations and this pull request is aligned with them.
• I have verified that all data streams collect metrics or logs.
• I have added an entry to my package's changelog.yml file.
• I have verified that Kibana version constraints are current according to guidelines.
• I have verified that any added dashboard complies with Kibana's Dashboard good practices

Related issues

• Closes https://github.com/elastic/obs-integration-team/issues/294

Screenshots

[ishleenk17]

/test

[elastic-vault-github-plugin-prod]

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

[muthu-mps]

• Dashboard linking requires updated image in the overview chart as well.
• Title case is applied to Audit logs, whereas the existing overview dashboard uses a different formatting style. Can we align the formatting here to match the style used in the overview dashboard?
• Do we need to show the Audit event email address in the visualization? My suggestion is include email in the table view is useful. WDYT?
• We can think of removing Audit in the title name as well. e.x. [Logs GCP VertexAI] Event Action instead of Audit Event Action.

[daniela-elastic]

1. I like the map of locations. Some users might want to see a list of locations for reasons such as easier to copy-paste, easier to grasp when there is a large number of locations (enterprise customer). Could we also add a list of the same locations next to the map?
2. The second pie widget has two email addresses (privacy issues). Could we scrub those (maybe replace them with fake ones or just blur them). Perhaps no need to re-generate the dashboard, just do it manually

[ishleenk17]

@daniela-elastic I have added the region names from which audit logs have been received. Does this look better ?

[daniela-elastic]

Left a few comments, please address before merge

[ishleenk17]

• Dashboard linking requires updated image in the overview chart as well.

Yes, I'll be doing that once all the comments are addressed

• Title case is applied to Audit logs, whereas the existing overview dashboard uses a different formatting style. Can we align the formatting here to match the style used in the overview dashboard?

Can you point me to which title case you are talking about ?

• Do we need to show the Audit event email address in the visualization? My suggestion is include email in the table view is useful. WDYT?

Pie chart gives an idea which email was used the most. Also, its inline with the GCP auditlogs.

• We can think of removing Audit in the title name as well. e.x. [Logs GCP VertexAI] Event Action instead of Audit Event Action.

Addressed

[ishleenk17]

Screenshot updated after addressing latest comments

[muthu-mps]

• Title case is applied to Audit logs, whereas the existing overview dashboard uses a different formatting style. Can we align the formatting here to match the style used in the overview dashboard?

Can you point me to which title case you are talking about ?

I am adding an example panel title from both the dashboards. This applies for all the panels in the dashboard.

Overview dashboard	Audit logs dashboard
Token usage - by model deployment	Audit Event Email

[ishleenk17]

• Title case is applied to Audit logs, whereas the existing overview dashboard uses a different formatting style. Can we align the formatting here to match the style used in the overview dashboard?

Can you point me to which title case you are talking about ?

I am adding an example panel title from both the dashboards. This applies for all the panels in the dashboard.

Overview dashboard Audit logs dashboard
Token usage - by model deployment Audit Event Email

Addressed

[muthu-mps]

Left comment on tags, change looks good to me otherwise.
Please update the dashboard images after updating the links. The audit log dashboard also needs the current dashboard link to be included which doesn't exist now.

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
98.2% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: b400193

History

• 💚 Build #27109 succeeded 511d866
• 💚 Build #27101 succeeded 5f3868d
• 💚 Build #27080 succeeded 3fcf74f
• 💚 Build #27053 succeeded 11088fb
• 💚 Build #27041 succeeded 07eb42f

cc @ishleenk17

[elastic-vault-github-plugin-prod]

Package gcp_vertexai - 1.3.0 containing this change is available at https://epr.elastic.co/package/gcp_vertexai/1.3.0/

[muthu-mps]

Screenshot updated after addressing latest comments

@ishleenk17 - Have the screenshots updated with dashboard links? They seem to be missing.

[ishleenk17]

Screenshot updated after addressing latest comments

@ishleenk17 - Have the screenshots updated with dashboard links? They seem to be missing.

https://github.com/elastic/integrations/pull/14184/files#diff-7887b792c58136f11ea0a7072d391460897a6a96b7b35ba12640f805b2ee6083, yes the link is there in auditlogs. Check this image.

The older metrics overview dashboard will need update for the link.

[muthu-mps]

Screenshot updated after addressing latest comments

@ishleenk17 - Have the screenshots updated with dashboard links? They seem to be missing.

https://github.com/elastic/integrations/pull/14184/files#diff-7887b792c58136f11ea0a7072d391460897a6a96b7b35ba12640f805b2ee6083, yes the link is there in auditlogs. Check this image.

The older metrics overview dashboard will need update for the link.

We might need to update both dashboards. The updated dashboard would display links to the previous dashboard as well as the currently selected one, with the link for the selected dashboard highlighted.