-
Notifications
You must be signed in to change notification settings - Fork 474
[Cloud Security] increase transfom retention_policy to 90 days for Wiz #11393
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Cloud Security] increase transfom retention_policy to 90 days for Wiz #11393
Conversation
🚀 Benchmarks reportTo see the full report comment with |
💚 Build Succeeded
|
|
…party data loading (#195636) ## Summary Increase retention on Cloud Security queries to accommodate a longer retention period on third-party CDR integrations, such as Wiz and AWS SecurityHub. This introduces regression for #142198 This is meant is a temporary workaround until we find a robust way to get full posture for third-party CDR integrations This change goes together with increasing retention period on Wiz: - elastic/integrations#11393 fixes: - elastic/security-team#10683 ## How to test The CI deployed a serverless project where I installed Wiz and CSP integrations and ingested some data.
…party data loading (elastic#195636) ## Summary Increase retention on Cloud Security queries to accommodate a longer retention period on third-party CDR integrations, such as Wiz and AWS SecurityHub. This introduces regression for elastic#142198 This is meant is a temporary workaround until we find a robust way to get full posture for third-party CDR integrations This change goes together with increasing retention period on Wiz: - elastic/integrations#11393 fixes: - elastic/security-team#10683 ## How to test The CI deployed a serverless project where I installed Wiz and CSP integrations and ingested some data. (cherry picked from commit e18c52e)
Pinging @elastic/security-service-integrations (Team:Security-Service Integrations) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The change looks good.
If the full set of useful data can include old records for which there aren't periodic updates, consider entirely removing this kind of expiry based on ingest time.
@chrisberkhout we still need the retention, it's more of temporary workaround of the issue described in this work item |
Package wiz - 1.9.0-preview05 containing this change is available at https://epr.elastic.co/search?package=wiz |
Package wiz - 2.0.0 containing this change is available at https://epr.elastic.co/search?package=wiz |
elastic#11393) * increase transfom retention_policy to 90 days for Wiz * update changelog
elastic#11393) * increase transfom retention_policy to 90 days for Wiz * update changelog
Proposed commit message
Increase retention policy to 90 days on Wiz transforms to cater for how Wiz evaluates environments for posture. In contrast to native CSP integration Wiz doesn't do regular full re-evaluation of customer environments, that's why short retention period mean customers having only a small slice of their posture. The change will go together with documentation on how to get more complete view for the posture using longer initial interval setting value
Checklist
changelog.yml
file.Author's Checklist
How to test this PR locally
Build and install integration, ingest some data from Wiz, check that latest index contains documents without 90d period
Related issues
Screenshots