-
Notifications
You must be signed in to change notification settings - Fork 474
mimecast: add message release logs data stream #10732
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
🚀 Benchmarks reportPackage
|
Data stream | Previous EPS | New EPS | Diff (%) | Result |
---|---|---|---|---|
dlp_logs |
13888.89 | 7751.94 | -6136.95 (-44.19%) | 💔 |
siem_logs |
4484.3 | 3773.58 | -710.72 (-15.85%) | 💔 |
To see the full report comment with /test benchmark fullreport
Pinging @elastic/security-service-integrations (Team:Security-Service Integrations) |
"risk_score": 12, | ||
"type": [ | ||
"info" | ||
] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could possibly add email.local_id and email.subject from id
and subject
fields respectively.
@@ -0,0 +1,159 @@ | |||
- name: mimecast |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does having all fields at package-level, i.e., mimecast
instead of datastream-level mimecast.message_release_logs
cause any datatype conflicts between datastreams?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The other data streams in the package place things at the mimecast root, so I was following that pattern. I can move this data stream to its own namespace and file an issue to move the others (this would be a breaking change). WDYT?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I just checked. Interesting that there are no collisions so far, but also could be they have a good mapping and field naming conventions across different datasets. I am leaning towards leaving it be as is, I don't want to bring about breaking changes when nothing is broken yet.
show_user: false | ||
default: | ||
- forwarded | ||
- mimecast-siem-logs |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- mimecast-siem-logs | |
- mimecast-message-release-logs |
...ast/data_stream/message_release_logs/_dev/test/pipeline/test-release-logs.json-expected.json
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
|
💚 Build Succeeded
History
cc @efd6 |
Package mimecast - 1.27.0 containing this change is available at https://epr.elastic.co/search?package=mimecast |
* mimecast: add message release logs data stream (#10732) * Fix AWS cloudfront log parsing * Refactored cloudfront parser * Updated aws cloudfront testlogs * Updated aws cloudfront logs test config * Moved cloudfront.content_type to http.response.mime_type * Added field mapping for aws.cloudfront range fields. * Fixed edge_detailed_result_type * Updated cloudfront.md * Implemented review recommendations * Updated cloudfront_logs system test log file * Fixed CI problems * Update sample_event.json * Update cloudfront.md * formatted and build with newest elastic-package version * Revert changes fixed by formatters * Update sample_event.json * Added review recommendations * Beautified some pipeline conditionals * Added additional cloudfront test case * Fixed test-default-config hit count --------- Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
* mimecast: add message release logs data stream (elastic#10732) * Fix AWS cloudfront log parsing * Refactored cloudfront parser * Updated aws cloudfront testlogs * Updated aws cloudfront logs test config * Moved cloudfront.content_type to http.response.mime_type * Added field mapping for aws.cloudfront range fields. * Fixed edge_detailed_result_type * Updated cloudfront.md * Implemented review recommendations * Updated cloudfront_logs system test log file * Fixed CI problems * Update sample_event.json * Update cloudfront.md * formatted and build with newest elastic-package version * Revert changes fixed by formatters * Update sample_event.json * Added review recommendations * Beautified some pipeline conditionals * Added additional cloudfront test case * Fixed test-default-config hit count --------- Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
* mimecast: add message release logs data stream (elastic#10732) * Fix AWS cloudfront log parsing * Refactored cloudfront parser * Updated aws cloudfront testlogs * Updated aws cloudfront logs test config * Moved cloudfront.content_type to http.response.mime_type * Added field mapping for aws.cloudfront range fields. * Fixed edge_detailed_result_type * Updated cloudfront.md * Implemented review recommendations * Updated cloudfront_logs system test log file * Fixed CI problems * Update sample_event.json * Update cloudfront.md * formatted and build with newest elastic-package version * Revert changes fixed by formatters * Update sample_event.json * Added review recommendations * Beautified some pipeline conditionals * Added additional cloudfront test case * Fixed test-default-config hit count --------- Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
Proposed commit message
See title.
Note that this is not tested against a real endpoint.
Checklist
changelog.yml
file.Author's Checklist
How to test this PR locally
Related issues
Screenshots