Skip to content

mimecast: add message release logs data stream #10732

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Aug 9, 2024
Merged

Conversation

efd6
Copy link
Contributor

@efd6 efd6 commented Aug 8, 2024

Proposed commit message

See title.


Note that this is not tested against a real endpoint.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Screenshots

@efd6 efd6 added enhancement New feature or request Integration:mimecast Mimecast (Partner supported) Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations] labels Aug 8, 2024
@efd6 efd6 self-assigned this Aug 8, 2024
@elasticmachine
Copy link

elasticmachine commented Aug 8, 2024

🚀 Benchmarks report

Package mimecast 👍(5) 💚(3) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
dlp_logs 13888.89 7751.94 -6136.95 (-44.19%) 💔
siem_logs 4484.3 3773.58 -710.72 (-15.85%) 💔

To see the full report comment with /test benchmark fullreport

@efd6 efd6 marked this pull request as ready for review August 8, 2024 01:23
@efd6 efd6 requested a review from a team as a code owner August 8, 2024 01:23
@elasticmachine
Copy link

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

"risk_score": 12,
"type": [
"info"
]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could possibly add email.local_id and email.subject from id and subject fields respectively.

@@ -0,0 +1,159 @@
- name: mimecast
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does having all fields at package-level, i.e., mimecast instead of datastream-level mimecast.message_release_logs cause any datatype conflicts between datastreams?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The other data streams in the package place things at the mimecast root, so I was following that pattern. I can move this data stream to its own namespace and file an issue to move the others (this would be a breaking change). WDYT?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just checked. Interesting that there are no collisions so far, but also could be they have a good mapping and field naming conventions across different datasets. I am leaning towards leaving it be as is, I don't want to bring about breaking changes when nothing is broken yet.

show_user: false
default:
- forwarded
- mimecast-siem-logs
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- mimecast-siem-logs
- mimecast-message-release-logs

@efd6 efd6 requested a review from kcreddy August 9, 2024 04:48
Copy link
Contributor

@kcreddy kcreddy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link

@elasticmachine
Copy link

💚 Build Succeeded

History

cc @efd6

@efd6 efd6 merged commit 76c4c3f into elastic:main Aug 9, 2024
5 checks passed
@elasticmachine
Copy link

Package mimecast - 1.27.0 containing this change is available at https://epr.elastic.co/search?package=mimecast

ltflb-bgdi pushed a commit to geoadmin/infra-elastic-integrations that referenced this pull request Aug 22, 2024
ltflb-bgdi pushed a commit to geoadmin/infra-elastic-integrations that referenced this pull request Sep 6, 2024
anil-elastic pushed a commit that referenced this pull request Sep 10, 2024
* mimecast: add message release logs data stream (#10732)

* Fix AWS cloudfront log parsing

* Refactored cloudfront parser

* Updated aws cloudfront testlogs

* Updated aws cloudfront logs test config

* Moved cloudfront.content_type to http.response.mime_type

* Added field mapping for aws.cloudfront range fields.

* Fixed edge_detailed_result_type

* Updated cloudfront.md

* Implemented review recommendations

* Updated cloudfront_logs system test log file

* Fixed CI problems

* Update sample_event.json

* Update cloudfront.md

* formatted and build with newest elastic-package version

* Revert changes fixed by formatters

* Update sample_event.json

* Added review recommendations

* Beautified some pipeline conditionals

* Added additional cloudfront test case

* Fixed test-default-config hit count

---------

Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
harnish-crest-data pushed a commit to chavdaharnish/integrations that referenced this pull request Feb 4, 2025
harnish-crest-data pushed a commit to chavdaharnish/integrations that referenced this pull request Feb 4, 2025
* mimecast: add message release logs data stream (elastic#10732)

* Fix AWS cloudfront log parsing

* Refactored cloudfront parser

* Updated aws cloudfront testlogs

* Updated aws cloudfront logs test config

* Moved cloudfront.content_type to http.response.mime_type

* Added field mapping for aws.cloudfront range fields.

* Fixed edge_detailed_result_type

* Updated cloudfront.md

* Implemented review recommendations

* Updated cloudfront_logs system test log file

* Fixed CI problems

* Update sample_event.json

* Update cloudfront.md

* formatted and build with newest elastic-package version

* Revert changes fixed by formatters

* Update sample_event.json

* Added review recommendations

* Beautified some pipeline conditionals

* Added additional cloudfront test case

* Fixed test-default-config hit count

---------

Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
harnish-crest-data pushed a commit to chavdaharnish/integrations that referenced this pull request Feb 5, 2025
harnish-crest-data pushed a commit to chavdaharnish/integrations that referenced this pull request Feb 5, 2025
* mimecast: add message release logs data stream (elastic#10732)

* Fix AWS cloudfront log parsing

* Refactored cloudfront parser

* Updated aws cloudfront testlogs

* Updated aws cloudfront logs test config

* Moved cloudfront.content_type to http.response.mime_type

* Added field mapping for aws.cloudfront range fields.

* Fixed edge_detailed_result_type

* Updated cloudfront.md

* Implemented review recommendations

* Updated cloudfront_logs system test log file

* Fixed CI problems

* Update sample_event.json

* Update cloudfront.md

* formatted and build with newest elastic-package version

* Revert changes fixed by formatters

* Update sample_event.json

* Added review recommendations

* Beautified some pipeline conditionals

* Added additional cloudfront test case

* Fixed test-default-config hit count

---------

Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
@efd6 efd6 deleted the 9395-mimecast branch February 5, 2025 22:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Integration:mimecast Mimecast (Partner supported) Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations]
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[mimecast] add Message Release Logs to integration
3 participants