-
Notifications
You must be signed in to change notification settings - Fork 472
[aws] Ingest managed insights from Security Hub #14354
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[aws] Ingest managed insights from Security Hub #14354
Conversation
Pinging @elastic/security-service-integrations (Team:Security-Service Integrations) |
🚀 Benchmarks reportPackage
|
Data stream | Previous EPS | New EPS | Diff (%) | Result |
---|---|---|---|---|
guardduty |
1061.57 | 887.31 | -174.26 (-16.42%) | 💔 |
inspector |
2012.07 | 1492.54 | -519.53 (-25.82%) | 💔 |
To see the full report comment with /test benchmark fullreport
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In commit message, s/retieved/retrieved/.
# This transform's job is to fail and end pagination when finished. | ||
# It will set a value if the last request was the first in the sequence | ||
# (which collects the managed insights), or if there is another page of | ||
# custom insights to fetch. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There's enough HTTPJSON magic here that I think the comment needs to explain more about how it is actually working.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I added a sentence. Here's the full new comment:
# This transform's job is to fail and end pagination when finished.
# It will set a value if the last request was the first in the sequence
# (which collects the managed insights), or if there is another page of
# custom insights to fetch. Otherwise, there will be a value template
# error (.last_response.body.NextToken doesn't exist) and the pagination
# sequence will end (because fail_on_template_error is set).
ea0efa3
to
0444f3e
Compare
|
💚 Build Succeeded
History
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks
Package aws - 3.9.0 containing this change is available at https://epr.elastic.co/package/aws/3.9.0/ |
The AWS Security Hub API's GetInsights endpoint[1] returns only custom insights. Managed insights[2] are built-in, and can only be retrieved by ARN. Fetch a hard-coded list of managed insights first, then fetch pages of custom insights as before. This has been tested against the live API. [1]: https://docs.aws.amazon.com/securityhub/1.0/APIReference/API_GetInsights.html [2]: https://docs.aws.amazon.com/securityhub/latest/userguide/securityhub-managed-insights.html
Proposed commit message
Checklist
changelog.yml
file.Related issues