Skip to content

Introduce Logging Stack: Add fluentd, add loki #1058

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 33 commits into
base: main
Choose a base branch
from

Conversation

mrnicegyu11
Copy link
Member

@mrnicegyu11 mrnicegyu11 commented May 21, 2025

What do these changes do?

This unblocks grafana alerting

Related issue/s

Related PR/s

Checklist

  • I tested and it works
  • Service has resource limits and reservations
  • Service has placement constraints or is global
  • Service is restartable
  • Service restart is zero-downtime
  • Service is monitored (via prometheus and grafana)
  • Service is not bound to one specific node (e.g. via files or volumes)
  • Relevant OPS E2E Test are added
  • Service's Public URL is included in maintenance mode
  • Service's Public URL is included in testing mode

mrnicegyu11 and others added 27 commits October 15, 2024 16:18
Merge remote-tracking branch 'upstream/main'
…oundation#979)

* Introduce longhorn chart

* Further longhorn configuration

* Longhorn: further settings configuration

* Fix longhorn configuration bugs

Extra: introduce longhorn pv vales for portainer

* Add comment for deletion longhorn

* Further longhorn configuration

* Add README.md for Longhorn wit FAQ

* Update Longhorn readme

* Update readme

* Futher LH configuration

* Update LH's Readme

* Update Longhorn Readme

* Improve LH's Readme

* LH: Reduce reserved default disk space to 5%

Since we use a dedicated disk for LH, we can go ahead with 5%

* Use values to set Longhorn storage class

* Update LH's Readme

* LH Readme: add requirements reference

* PR Review: bring back portainer s3 pv

* LH: decrease portinaer volume size
@mrnicegyu11 mrnicegyu11 self-assigned this Jul 7, 2025
@mrnicegyu11 mrnicegyu11 added observability alerting/monitoring EPIC labels Jul 7, 2025
@mrnicegyu11 mrnicegyu11 added this to the Engage milestone Jul 7, 2025
@mrnicegyu11 mrnicegyu11 changed the title 2025/add/fluentd Introduce Logging Stack: Add fluentd, add loki Jul 24, 2025
@mrnicegyu11 mrnicegyu11 requested a review from sanderegg July 24, 2025 13:02
retention_enabled: false

limits_config:
retention_period: 48h # Must be ≥24h and multiple of index period (24h)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: This should be configurable via env-vars

address: 0.0.0.0
ring:
kvstore:
store: inmemory
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: I guess this could/should go to S3

Comment on lines +13 to +14
dns: # Add this always for AWS, otherwise we get "No such image: " for docker services
8.8.8.8
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is not necessary when the docker swarm base network is setup as I believe we do now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
EPIC observability alerting/monitoring
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants