Skip to content

Conversation

@dhtclk
Copy link
Collaborator

@dhtclk dhtclk commented Nov 25, 2025

Summary

ClickStack - EC2 host logs guide

Checklist

@vercel
Copy link

vercel bot commented Nov 25, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
clickhouse-docs Ready Ready Preview Comment Nov 25, 2025 9:41pm
3 Skipped Deployments
Project Deployment Preview Comments Updated (UTC)
clickhouse-docs-jp Ignored Ignored Nov 25, 2025 9:41pm
clickhouse-docs-ru Ignored Ignored Preview Nov 25, 2025 9:41pm
clickhouse-docs-zh Ignored Ignored Preview Nov 25, 2025 9:41pm

@dhtclk dhtclk marked this pull request as ready for review November 25, 2025 18:09
@dhtclk dhtclk requested a review from a team as a code owner November 25, 2025 18:09
Copy link
Member

@Blargian Blargian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM


**Replace the following in the configuration:**
- `YOUR_CLICKSTACK_HOST`: The hostname or IP address where ClickStack is running
- For local testing, you can use an SSH tunnel (see Troubleshooting section)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- For local testing, you can use an SSH tunnel (see Troubleshooting section)
- For local testing, you can use an SSH tunnel (see the [Troubleshooting section](#troubleshooting))

This configuration:
- Reads system log files from standard locations (`/var/log/syslog` for Ubuntu, `/var/log/messages` for Amazon Linux/RHEL)
- Parses syslog format to extract structured fields (timestamp, hostname, unit/service, PID, message)
- **Automatically detects and adds EC2 metadata** using the resourcedetection processor
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Automatically detects and adds EC2 metadata** using the resourcedetection processor
- **Automatically detects and adds EC2 metadata** using the `resourcedetection` processor

For consistency below

Once the collector is running, log into HyperDX and verify logs are flowing with EC2 metadata:

1. Navigate to the search view
2. Set source to Logs
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
2. Set source to Logs
2. Set source to `Logs`


Once the collector is running:

1. Open [HyperDX](http://localhost:8080/) and log in to your account (you may need to create an account first)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's link to where you can create an account

Once the collector is running:

1. Open [HyperDX](http://localhost:8080/) and log in to your account (you may need to create an account first)
2. Navigate to the Search view and set the source to `Logs`
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
2. Navigate to the Search view and set the source to `Logs`
2. Navigate to the search view and set the source to `Logs`

<Image img={search_view_demo} alt="EC2 logs search view"/>
<Image img={log_view_demo} alt="EC2 log detail with metadata"/>

:::note[Timezone Display]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
:::note[Timezone Display]
:::note[Timezone display]

Comment on lines +565 to +567
- Filter by EC2 metadata attributes (region, instance type, instance ID) to monitor specific resources
- Correlate EC2 host logs with application logs for comprehensive troubleshooting
- Create custom dashboards for security monitoring (SSH attempts, sudo usage, firewall blocks)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we have links for these it will make a nice addition

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants