Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

any alternative solution for cache servers with hybrid disks(hdd/ssd)? #11981

Open
wangchunpeng opened this issue Jan 23, 2025 · 4 comments
Labels

Comments

@wangchunpeng
Copy link

wangchunpeng commented Jan 23, 2025

We are planning to use ATS as the cache engine for our CDN, and given servers with 10 hdd and 2 ssd disks. We want to store high-frequency access resources or some small files on the SSDs. Older versions of ATS supported specific features for this, but those features have been removed in latest versions. I would like to ask the reasons for this removal and whether there are any alternative solutions in recent versions?

@masaori335
Copy link
Contributor

masaori335 commented Jan 23, 2025

You can define volumes on your SSD by storage.config and use the volumes to specific hostname or domain by hosting.config.

This is described in the "Partitioning the Cache" section.

Older versions of ATS supported specific features for this, but those features have been removed in latest versions.

What was this feature called? do you have a link to the doc describe this?

@wangchunpeng
Copy link
Author

wangchunpeng commented Jan 23, 2025

You can define volumes on your SSD by storage.config and use the volumes to specific hostname or domain by hosting.config.

This is described in the "Partitioning the Cache" section.

Older versions of ATS supported specific features for this, but those features have been removed in latest versions.

What was this feature called? do you have a link to the doc describe this?

the interim caching feature ,https://cwiki.apache.org/confluence/display/TS/SSDSupport

@masaori335
Copy link
Contributor

masaori335 commented Jan 27, 2025

I know nothing about interim caching, but the old ticket removed the feature describe reasons and suggests below.

  1. Assigning content to volumes and disks via our existing configs.
  2. Use Linux’s bcache feature, which comes with Linux 3.10 or later. I suspect e.g. ZFS has something similar.
  3. Use a third party system to implement the hybrid device (e.g. flash cache or EnhanceIO.

TS-3541 Eliminate interim cache

@masaori335
Copy link
Contributor

Do you using hierarchy caching in your CDN? In general CDN deployment, using SSD on child layer and using HDD on parent layer makes sense for balance of cost efficiency and cache space.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants