Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fail Permanently to fetch a community on another server with "server error" page #5520

Open
4 tasks done
glamoroussky opened this issue Mar 16, 2025 · 15 comments
Open
4 tasks done

Fail Permanently to fetch a community on another server with "server error" page #5520

glamoroussky opened this issue Mar 16, 2025 · 15 comments
Labels
area: federation support federation via activitypub bug Something isn't working

Comments

@glamoroussky
Copy link

glamoroussky commented Mar 16, 2025 •
edited
Loading

Requirements

  • This is a bug report, and if not, please post to https://lemmy.ml/c/lemmy_support instead.
  • Please check to see if this issue already exists.
  • It's a single bug. Do not report multiple bugs in one issue.
  • It's a frontend issue, not a backend issue; Otherwise please create an issue on the backend repo instead.

Summary

I try to fetch the "Diablo" community on Lemmy.world one day, and it was so slow fetching the community when I was directed back to my server, so I clicked on refresh on browser, then I got a plain "server error" page.

I tried to restart server, use another account to do the same, and wait several days to repeat again, all back to that "server error" page permanently.

I can successfully fetch and subscribe to other communes on the same remote server.

Steps to Reproduce

  1. open https://lemmy.world/c/diablo
  2. click subscribe
  3. input https://sub.community to fetch
  4. got the error page

Technical Details

New logs right after I try to fetch Diablo community on https://lemmy.world server:

lemmy-ui-1 | TypeError: Cannot read properties of undefined (reading 'community')
lemmy-ui-1 | at t.get (/app/dist/js/server.js:2:3078424)
lemmy-ui-1 | at a.render (/app/dist/js/server.js:2:3077612)
lemmy-ui-1 | at P (/app/node_modules/.pnpm/[email protected]/node_modules/inferno-server/dist/index.cjs.min.js:1:2338)
lemmy-ui-1 | at P (/app/node_modules/.pnpm/[email protected]/node_modules/inferno-server/dist/index.cjs.min.js:1:2444)
lemmy-ui-1 | at P (/app/node_modules/.pnpm/[email protected]/node_modules/inferno-server/dist/index.cjs.min.js:1:3216)
lemmy-ui-1 | at P (/app/node_modules/.pnpm/[email protected]/node_modules/inferno-server/dist/index.cjs.min.js:1:2444)
lemmy-ui-1 | at P (/app/node_modules/.pnpm/[email protected]/node_modules/inferno-server/dist/index.cjs.min.js:1:2544)
lemmy-ui-1 | at P (/app/node_modules/.pnpm/[email protected]/node_modules/inferno-server/dist/index.cjs.min.js:1:2444)
lemmy-ui-1 | at P (/app/node_modules/.pnpm/[email protected]/node_modules/inferno-server/dist/index.cjs.min.js:1:2444)
lemmy-ui-1 | at P (/app/node_modules/.pnpm/[email protected]/node_modules/inferno-server/dist/index.cjs.min.js:1:3216)
proxy-1 | 101.119.179.213 - - [16/Mar/2025:01:54:51 +0000] "GET /activitypub/externalInteraction?uri=https%3A%2F%2Flemmy.world%2Fc%2Fdiablo HTTP/1.1" 500 12 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:136.0) Gecko/20100101 Firefox/136.0"
proxy-1 | 101.119.179.213 - - [16/Mar/2025:01:54:52 +0000] "GET /favicon.ico HTTP/1.1" 404 95361 "https://sub.community/activitypub/externalInteraction?uri=https%3A%2F%2Flemmy.world%2Fc%2Fdiablo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:136.0) Gecko/20100101 Firefox/136.0"
proxy-1 | 101.119.179.213 - - [16/Mar/2025:01:54:53 +0000] "GET /service-worker.js HTTP/1.1" 200 40613 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:136.0) Gecko/20100101 Firefox/136.0"
proxy-1 | 103.91.85.107 - - [16/Mar/2025:01:55:01 +0000] "GET /remote/login?lang=en HTTP/1.1" 404 80979 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36"
proxy-1 | 2a02:8071:78d0:b540:6818:52b:da6b:b7b - - [16/Mar/2025:01:56:20 +0000] "GET / HTTP/1.1" 200 377031 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:137.0) Gecko/20100101 Firefox/137.0"
proxy-1 | 2a02:8071:78d0:b540:6818:52b:da6b:b7b - - [16/Mar/2025:01:56:20 +0000] "GET /css/code-themes/atom-one-light.css HTTP/1.1" 200 856 "https://sub.community/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:137.0) Gecko/20100101 Firefox/137.0"
proxy-1 | 2a02:8071:78d0:b540:6818:52b:da6b:b7b - - [16/Mar/2025:01:56:20 +0000] "GET /css/themes/litely.css HTTP/1.1" 200 271346 "https://sub.community/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:137.0) Gecko/20100101 Firefox/137.0"
proxy-1 | 2a02:8071:78d0:b540:6818:52b:da6b:b7b - - [16/Mar/2025:01:56:20 +0000] "GET /static/c15a0eb1/assets/symbols.svg HTTP/1.1" 200 71295 "https://sub.community/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:137.0) Gecko/20100101 Firefox/137.0"
proxy-1 | 2a02:8071:78d0:b540:6818:52b:da6b:b7b - - [16/Mar/2025:01:56:20 +0000] "GET /static/c15a0eb1/js/client.js HTTP/1.1" 200 1845621 "https://sub.community/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:137.0) Gecko/20100101 Firefox/137.0"
proxy-1 | 2a02:8071:78d0:b540:6818:52b:da6b:b7b - - [16/Mar/2025:01:56:22 +0000] "GET /pictrs/image/0c9d5e3c-d624-4443-a462-c1b8f6b72c56.jpeg?format=webp&thumbnail=256 HTTP/1.1" 200 6595 "https://sub.community/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:137.0) Gecko/20100101 Firefox/137.0"
proxy-1 | 88.152.213.159 - - [16/Mar/2025:01:56:22 +0000] "GET / HTTP/1.1" 200 377031 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:137.0) Gecko/20100101 Firefox/137.0"
proxy-1 | 2a02:8071:78d0:b540:6818:52b:da6b:b7b - - [16/Mar/2025:01:56:25 +0000] "GET /service-worker.js HTTP/1.1" 200 40613 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:137.0) Gecko/20100101 Firefox/137.0"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:56:34 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:56:34 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:57:04 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:57:05 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:57:05 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:57:05 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 2a00:1098:84:1c8::157 - - [16/Mar/2025:01:57:19 +0000] "GET / HTTP/1.1" 200 377031 "-" "Synapse (bot; +https://github.com/matrix-org/synapse)"
proxy-1 | 2a00:1098:84:1c8::157 - - [16/Mar/2025:01:57:19 +0000] "GET /pictrs/image/feb3eef4-48d6-49d5-b4db-ba22fee033cb.png HTTP/1.1" 200 51380 "-" "Synapse (bot; +https://github.com/matrix-org/synapse)"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:57:35 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:57:35 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:06 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:06 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:06 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:06 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:07 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:07 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 46.4.254.144 - - [16/Mar/2025:01:58:15 +0000] "GET /activitypub/externalInteraction?uri=https%3A%2F%2Flemmy.world%2Fc%2Fdiablo HTTP/1.1" 302 127 "-" "Synapse (bot; +https://github.com/matrix-org/synapse)"
proxy-1 | 46.4.254.144 - - [16/Mar/2025:01:58:15 +0000] "GET /login?prev=%2Factivitypub%2FexternalInteraction%3Furi%3Dhttps%253A%252F%252Flemmy.world%252Fc%252Fdiablo HTTP/1.1" 200 84062 "-" "Synapse (bot; +https://github.com/matrix-org/synapse)"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:38 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:38 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:01:58:39 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 2a03:2880:13ff:4:: - - [16/Mar/2025:01:59:05 +0000] "GET /robots.txt HTTP/1.1" 200 300 "-" "facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)"
proxy-1 | 2a03:2880:f803:e:: - - [16/Mar/2025:01:59:06 +0000] "GET /post/346 HTTP/1.1" 200 109613 "-" "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:00:10 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:01:10 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:01:41 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:02:11 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:02:11 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 185.242.226.157 - - [16/Mar/2025:02:03:11 +0000] "GET /pictrs/image/feb3eef4-48d6-49d5-b4db-ba22fee033cb.png HTTP/1.1" 200 51374 "-" "Python/3.7 aiohttp/3.8.1"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:03:44 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 2a02:c204:2249:892::1 - - [16/Mar/2025:02:04:19 +0000] "GET /post/647/5 HTTP/1.1" 200 118346 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0 Safari/537.36"
proxy-1 | 144.91.100.51 - - [16/Mar/2025:02:04:21 +0000] "GET /post/647/4 HTTP/1.1" 200 123309 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0 Safari/537.36"
proxy-1 | 2a03:2880:f803:19:: - - [16/Mar/2025:02:05:21 +0000] "GET /post/346?scrollToComments=true HTTP/1.1" 200 109613 "-" "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)"
lemmy-1 | 2025-03-16T02:05:42.575510Z WARN lemmy_server::root_span_builder: InboxTimeout: InboxTimeout
proxy-1 | 88.99.12.217 - - [16/Mar/2025:02:05:42 +0000] "POST /inbox HTTP/1.1" 400 56 "-" "Mastodon/4.4.0-nightly.2025-03-14-security (http.rb/5.2.0; +https://mastodon.social/)"
lemmy-1 | 0: lemmy_server::root_span_builder::HTTP request
lemmy-1 | with http.method=POST http.scheme="http" http.host=sub.community http.target=/inbox otel.kind="server" request_id=d6876bcb-bd43-4655-b46a-e8a27d7f2633
lemmy-1 | at src/root_span_builder.rs:16
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:05:44 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:06:15 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:06:15 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:06:15 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:06:16 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:06:46 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:06:46 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 2a03:2880:f803:19:: - - [16/Mar/2025:02:08:42 +0000] "GET /c/[email protected] HTTP/1.1" 200 367563 "-" "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:08:47 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 159.203.88.72 - - [16/Mar/2025:02:09:11 +0000] "GET /.env HTTP/1.1" 404 80966 "-" "Mozilla/5.0 Keydrop"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:09:18 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:09:18 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 135.181.143.221 - - [16/Mar/2025:02:10:18 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3-4-gc98049af6; +https://lemmy.world"
proxy-1 | 24.49.171.247 - - [16/Mar/2025:02:10:26 +0000] "GET /pictrs/image/ce884da5-e43d-4ddc-8faf-f259ebe1ad46.png?thumbnail=66&format=webp HTTP/1.1" 200 558 "-" "Sync"
proxy-1 | 24.49.171.247 - - [16/Mar/2025:02:10:26 +0000] "GET /pictrs/image/ce884da5-e43d-4ddc-8faf-f259ebe1ad46.png?thumbnail=66&format=webp HTTP/1.1" 200 558 "-" "Sync"
lemmy-1 | 2025-03-16T02:11:02.506979Z WARN lemmy_server::root_span_builder: InboxTimeout: InboxTimeout
lemmy-1 | 0: lemmy_server::root_span_builder::HTTP request
lemmy-1 | with http.method=POST http.scheme="http" http.host=sub.community http.target=/inbox otel.kind="server" request_id=53379835-6eea-45c4-a201-75ba738529e5
lemmy-1 | at src/root_span_builder.rs:16

Lemmy Instance Version

0.19.9

Lemmy Instance URL

https://sub.community
@glamoroussky glamoroussky added the bug Something isn't working label Mar 16, 2025
@dessalines
Copy link
Member

https://sub.community/

That's an instance. You can't subscribe to an instance, only communities. You have a lemmy.world account and are trying to sub to one of its communities? Or you have a sub.community account and are trying to sub to https://lemmy.world/c/diablo ?

If its the latter, you need to enter https://lemmy.world/c/diablo into the search bar of a logged-in account on sub.community.

@glamoroussky
Copy link
Author

It's the first step to federated with https://lemmy.world/c/diablo
The community is not searchable on https://sub.community/ server.
When I "remote subscribe" the aforementioned Diablo community, it display a plain "Server error" page (https://sub.community/activitypub/externalInteraction?uri=https%3A%2F%2Flemmy.world%2Fc%2Fdiablo)

All other communities on the https://lemmy.world/ can be "remote subscribe" successfully on https://sub.community/

@dessalines dessalines transferred this issue from LemmyNet/lemmy-ui Mar 18, 2025
@Nutomic Nutomic added the area: federation support federation via activitypub label Mar 18, 2025
@Nutomic
Copy link
Member

Nutomic commented Mar 18, 2025

The logs dont show anything relevant. Try it like this:

  • Filter logs: docker compose logs --tail=100 -f lemmy | grep diablo -C 10
  • Then paste the community url (https://lemmy.world/c/diablo) into Lemmys search field

@glamoroussky
Copy link
Author

glamoroussky commented Mar 19, 2025 •
edited by Nutomic
Loading

I got this by using your instructions:
I just pick one paragraph, it seems like repeat the same thing for several times

lemmy-1  |              at crates/apub/src/api/resolve_object.rs:18
lemmy-1  |    9: lemmy_server::root_span_builder::HTTP request
lemmy-1  |            with http.method=GET http.scheme="http" http.host=sub.community http.target=/api/v3/resolve_object otel.kind="server" request_id=c8ae3bcf-fdd3-4b8c-9ef4-c7a0c09330e6
lemmy-1  |              at src/root_span_builder.rs:16
lemmy-1  | 2025-03-19T11:53:45.529170Z  WARN lemmy_api_common::request: Failed to generate thumbnail: Unknown: Request error: error sending request for url (http://pictrs:8080/image/download?url=https%3A%2F%2Fcdn.mos.cms.futurecdn.net%2FCSqJEghs3Pv8WRSKGtFc39-1200-80.jpeg&resize=512): operation timed out
lemmy-1  |    0: lemmy_api_common::request::generate_pictrs_thumbnail
lemmy-1  |              at crates/api_common/src/request.rs:413
lemmy-1  |    1: lemmy_apub::objects::post::from_json
lemmy-1  |              at crates/apub/src/objects/post.rs:182
lemmy-1  |    2: lemmy_apub::activities::create_or_update::post::receive
--
lemmy-1  |              at crates/apub/src/collections/community_outbox.rs:88
lemmy-1  |    4: lemmy_apub::objects::community::from_json
lemmy-1  |              at crates/apub/src/objects/community.rs:141
lemmy-1  |    5: lemmy_apub::fetcher::user_or_community::from_json
lemmy-1  |              at crates/apub/src/fetcher/user_or_community.rs:87
lemmy-1  |    6: lemmy_apub::fetcher::search::from_json
lemmy-1  |              at crates/apub/src/fetcher/search.rs:150
lemmy-1  |    7: lemmy_apub::fetcher::search::search_query_to_object_id
lemmy-1  |              at crates/apub/src/fetcher/search.rs:20
lemmy-1  |    8: lemmy_apub::api::resolve_object::resolve_object
lemmy-1  |            with data=Query(ResolveObject { q: "https://lemmy.world/c/diablo" }) local_user_view=Some(LocalUserView { local_user: LocalUser { id: LocalUserId(1), person_id: PersonId(2), password_encrypted: Sensitive, email: Some(Sensitive), show_nsfw: true, theme: "browser", default_sort_type: Hot, default_listing_type: All, interface_language: "en", show_avatars: true, send_notifications_to_email: true, show_scores: true, show_bot_accounts: true, show_read_posts: true, email_verified: false, accepted_application: true, totp_2fa_secret: Some(Sensitive), open_links_in_new_tab: true, blur_nsfw: true, auto_expand: true, infinite_scroll_enabled: false, admin: true, post_listing_mode: List, totp_2fa_enabled: true, enable_keyboard_navigation: false, enable_animated_images: true, collapse_bot_comments: false }, local_user_vote_display_mode: LocalUserVoteDisplayMode { local_user_id: LocalUserId(1), score: true, upvotes: true, downvotes: true, upvote_percentage: false }, person: Person { id: PersonId(2), name: "SUB", display_name: Some("SUB"), avatar: Some(DbUrl(Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("sub.community")), port: None, path: "/pictrs/image/09485721-05bf-4d0f-9f91-9d28f7cc5ddd.png", query: None, fragment: None })), banned: false, published: 2025-01-03T12:24:26.041124Z, updated: None, actor_id: DbUrl(Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("sub.community")), port: None, path: "/u/SUB", query: None, fragment: None }), bio: Some("All enquires to `email: [email protected]`"), local: true, private_key: Some(Sensitive), public_key: "-----BEGIN PUBLIC KEY-----\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwxuBKm1tiY3n5/D+XkG/\nuRke6To1Qr6y+xcRExol8ngbkmejdQ2Av8hxG1u0MiSrqGaFU4w+YwFRM+gw1ZUC\naPfAcB+IkP/cwTiLm0Bf3/iy7KF2RDzO4wn9nCQYoJZBA/Hhzmq5iQxXDJ/YO8KI\nuiceSZGwd9F4wNXNG7WKS1WhjL3mRO44acY6L021doaPuV92Y4VGVIjpwcUzd6BQ\n6kSRODDz4ZDdMK1bG4tWuMU9q7WIH+ujUXOilRYeFc3h/41sMNpMPcZE52qtP6+T\nepL2+/UpEhA01F1U+blM5XNlE0erksmXT3zYyBr+tco5vYigTUYireKNIM10J138\nhQIDAQAB\n-----END PUBLIC KEY-----\n", last_refreshed_at: 2025-01-03T12:24:26.041124Z, banner: Some(DbUrl(Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("sub.community")), port: None, path: "/pictrs/image/e4369c00-c547-4fd6-a601-374f3a56af87.png", query: None, fragment: None })), deleted: false, inbox_url: DbUrl(Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("sub.community")), port: None, path: "/u/SUB/inbox", query: None, fragment: None }), shared_inbox_url: Some(DbUrl(Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("sub.community")), port: None, path: "/inbox", query: None, fragment: None })), matrix_user_id: None, bot_account: false, ban_expires: None, instance_id: InstanceId(1) }, counts: PersonAggregates { person_id: PersonId(2), post_count: 1, post_score: 1, comment_count: 0, comment_score: 0 } })
lemmy-1  |              at crates/apub/src/api/resolve_object.rs:18
lemmy-1  |    9: lemmy_server::root_span_builder::HTTP request
lemmy-1  |            with http.method=GET http.scheme="http" http.host=sub.community http.target=/api/v3/resolve_object otel.kind="server" request_id=c8ae3bcf-fdd3-4b8c-9ef4-c7a0c09330e6
lemmy-1  |              at src/root_span_builder.rs:16

@Nutomic
Copy link
Member

Nutomic commented Mar 20, 2025 •
edited
Loading

That log is not enough, it doesnt show the actual error message. Try with grep diablo -C 100 and post the full output (you can paste it into gist).

@glamoroussky
Copy link
Author

glamoroussky commented Mar 21, 2025 •
edited
Loading

Here it is:
https://gist.github.com/glamoroussky/5ccc3be26a6eefd026a4f5a14ee28ce8

Btw, can I upgrade to the new version that just Hase been released, or I need to wait until this bug is fixed?

@Nutomic
Copy link
Member

Nutomic commented Mar 21, 2025

Hmm it logs a lot of errors for "Failed to generate thumbnail", but those should be ignored and not prevent it from fetching the community. Anyway you can try if image mode proxy solves the problem.

Upgrading to the new version is fine.

@glamoroussky
Copy link
Author

https://gist.github.com/glamoroussky/0b9e23e67245c6d96f1dd14538af558d

This is the logs after I used that image mode proxy.

I still cannot remote fetch https://lemmy.world/c/diablo/, I still got the "server error" text page by this method.
But this time I can search it on my server, and subscribe it on that.

@Nutomic
Copy link
Member

Nutomic commented Mar 24, 2025

The logs still dont show any error that would be related to fetching the community, it seems that Lemmy doesnt log that information properly. You can try setting env var RUST_LOG=activitypub_federation=debug,warn to get more logs.

Anyway it looks like your server has some general network problems, as it fails to fetch various images which are loading just fine for me. There are also multiple InboxTimeout which happens if your server takes too long to process incoming federation activities. This can happen if your database is too slow for some reason. These things could also be related to the fact that your instance is in Australia, so latency to lemmy.world is high. You may contact the admins of aussie.zone as they have some optimizations in place. I also suggest asking in https://matrix.to/#/#lemmy-support-general:discuss.online where you can get answers faster.

@glamoroussky
Copy link
Author

@Nutomic server is in U.S.A. but I used Cloudflare R2 Storage for S3 storage, the bucket is in Oceania. Actually, I talked to them there in matrix room first and told me this is possible a bug...

@Nutomic
Copy link
Member

Nutomic commented Mar 24, 2025

So you are probably getting a timeout somewhere because things are taking longer than expected. Try moving all parts of your server infrastructure nearby so that latency is as low as possible.

@glamoroussky
Copy link
Author

Thank you, I just found out the default Postgresql config file still says it's version 15, while the container now is at version 16.
Does this affect the performance?
Cheers.

@Nutomic
Copy link
Member

Nutomic commented Mar 27, 2025

No both versions should be fine.

@akohlsmith
Copy link

I have the same issue with a few different communities on a few different servers (and have no issues with other communities on the same servers). Running 0.19.10 in Docker.

@Nutomic
Copy link
Member

Nutomic commented Apr 8, 2025

This could also be caused by #5441 which will be fixed in 0.19.11 (to be released later today).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area: federation support federation via activitypub bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@akohlsmith @dessalines @Nutomic @glamoroussky