Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Too many fds open. Cannot use select on a fd >= 64 #198

Open
ZombiePm opened this issue Jan 20, 2020 · 6 comments
Open

Too many fds open. Cannot use select on a fd >= 64 #198

ZombiePm opened this issue Jan 20, 2020 · 6 comments

Comments

@ZombiePm
Copy link

Too many fds open. Cannot use select on a fd >= 64
why? How Change?

@shin701
Copy link

shin701 commented Oct 25, 2020

resolved? i meet the same problem when i open 9 OR 10 wget in the same time..... my computer, window10/ 8G/i7

@DGrv
Copy link

DGrv commented Aug 15, 2021

I have this problem using --spider.
I am trying to fetch url from a domain.
I tried to use --wait, -timeout but did not succeed.
I restarted my computer thinking that some background fds were still opened, did not change.

Does it exist a solution to avoid too open too many fds at the same time ?

@Slobodoslav
Copy link

Same issue here.
What to do?
W10
--mirror

@darnir
Copy link
Owner

darnir commented Oct 24, 2021

Con someone please provide a way to reproduce this issue?

@darnir
Copy link
Owner

darnir commented Oct 24, 2021

More specifically, the exact command you're using and the environment. All our development and testing is done on GNU/Linux, and I haven't come across this issue before

@Slobodoslav
Copy link

This is probably issue on windows only. FD_SETSIZE is set to rather low - to only 64 sockets - as it is described by error message. On Linux it is "probably/definitely" set (by default, or intentionally) to higher value (1024?).

Solution is easy and described in last comment here:
https://stackoverflow.com/questions/7976388/increasing-limit-of-fd-setsize-and-select/14929259

(actually there IS a way to increase FD_SETSIZE on windows. its defined in winsock.h and per microsoft themselves you can increase it by simply defining it BEFORE you include winsock.h
... )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants