At the moment use.js itself is sandboxed when --experimental-network-imports is used. Meaning no npm resolver available. If we can give enough access for use.js itself it might be able to use default npm resolver on server that will allow to use all server (native) npm.js packages.

Example is here:
nodejs/node#48591 (comment)