not found golang packages

[gouslu]

I am getting 404 for the packages below. Can this be fixed? Is there anything I can do to help?

Status	Dependency	URL
NOT FOUND	github.com/aws/aws-sdk-go-v2/feature/ec2/[email protected]	https://api.clearlydefined.io/definitions/go/golang/github.com%2faws%2faws-sdk-go-v2%2ffeature%2fec2%2fimds/v1.6.0
NOT FOUND	github.com/aws/aws-sdk-go-v2/service/internal/[email protected]	https://api.clearlydefined.io/definitions/go/golang/github.com%2faws%2faws-sdk-go-v2%2fservice%2finternal%2fpresigned-url/v1.3.2
NOT FOUND	github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/[email protected]	https://api.clearlydefined.io/definitions/go/golang/github.com%2fopen-telemetry%2fopentelemetry-collector-contrib%2fpkg%2ftranslator%2fjaeger/v0.68.0
NOT FOUND	github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/[email protected]	https://api.clearlydefined.io/definitions/go/golang/github.com%2fopen-telemetry%2fopentelemetry-collector-contrib%2fpkg%2ftranslator%2fprometheus/v0.73.0
NOT FOUND	github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/[email protected]	https://api.clearlydefined.io/definitions/go/golang/github.com%2fopen-telemetry%2fopentelemetry-collector-contrib%2fpkg%2ftranslator%2fprometheusremotewrite/v0.73.0
NOT FOUND	[email protected]	https://api.clearlydefined.io/definitions/go/golang/go.opencensus.io/v0.24.0
NOT FOUND	go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/[email protected]	https://api.clearlydefined.io/definitions/go/golang/go.opentelemetry.io%2fcontrib%2finstrumentation%2fgoogle.golang.org%2fgrpc%2fotelgrpc/v0.40.0
NOT FOUND	go.opentelemetry.io/contrib/instrumentation/net/http/[email protected]	https://api.clearlydefined.io/definitions/go/golang/go.opentelemetry.io%2fcontrib%2finstrumentation%2fnet%2fhttp%2fotelhttp/v0.40.0
NOT FOUND	go.opentelemetry.io/otel/exporters/otlp/internal/[email protected]	https://api.clearlydefined.io/definitions/go/golang/go.opentelemetry.io%2fotel%2fexporters%2fotlp%2finternal%2fretry/v1.11.2
NOT FOUND	go.opentelemetry.io/otel/exporters/otlp/otlptrace/[email protected]	https://api.clearlydefined.io/definitions/go/golang/go.opentelemetry.io%2fotel%2fexporters%2fotlp%2fotlptrace%2fotlptracegrpc/v1.11.2
NOT FOUND	go.opentelemetry.io/otel/exporters/otlp/otlptrace/[email protected]	https://api.clearlydefined.io/definitions/go/golang/go.opentelemetry.io%2fotel%2fexporters%2fotlp%2fotlptrace%2fotlptracehttp/v1.11.2

[mpcen]

@qtomlinson

[mattsains]

I've been having a problem harvesting packages like these as well. I tried to do specifically github.com/open-telemetry/opentelemetry-collector like this:

But after multiple days, the golang package page still shows it as not harvested:

https://clearlydefined.io/definitions/go/golang/github.com%2fopen-telemetry/opentelemetry-collector/v0.82.0

Is there a different/correct way to do this that I don't know about?

[mattsains]

I think the issue is that the ClearlyDefined UI doesn't support golang yet, or at least not when the identifier for the golang repo isn't github - for example go.opentelemetry.io/collector v0.82.0.

I think it's possible to submit these using the API bypassing the UI, I'm looking into this

[mattsains]

I submitted an API request like this to the harvest API, POST https://api.clearlydefined.io/harvest:

[{"tool":"package","coordinates":"go/golang/github.com/aws/aws-sdk-go/v1.44.309"}]

I received a 201 back with body "Created".

I don't know how long the harvest API takes to work, but I submitted this one at Wed, 09 Aug 2023 21:29:00 GMT (half an hour ago now) and the corresponding definition has not changed to show harvested: https://clearlydefined.io/definitions/go/golang/github.com%2faws%2faws-sdk-go/v1.44.309

Btw, I also tried:

[{"tool":"package","coordinates":"go/golang/github.com%2faws%2faws-sdk-go/v1.44.309"}]

Just in case the URL-escaped quotes matter, but this also had no effect

[mattsains]

ok, that package just spontaneously became harvested. I'll keep an eye on the other packages I've been testing with to see whether they resolve themselves too