OpenAI.Files.OpenAIFileClient.GetFiles(filePurpose) returns only ~5k files

[mr-shevchenko]

Service

OpenAI

Describe the bug

API endpoint https://platform.openai.com/docs/api-reference/files/list uses pagination. The .NET client returns only the first page (~5k files) and doesn't provide an interface for retrieving other pages.

Steps to reproduce

1. Upload 15k files to OpenAI storage with OpenAIFileClient.UploadFileAsync(filePath, FileUploadPurpose.UserData).
2. OpenAIFileClient.GetFiles(FilePurpose.UserData) returns only ~5k files. How to get the rest of the files from storage?

Code snippets

OS

Windows 11 Pro version 23H2

.NET version

.NET 9

Library version

2.2.0-beta.4

[jsquire]

Hi @mr-shevchenko. Thanks for reaching out and we regret that you're experiencing difficulties. You're correct in that the existing client surface lacks paging, as this was a recent service change that the client has not yet included. This is something that we are looking into and plan on including in a future release, but do not yet have a target date for.