Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve CPU inference time #374

Open
romeokienzler opened this issue Jan 16, 2025 · 2 comments
Open

Improve CPU inference time #374

romeokienzler opened this issue Jan 16, 2025 · 2 comments
Assignees
@Joao-L-S-Almeida
Labels
1.1 MoSCoW-must

Comments

@romeokienzler
Copy link
Collaborator

maximize CPU usage
@romeokienzler
Copy link
Collaborator Author

#370

@Joao-L-S-Almeida Joao-L-S-Almeida added 1.1 and removed 1.0 labels Jan 28, 2025
@romeokienzler
Copy link
Collaborator Author

update from @Joao-L-S-Almeida :
task: 1.2 GB image inference in <= 5min, model: Prithvi V2 100M (tiled inference), seg. fault on CPU and GPU on CCC

atm 300 MB in 3 min -> in theory: 12 min 1.2 GB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Joao-L-S-Almeida Joao-L-S-Almeida

Labels
1.1 MoSCoW-must
Projects
None yet
Milestone
No milestone
Development

When branches are created from issues, their pull requests are automatically linked.

add/quantization IBM/terratorch
bench/tiled_inference IBM/terratorch
2 participants
@romeokienzler @Joao-L-S-Almeida