🚀 Release v1.87.0

[YuryHrytsuk]

Release version

1.87.0

Commit SHA

cb80f55f43506b2f90edfc47ac7d56ead161daf3

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Imparable1

Planned date

4.11.2025

Did the commit CI succeed?

• The commit CI succeeded.

Motivation

• Regular sprint release

Changes

• 🐛 [Frontend] Fix: Support group accessRights #8420 by @odeimaiz
• ✨Dask sidecar: add threads multiplier (⚠️ Devops) #8419 by @sanderegg
• 🎨 Updates all aiohttp state application keys from string-based keys to type-safe web.AppKey instances #8405 by @pcrespov
• ♻️🐛🎨 Renaming and redesign of celery task metadata #8388 by @bisgaard-itis
• 🐛 [Frontend] Fix: filter tags with empty text #8428 by @odeimaiz
• 🎨 [Frontend] Book a call: select a topic first #8422 by @odeimaiz
• ♻️ webserver: Enhance Action Confirmation Token Logic (🚨🗃️) #8150 by @pcrespov
• ♻️ Refactor: migrate more aiohttp app keys to type-safe web.AppKey #8424 by @pcrespov
• ✨ nicegui rendering aids #8427 by @GitHK
• ♻️ Refactor groups/classifiers and scicrunch to use asyncpg with service/repository separation #8433 by @pcrespov
• 🐛 fix loss of logs (on project close/websocket disconnect) & add wallet permission check on wallet (on project open) 🚨 #8426 by @matusdrobuliak66
• 🎨 Align map load test with ui workflow #8417 by @bisgaard-itis
• ✨ Adding generic scheduling capability to dynamic-scheduler [part 1/2] #8307 by @GitHK
• 🎨 Increase function rpc call timeouts to 30sec #8440 by @bisgaard-itis
• 🐛 Fix performance issue when listing files filtering on projects #8443 by @bisgaard-itis
• 🎨 TaskID -> TaskKey #8409 by @bisgaard-itis
• 🔒️ Potential fix for code scanning alert no. 95: Clear-text logging of sensitive information #8442 by @pcrespov
• 🎨 New rpc client in the api-server to avoid cross-service calls with the web-server variants (🚨) #8431 by @pcrespov
• ⬆️ Maintenance: upgrades python tests and tool requirements #8435 by @pcrespov
• 🐛 Unified the redis_namespace for LRT ⚠️🚨 #8450 by @GitHK
• 🎨✅ [Maintenance] Add mock handler factory for LicensesRpcApi to fix pact tests #8455 by @pcrespov
• 🎨 Removed noisy logger #8429 by @GitHK
• ♻️ Refactor: migrate more aiohttp app keys to type-safe web.AppKey (follow up) #8452 by @pcrespov
• 🐛 Fix: enforce consistent WEBSERVER_RPC_NAMESPACE in docker-compose to prevent deploy bug #8463 by @pcrespov
• 🐛 Fix listing function to avoid duplicates  #8460 by @wvangeit
• ♻️ [Maintenance] Refactor Payments Domain to Use asyncpg Instead of aiopg #8462 by @pcrespov
• 🐛 [Frontend] Fix: Open My Account in s4llite #8468 by @odeimaiz
• 🎨 [Frontend] Support center: Enhance conversation list item #8464 by @odeimaiz
• 🐛 Fix issue with not consumed rabbitmq message #8472 by @matusdrobuliak66
• ♻️ [Frontend] Refactor: Message model #8471 by @odeimaiz
• ✅ [Maintenance] Fixes api-server/tests/unit/pact_broker testing #8473 by @pcrespov
• ♻️ [Maintenance] Refactor Studies-dispatcher Domain to Use asyncpg Instead of aiopg #8467 by @pcrespov
• 🐛 Agent should be able to read files in directory now  #8466 by @GitHK
• 🎨 feat(api-server): Add TTL caching to authentication repositories 🚨 #8474 by @pcrespov
• 🐛 [Frontend] Fix: Trash pagination #8478 by @odeimaiz
• ✨ Add Celery task manager to Web Server ⚠️ #8436 by @giancarloromeo
• 🐛 [Frontend] Fix: Sim4Life Escalate to Support #8479 by @odeimaiz
• ✨ dynamic-scheduler can chain operations #8446 by @GitHK
• 🎨 e2e Metamodeling: Improve project creation #8477 by @odeimaiz
• Split functions repo in different files ♻️ #8483 by @wvangeit
• 🎨 [Frontend] Enh: Tasks UI #8485 by @odeimaiz
• 🐛 fix unsubscription of project logs for multiple replicas #8458 by @matusdrobuliak66
• 🐛 [Frontend] Fix: invalidate cache after emptying trash #8492 by @odeimaiz
• 🎨 Adds missing features to generic_scheduler #8490 by @GitHK
• 🚨✨ Implement tracing sampling strategy (🚧 devops 🚧) #8421 by @bisgaard-itis
• 🐛 Fixes webserver-api error on get_project_services when project services are missing in the catalog by allowing partial failure #8486 by @pcrespov
• Follow up to osparc.io incident #8491 by @bisgaard-itis
• 🎨 [e2e] Improve MMUX test #8494 by @odeimaiz
• 🎨 adds required initial operation context key #8495 by @GitHK
• 🐛 Ensure function execute permission check is performed only once in map endpoint #8499 by @bisgaard-itis
• 🎨 [Frontend] New Feature: Transfer Projects #8497 by @odeimaiz
• 🐛 Prevent showing full s3 url with credentials in logs  #8493 by @wvangeit
• 🐛 webserver: Fix 5XX error in GET /v0/projects/{project_id}/nodes/-/services when project has no nodes #8501 by @pcrespov
• 🔨 [Maintenance] Refactor docker-compose.yml to Improve Maintainability via Environment Variable Grouping #8503 by @pcrespov
• 🎨 [Support center] reopen closed Fogbugz cases (🗃️) #8482 by @matusdrobuliak66
• Bump astral-sh/setup-uv from 6 to 7 #8509 by @dependabot[bot]
• ✨ Add ordering to function jobs inside a function job collection  #8487 by @wvangeit
• ✨ Introduce streamed files search #8202 by @giancarloromeo
• 🎨 [Frontend] Support Center: read/unread conversations #8489 by @odeimaiz
• ⬆️ Unblock Mypy version in autoscaling + some more updates #8517 by @sanderegg
• 🐛 Fixed issues with cancellation #8521 by @GitHK
• 🐛 Fixed failing director-v2 when monitoring services #8513 by @GitHK
• ✨ Introduce chatbot client (⚠️) #8516 by @matusdrobuliak66
• 🎨 Check study and solver job status before returning output #8511 by @wvangeit
• ⬆️ Upgrade UV to 0.9.x version everywhere #8519 by @sanderegg
• Autoscaling for dynamic services: Performance improvements for cold starts (⚠️ devops) 🚨🚨🚨 #8375 by @sanderegg
• 🎨 Allow case-insensitive filename matching #8522 by @giancarloromeo
• ♻️E2E: Fix DEBUG logging not outputing to the logs #8523 by @sanderegg
• Fix/sntz tgs #8524 by @odeimaiz
• 🐛 Fix: initialize 3rd party libs #8527 by @odeimaiz
• 🐛 Use Celery prefork pool for CPU-bound tasks #8500 by @giancarloromeo
• 🐛 [Frontend] Fix: Pass the initial value #8529 by @odeimaiz
• ✨ AI answers user questions in support center (🗃️⚠️🚨) #8525 by @matusdrobuliak66
• ✨ [Frontend] Search Files #8520 by @odeimaiz
• 🐛Storage: Listing path query grows with number of projects unbounded #8542 by @sanderegg
• 🎨E2E: ensure info logs are shown when testing playwright e2e #8543 by @sanderegg
• 🎨🔒️ Add string_types Module for Strongly Validated API String Fields #8526 by @pcrespov
• 🎨🐛 [Frontend] PO Center improvements #8537 by @odeimaiz
• Bump actions/setup-node from 5.0.0 to 6.0.0 #8534 by @dependabot[bot]
• Bump github/codeql-action from 3 to 4 #8508 by @dependabot[bot]
• 🎨 No more long running http requests while stopping services #8531 by @GitHK
• 🔨 Make devel-mode work again and importing in main modules ⚠️  #8515 by @pcrespov
• 🐛 chatbot followups (🗃️) #8541 by @matusdrobuliak66
• 🐛 [BugFix] Properly handle incorrect passwords for existing accounts during product registration #8548 by @pcrespov
• 🐛 [Frontend] Fix: no-read default accessRights for the chatbot user #8551 by @odeimaiz
• 🎨E2E: improve logging of websocket messages #8550 by @sanderegg
• 🐛 [Frontend] Fix: catch error /group/{gid}/users #8552 by @odeimaiz
• 🎨E2E: Adds missing prefix for websocket messages #8554 by @sanderegg
• ♻️ RabbitMQ: Make sure exclusive queues are not set as durable (⚠️ devops) #8546 by @sanderegg
• 🎨Computational backend: Make sure the number of threads of a dask-worker is computed for autoscaling 🚨🚨🚨 #8423 by @sanderegg
• 🐛 LRT redis cleanup ⚠️🚨 #8539 by @GitHK
• 🐛Autoscaling: fixes unknown passing type to dask-scheduler #8556 by @sanderegg
• 🚑️ Revert #8423 + #8556 until later fix and allow for staging release #8557 by @sanderegg
• 🎨 Batch api-server->wb-api-server requests in map endpoint in the api-server #8514 by @bisgaard-itis
• 🎨 Allows guest users to run a project form a template with outputs pushing enabled 🗃️ #8555 by @GitHK

Devops check 👷

• Update docker engine version Update docker engine to major version 26 osparc-ops-environments#1198
  • sim4life
  • nih
  • aws tip
  • internal tip
  • dalco
• Clean up redis 🐛 Unified the redis_namespace for LRT ⚠️🚨 #8450 / 🐛 LRT redis cleanup ⚠️🚨 #8539
  • sim4life
  • nih
  • aws tip
  • internal tip
  • dalco
• remove (clean) old docker api network 🔨 Make devel-mode work again and importing in main modules ⚠️  #8515 @YuryHrytsuk
  • sim4life
  • nih
  • aws tip
  • internal tip
  • dalco
• Modify DB ✨ AI answers user questions in support center (🗃️⚠️🚨) #8525 @matusdrobuliak66
  • sim4life
  • nih
  • aws tip
  • internal tip
  • dalco
• @mrnicegyu11 Clean NIH-Prod TF State - Create smaller simcore machine
  • nih
• update license server on sim4life @mguidon

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=<M.m.0>  git_sha=<commit_sha>

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis add an entry in db scheduled_maintenance with key maintenance {"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}. Note the time is in UTC, please adjust accordingly
  • sim4life.io
  • osparc.speag.com
  • osparc.io
  • tip.science
• status page (https://manage.statuspage.io/)
  • sim4life.io
  • s4l-lite.io
  • osparc.io
  • tip.science
• mattermost channels
  • maintenance
  • power users
• Publish draft draft
• Check release CI

Releasing 🚀

• Maintenance page up (https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipeline_schedules)
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Remove redis key
• Check deployed
  • sim4life.io
  • osparc.speag.com
  • osparc.io
  • tip.science
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Update status page
• Update Release notes if hotfix (https://github.com/ITISFoundation/osparc-issues/blob/master/scripts/run_after_hotfix_to_prod.py)
• Check e2e runs
• Announce in mattermost

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>

[matusdrobuliak66]

• @GitHK 🐛 Unified the redis_namespace for LRT ⚠️🚨 #8450 / 🐛 LRT redis cleanup ⚠️🚨 #8539

After release:

• ✨ AI answers user questions in support center (🗃️⚠️🚨) #8525 @matusdrobuliak66

[mrnicegyu11]

I plan to clean the terraform state on nih-prod, for this I will need 30min to restart a "simcore" machine.