🚀 Release v1.82.0

[matusdrobuliak66]

Release version

1.82.0

Commit SHA

1168c77dbdff4e104f7f93814866262fa46cedc7

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_PauwelKwak5

Planned date

--

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

• Release to production

Changes

• ♻️ Refactoring of APIs for computations in web-server, api-server and directorv2 #7520 by @pcrespov
• 🐛 fix OAS test #7535 by @odeimaiz
• ✨ [Frontend] Convert To Pipeline #7522 by @odeimaiz
• [e2e] Fix TIP test #7533 by @odeimaiz
• ✨ web-server RPC: exposes list_my_projects_marked_as_jobs  #7534 by @pcrespov
• ✨ [Frontend] Template type: Hypertools #7531 by @odeimaiz
• 🐛 Add legacy tasks to webserver openapi specs #7543 by @bisgaard-itis
• ♻️ Use catalog rpc client in api-server #7541 by @bisgaard-itis
• 🐛 [Frontend] Disable Autocompletion #7549 by @odeimaiz
• 🎨 Add Reusable Lifespan Contexts for RabbitMQ and Redis in servicelib.fastapi #7547 by @pcrespov
• 🎨 [Frontend] More Plus Menu #7545 by @odeimaiz
• 🐛 [Frontend] Do not reload Studies when loading Tags #7551 by @odeimaiz
• 🐛 [Frontend] Fix TIP's New Plans #7552 by @odeimaiz
• 🎨 Store and retrieve task_name when listing Celery tasks #7538 by @giancarloromeo
• ✨ [Frontend] Persistent Export Data #7554 by @odeimaiz
• 🐛 Add missing AsyncJob's name #7555 by @giancarloromeo
• ✨ Adds filtering for Service Listing in Catalog's RPC API #7537 by @pcrespov
• Is7420/permanently delete trashed workspaces #7482 by @matusdrobuliak66
• 🎨 replace project_id and node_id with appropriate labels when exporting #7508 by @GitHK
• 🐛 [Frontend] Fix: Service catalog listing #7559 by @odeimaiz
• ♻️🎨Dockerfile: fix start period/start interval healthchecks #7557 by @sanderegg
• ✨ task manager web-api listing (🗃️) #7544 by @matusdrobuliak66
• 🔒️ Enhance security of API keys 🗃️  #7085 by @giancarloromeo
• ✨Computational clusters: connect autoscaling to RabbitMQ ⚠️ #7485 by @sanderegg
• ⬆️ Maintenance: Upgrade UV to 0.6.x #7561 by @sanderegg
• 🐛Clusters-keeper: ensure json dicitionary is '-escaped #7564 by @sanderegg
• 🎨 Exposes get_service_ports to rpc interface of the catalog simcore-service #7558 by @pcrespov
• ✨ [Frontend] Jobs: Connect to backend #7550 by @odeimaiz
• 🎨 [Frontend] Delete export-data task after downloading artifacts #7567 by @odeimaiz
• 🎨 [Frontend] Hypertools in menu #7570 by @odeimaiz
• ♻️SQLAlchemy migration: simcore-sdk #7404 by @sanderegg
• ⬆️Maintenance: unblock boto3  #7572 by @sanderegg
• 🎨 Replaces built-in JSON serialization with common_library utilities #7569 by @pcrespov
• ✨ adds notifications service (⚠️ devops) #7436 by @GitHK
• 🎨 [Frontend] Enh: Converstations #7571 by @odeimaiz
• ✨ Enhance task cancellation #7565 by @giancarloromeo
• 🎨 Extends list_projects_marked_as_jobs in the webserver's rpc API #7577 by @pcrespov
• 🐛lock botocore<1.36.0 until CEPH S3 is updated to be compatible with AWS S3 #7587 by @sanderegg
• 🎨E2E: when service legacy there is no need to wait for the running events #7579 by @sanderegg
• 🐛Maintenance: Unlock botocore again 🚨🚨🚨🚨 #7589 by @sanderegg
• 🐛 [Frontend] Fix share service #7593 by @odeimaiz
• 🐛 [Frontend] Fix: Cached promises #7595 by @odeimaiz
• 🎨Autoscaling in computations: send log/progress messages to rabbitMQ #7597 by @sanderegg
• ♻️🗑️ api-server upgraded to use asyncpg #7598 by @pcrespov
• 🎨E2E: fixing fail fast when websocket messages missing, fixing missing yield #7602 by @sanderegg
• 🎨 E2E: Handle success value to True when no messages came in #7603 by @sanderegg
• 🐛 fixed issue where notifications service would not start in development mode #7580 by @GitHK
• 🎨 Program jobs: Pass metadata and return display version  #7562 by @bisgaard-itis
• ♻️CI: Upgraded setup-uv to v6, try fix ARM build, modularization of CI file #7604 by @sanderegg
• ♻️Director v2: remove aiopg usage #7576 by @sanderegg
• 🐛⚗️ARM CI: build fail in CI on ARM #7606 by @sanderegg
• ⚗️CI: Improvements and addition ARM64 fixes #7607 by @sanderegg
• ✨🎨 Remove all http catalog client from api-server and introduce listing of programs endpoint #7575 by @bisgaard-itis
• 🐛E2E: TIP test fixes #7610 by @sanderegg
• ✅ Fixes flaky: test_guest_user_is_not_garbage_collected #7609 by @pcrespov
• 🐛Autoscaling: Fix docker-compose variable name typo #7611 by @sanderegg
• ⚗️ CI: Fixing ARM64 build #7612 by @sanderegg
• ✨ api-server: listing of all solver jobs  #7566 by @pcrespov
• 🎨 docker-api-proxy always requires authentication (⚠️devops) #7586 by @GitHK
• ✨ introduce conversations (🗃️) #7591 by @matusdrobuliak66
• 🐛 Add correct registry when collecting api-server log queue prometheus metrics #7616 by @bisgaard-itis
• ♻️ Clean up getting latest released service #7608 by @bisgaard-itis
• 🐛Dask-sidecar: getting logs from container times-out #7627 by @sanderegg
• 🐛 Fix automatic API keys generation  #7625 by @giancarloromeo
• ✨ ♻️ api-server: Refactor Service Layer, extended dependency injection and drafts list_study_jobs #7615 by @pcrespov
• ✨ Introduce changelog-driven FastAPI route configuration system #7620 by @pcrespov
• 🐛 Deregister log streamer via starlette background task #7626 by @bisgaard-itis
• ✨Maintenance: autoscaled clusters allows to write outputs to a file #7628 by @sanderegg
• 🔨 Maintenance: script to assist bulk pre-registrations #7623 by @pcrespov
• ✨Maintenance CLI: introduce option to terminate dynamic instances #7630 by @sanderegg
• 🎨 add Postgres connection to dynamic-scheduler #7600 by @GitHK
• ♻️E2E: Fix some timing issues #7633 by @sanderegg
• 🐛 [Frontend] Fix: Shared with Everyone filter #7596 by @odeimaiz
• ♻️E2e: definite fix to ensure idle timeout is always smaller than waiting timeout #7637 by @sanderegg
• ♻️Director-v2: removed aiopg dependency also from tests #7638 by @sanderegg
• 🐛Autoscaling script: bugfix, invalid variable #7639 by @sanderegg
• 🎨 add WAITING_FOR_RESOURCES to get_pipeline_state_from_task_states #7640 by @matusdrobuliak66

Devops check 👷

• Add policy to expire content in the /exports path osparc-ops-environments#1031
• upgrade sim4life.io DB instance to the same as osparc.io with 4 CPUs @YuryHrytsuk
• Expose RabbitMQ for Computational clusters osparc-ops-environments#1030
• Mitigate graylog minor version upgrade bug @mrnicegyu11 :

0. This can be done entirely in portainer
1. Scale graylog-mongodb to 0 replica
2. Delete docker persistant volume of graylog-mongodb
3. Scale graylog-mongodb to 1 replica

• Disable api stopping / termination for EC2 Instances in PROD osparc-ops-environments#1047

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=<M.m.0>  git_sha=<commit_sha>

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis add an entry in db scheduled_maintenance with key maintenance {"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}. Note the time is in UTC, please adjust accordingly
  • sim4life.io
  • osparc.speag.com
  • osparc.io
  • tip.science
• status page (https://manage.statuspage.io/)
  • sim4life.io
  • s4l-lite.io
  • osparc.io
  • tip.science
• mattermost channels
  • maintenance
  • power users
• Publish draft draft
• Check release CI

Releasing 🚀

• Maintenance page up (https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/pipeline_schedules)
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Remove redis key
• Check deployed
  • sim4life.io
  • osparc.speag.com
  • osparc.io
  • tip.science
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Update status page
• Update Release notes if hotfix (https://github.com/ITISFoundation/osparc-issues/blob/master/scripts/run_after_hotfix_to_prod.py)
• Check e2e runs
• Announce in mattermost

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>

[matusdrobuliak66]

NOTE:

• Before the next production release setup *_DEV_FEATURES_ENABLED to 0 in both staging deployments @matusdrobuliak66

[matusdrobuliak66]

@YuryHrytsuk @mrnicegyu11 Please upgrade sim4life.io DB instance to the same as osparc.io with 4 CPUs