🚀 Pre-release master -> staging_Cheops5

[matusdrobuliak66]

What kind of pre-release?

master branch

Sprint Name

Cheops

Pre-release version

5

Commit SHA

0a583a5

Planned date

Thursday 18, Sep

Did the commit CI succeed?

• The commit CI succeeded.

Motivation

• weekly release (preparation for production release)

What Changed

• 🎨♻️Computational backend: stability improvements step 4 (🎨♻️Computational backend: stability improvements step 4 #8380)
• ⚗️ [Frontend] PoC: Rocket preview (⚗️ [Frontend] PoC: Rocket preview #8378)
• 🐛 Minor fixes for the function api (🐛 Minor fixes for the function api #8376)
• ♻️Maintenance: fix generation of service names (♻️Maintenance: fix generation of service names #8377)
• ♻️Maintenance: multiple improvements after debugging session (♻️Maintenance: multiple improvements after debugging session #8370)
• 🎨Computational backend: performance improvements step2 - autoscaling shall ask dask to retire nodes only if necessary (🎨Computational backend: performance improvements step2 - autoscaling shall ask dask to retire nodes only if necessary #8374)
• 🐛 Add task_manager to api-worker (🐛 Add task_manager to api-worker #8373)
• 🎨 Computational backend performance: improvements step1 (🎨 Computational backend performance: improvements step1 #8349)
• 🐛 Fix Celery task submission (🐛 Celery tasks aborted after submission #8371)
• 🎨 [Frontend] Suport Center: Chat bubble and Fogbugz link (🎨 [Frontend] Suport Center: Chat bubble and Fogbugz link #8369)
• ♻️🐛 Use celery task manager in function job task client service (♻️🐛 Use celery task manager in function job task client service #8352)
• 🎨 allow support user to patch conversation (🎨 allow support user to patch conversation #8372)
• 🎨 Makes removal of long running tasks faster (🎨 Makes removal of long running tasks faster #8350)
• 🐛 Update API keys uniqueness constraint (🗃️) (🐛 Update API keys uniqueness constraint (🗃️) #8363)
• 🎨 [Frontend] Support center feedback (🎨 [Frontend] Support center feedback #8362)
• ♻️ [Maintenance] Refactor Tests Utilities and Typing (Spin-off 2 from PR WIP: ♻️ Use projects_nodes table instead of projects.workbench (🗃️) #8141) (♻️ [Maintenance] Refactor Tests Utilities and Typing (Spin-off 2 from PR #8141) #8368)
• ♻️Maintenance: improve cancellation error handling (♻️Maintenance: improve cancellation error handling #8367)
• ♻️ Refactor Models, Schema Validation, and DB Utilities (Spin-off 1 from PR WIP: ♻️ Use projects_nodes table instead of projects.workbench (🗃️) #8141) (♻️ Refactor Models, Schema Validation, and DB Utilities (Spin-off 1 from PR #8141) #8360)
• 🎨 Cleanup test in celery library (🎨 Cleanup test in celery library #8364)
• 🎨🐛 Fix filtering bug in celery tasks (🎨🐛 Fix filtering bug in celery tasks #8355)
• 🐛 Ensure proper Redis client shutdown in Celery (🐛 Ensure proper Redis client shutdown in Celery #8237)
• 🎨 [Frontend] Enh: User Account UI (🎨 [Frontend] Enh: User Account UI #8361)
• 🐛 Ensure consistent Celery task cancellation (🐛 Ensure consistent Celery task cancellation #8354)
• 🎨 Added user identifiers to the UserAccountGetmodel (🎨 Added user identifiers to the UserAccountGetmodel #8358)
• 🎨 Unmarks WEBSERVER_REALTIME_COLLABORATION as dev feature (🎨 Unmarks WEBSERVER_REALTIME_COLLABORATION as dev feature ⚠️ #8348)
• 🎨 [Frontend] Remove S4L's border and Enhance PO Center (🎨 [Frontend] Remove S4L's border and Enhance PO Center #8359)
• 🎨 [Frontend] Enhanced Support Center (🎨 [Frontend] Enhanced Support Center #8353)
• ♻️[Maintenance]: Improve RPC Server Logging and Error Handling (♻️[Maintenance]: Improve RPC Server Logging and Error Handling #8346)
• Bump actions/setup-node from 4.4.0 to 5.0.0 (Bump actions/setup-node from 4.4.0 to 5.0.0 #8330)
• Bump actions/setup-python from 5 to 6 (Bump actions/setup-python from 5 to 6 #8329)
• ✨ [Frontend] Support users can access other users extra data (✨ [Frontend] Support users can access other users extra data #8339)
• ✨ [Frontend] Delete Functions (✨ [Frontend] Delete Functions #8351)
• ✨ Check for associated jobs when deleting a function (✨ Check for associated jobs when deleting a function #8342)
• Fix job_task_id not found if db doesnt have the field 🐛 🚑️ (Fix job_task_id not found if db doesnt have the field 🐛 🚑️ #8347)
• ⬆️ Upgrade traefik to v3.5.2 (⬆️ Upgrade traefik to v3.5.2 #8343)
• 🐛🎨Computational backend stability: improvements step 2 (🐛🎨Computational backend stability: improvements step 2 #8341)
• ✨ Create custom generate json schema for resolving references (✨ Create custom generate json schema for resolving references #8295)
• 🎨 [Frontend] Distinguish product groups (Everyone/Public and Support) (🎨 [Frontend] Distinguish product groups (Everyone/Public and Support) #8335)
• 🎨E2E: add create study, create function, start mmux (🎨E2E: add create study, create function, start mmux #8311)
• ✨ Support Center: Gives Read Access to Support Users to User Accounts and Product Details (✨ Support Center: Gives Read Access to Support Users to User Accounts and Product Details #8313)
• 🎨 [Frontend] Hide some pages in Study/Template details when user has no write access (🎨 [Frontend] Hide some pages in Study/Template details when user has no write access #8331)
• 🐛🎨⚗️Computational backend: Stability (Step 1) (🐛🎨⚗️Computational backend stability: improvements step 1 #8323)
• 🎨 [Frontend] Event-driven patch regardless of whether RTC is enabled (🎨 [Frontend] Event-driven patch regardless of whether RTC is enabled #8328)
• 🎨 added docker hub registry auth to director-v2 when creating services (🎨 added docker hub registry auth to director-v2 when creating services ⚠️ #8321)
• ✅ Add parametrizable load tests for function interface (✅ Add parametrizable load tests for function interface #8326)
• Add a check_write_permissions option to update function job/out 🐛 (Add a check_write_permissions option to update function job/out 🐛  #8325)
• 🐛 [Frontend] Add new parameter from node's inputs (🐛 [Frontend] Add new parameter from node's inputs #8332)
• 🎨 [Frontend] UX: Join project with assigned wallet (🎨 [Frontend] UX: Join project with assigned wallet #8324)
• 🎨 Only run a single function at a time in map endpoint (🎨 Only run a single function at a time in map endpoint #8327)
• 🎨Maintenance & Performance: Properly setup asyncpg DB engine (🎨Maintenance & Performance: Properly setup asyncpg DB engine #8322)
• 🎨 Add env var for setting number of threads in api-server celery worker (🎨 Add env var for setting number of threads in api-server celery worker #8298)
• 🎨 [Frontend] Enh: Show Tags filter only in the Tutorials tab (🎨 [Frontend] Enh: Show Tags filter only in the Tutorials tab #8320)
• ✨Clusters-keeper: Add new ENV to test different configurations (✨Clusters-keeper: Add new ENV to test different configurations #8304)
• 🎨 Enhance account request emails to reduce invitation errors (🎨 Enhance account request emails to reduce invitation errors #8317)
• 🎨 Allow headers and random body generation in single endpoint locust test (🎨 Allow headers and random body generation in single endpoint locust test #8318)
• 🐛 [Frontend] FIXES: Add nodes (🐛 [Frontend] FIXES: Add nodes #8312)
• 🎨 [Frontend] All users know about the Support group (🎨 [Frontend] All users know about the Support group #8305)
• [Frontend] e2e: IDs for MetaModeling ([Frontend] e2e: IDs for MetaModeling #8310)
• ♻️ Refactors studies-dispatcher before extending nih portal's views api (♻️ Refactors studies-dispatcher before extending nih portal's views api (🚨) #8257)
• 🎨 [Frontend] Display Contact information (🎨 [Frontend] Display Contact information #8302)
• 🎨 Run each job creation as a single task in api-worker (🎨 Run each job creation as a single task in api-worker #8306)
• ✨ Add Optional Contact Information Fields to get_profile Response (✨ Add Optional Contact Information Fields to get_profile Response #8300)
• Fix python client wrt function job status 🐛 (Fix python client wrt function job status 🐛 #8309)
• 🐛Director-v2: fix empty arguments for max method (🐛Director-v2: fix empty arguments for max method #8308)
• ✨E2E: Added initial skeleton for testing MMUX services in E2E tests (✨E2E: Added initial skeleton for testing MMUX services in E2E tests #8301)
• ✨ [Frontend] Support: Book a call (✨ [Frontend] Support: Book a call #8297)
• ✨ Support center: extend response model of get profile endpoint with support group info (✨ Support center: extend response model of get profile endpoint with support group info #8294)
• 🐛🎨Do not fail a pipeline when the clusters-keeper or the computational backend in general is not reachable for short time 🚨 (🐛🎨Do not fail a pipeline when the clusters-keeper or the computational backend in general is not reachable for short time 🚨 #8286)
• ✨ dynamic-scheduler prerequisites ⚠️🚨 (✨ dynamic-scheduler prerequisites ⚠️🚨 #8287)
• Add a function_job_list_with_status endpoint 🎨 (Add a function_job_list_with_status endpoint 🎨 #8278)
• 🎨 Use FogBugz client to create support request (🎨 Use FogBugz client to create support request (⚠️) #8293)
• ✨ [Frontend] OEC to Support chat (✨ [Frontend] OEC to Support chat #8288)
• ⚠️🎨✨ Execute the api-server's run and map function api endpoints in celery worker (⚠️🎨✨ Execute the api-server's run and map function api endpoints in celery worker #8233)
• ✨ [Frontend] User profile details (✨ [Frontend] User profile details #8282)
• 🐛🗑️ Fixes validation of product vendor ui object and drops unused project_alias ⚠️ (🐛🗑️ Fixes validation of product vendor ui object and drops unused project_alias ⚠️ #8266)
• ♻️Maintenance: Add UNKOWN type to DB State Type (🗃️) (♻️Maintenance: Add UNKOWN type to DB State Type (🗃️) #8284)
• 🐛Clusters-keeper: missing quoting for newly transformed list of values (🐛Clusters-keeper: missing quoting for newly transformed list of values #8285)
• 🐛Director-v2 computational scheduler: tasks specific state combination was missing and returning UNKNOWN pipeline state (🐛Director-v2 computational scheduler: tasks specific state combination was missing and returning UNKNOWN pipeline state #8281)
• 🐛Autoscaling: ensure unstarteable warm buffer are replaced by cold instances if available (🐛Autoscaling: ensure unstarteable warm buffer are replaced by cold instances if available #8277)
• ✨ Adds RPC interface for containers routes (✨ Adds RPC interface for containers routes #8227)
• 🎨 [Frontend] Support Conversations: Listen to websocket (🎨 [Frontend] Support Conversations: Listen to websocket #8276)
• 🎨🐛Autoscaling: Allow EC2 launches in multiple AvailabilityZones ⚠️ (DevOPS) 🚨 (🎨🐛Autoscaling: Allow EC2 launches in multiple AvailabilityZones ⚠️ (DevOPS) 🚨 #8210)
• 🐛 [Frontend] Fix: Release date on Service Card (🐛 [Frontend] Fix: Release date on Service Card #8275)
• 🎨 [Frontend] (Too) light buttons (🎨 [Frontend] (Too) light buttons #8274)
• 🎨 [Frontend] Request Account: Enhanced Phone input filed (🎨 [Frontend] Request Account: Enhanced Phone input filed #8270)
• ✨ Add long running rpc interface to dynamic-sidecar (✨ Add long running rpc interface to dynamic-sidecar #8255)
• 🐛 Fixed encoding unpicklable errors (🐛 Fixed encoding unpicklable errors #8263)
• ⬆️ Update dependencies to add celery worker in api server (⬆️ Update dependencies to add celery worker in api server #8269)
• 🎨 introducing fogbugz client ⚠️ (🎨 introducing fogbugz client ⚠️ #8258)
• 🎨 [Frontend] Functions Browser: sorting (🎨 [Frontend] Functions Browser: sorting #8267)
• ✨👽️ Add patch registered function job rpc endpoint in webserver (✨👽️ Add patch registered function job rpc endpoint in webserver #8268)
• 🎨 Fixed long running tasks cleanup 🚨⚠️ (🎨 Fixed long running tasks cleanup 🚨⚠️ #8253)
• ✨ [Frontend] Update Phone Number (✨ [Frontend] Update Phone Number #8264)
• 🎨Autoscaling: warm buffers: create at minimum 1 machine at a time instead of asking directly for the required number (🎨Autoscaling: warm buffers: create at minimum 1 machine at a time instead of asking directly for the required number #8262)
• 🐛 Fix PO center invitations to include correct product info and links (🐛 Fix PO center invitations to include correct product info and links (🚨) #8261)
• ✨ [Frontend] Expose Phone number (✨ [Frontend] Expose phone number #8260)
• 🎨Send NodeUpdate when computational pipeline completes (🎨Send NodeUpdate when computational pipeline completes #8250)
• E2E: Fix classic TIP test (E2E: Fix classic TIP test #8259)
• ✨ [Frontend] Functions Browser: Permissions and Search (✨ [Frontend] Functions Browser: Permissions and Search #8252)
• 🐛 fixes issue with agent not executing in correct container (🐛 fixes issue with agent not executing in correct container #8256)
• ⬆️Security update with alignment of dependencies (⬆️Security update with alignment of dependencies #8247)
• ✨ [Frontend] RTC: Node Lock State (✨ [Frontend] RTC: Node Lock State #8243)
• ♻️ add rabbitmq interface to long_running_tasks ⚠️🚨 (♻️ add rabbitmq interface to long_running_tasks ⚠️🚨 #8198)
• 🐛 fix list_users_in_group introduced in previous PR (🐛 fix list_users_in_group introduced in previous PR #8249)
• ✨Simultaneous access: allow access to collaborative services (✨Simultaneous access: allow access to collaborative services #8236)
• 🎨 Support conversation improvement (ws notification, remove unnecessary parameters) (🎨 Support conversation improvement (ws notification, remove unnecessary parameters) #8244)
• ♻️Maintenance: remove circular dependency (♻️Maintenance: remove circular dependency #8245)
• 🐛 [Frontend] Fix: Share workspaces (🐛 [Frontend] Fix: Share workspaces #8242)
• ✨ [Frontend] Support center (✨ [Frontend] Support center #8216)
• 🎨Director-v0: Pass headers on /manifests call to let the registry know we accept all manifest versions (🎨Director-v0: Pass headers on /manifests call to let the registry know we accept all manifest versions #8241)
• ✨ On first support message send email to fogbugz (✨ On first support message send email to fogbugz #8238)
• 🎨Director-v0: compatible with both registries + upgraded registry to v3 (🎨Director-v0: compatible with both registries + upgraded registry to v3 #8240)
• 🎨 Adds support for extra context in conversation updates (🎨 Adds support for extra context in conversation updates #8235)
• 🎨 instrument storage and director httpx client (opentelemetry) (🎨 instrument storage and director httpx client (opentelemetry) #8234)
• ✨ Add ordering and filtering when listing Functions (✨ Add ordering and filtering when listing Functions #8229)
• ♻️ Refactor job_service and function_job_service in api-server before introducing celery worker (♻️ Refactor job_service and function_job_service in api-server before introducing celery worker #8222)
• ✨ Add Function groups permissions management endpoints (✨ Add Function groups permissions management endpoints #8226)
• 🐛Refreshing shall renew the socket (🐛Refreshing shall renew the socket #8228)
• ⬆️Upgrade UV to 0.8.X (⬆️Upgrade UV to 0.8.X #8232)
• ⬆️ Webserver node locking: missing change (⬆️ Webserver node locking: missing change #8230)
• node locking (node locking #8170)
• ✨ First iteration backend for support center (🗃️) (✨ First iteration backend for support center (🗃️) #8212)
• 🐛 [Frontend] Fix: start dynamic services (🐛 [Frontend] Fix: start dynamic services #8224)
• 🐛 Fix issue with agent and volume permissions when backing up (🐛 Fix issue with agent and volume permissions when backing up #8214)
• 🎨Ensure all DB clients have a sensible name (🎨Ensure all DB clients have a sensible name #8220)
• 🎨When a docker pulling is retried, output a warning (🎨When a docker pulling is retried, output a warning #8223)
• ✨👽️🗃️ Introduce api-server endpoint for deleting solver job assets (s3-data) (✨👽️🗃️ Introduce api-server endpoint for deleting solver job assets (s3-data) #8203)
• 🐛Fixes webserver integration tests (🐛Fixes webserver integration tests #8221)
• 🎨 Make POSTGRES_MINSIZE and POSTGRES_MAXSIZE configurable (🎨 Make POSTGRES_MINSIZE and POSTGRES_MAXSIZE configurable #8199)
• Add search and sort fields to list_functions 🎨 (Add search and sort fields to list_functions 🎨 #8218)
• ♻️ Shorten traefik config placeholder svc name ( ♻️ Shorten traefik config placeholder svc name #8217)
• ✨ [Frontend] RTC: Support for adding nodes (✨ [Frontend] RTC: Support for adding nodes #8196)
• Add permission function service layer methods 🎨 (Add permission function service layer methods 🎨 #8211)
• ♻️ Adds feature flag check for realtime collaboration Project Document updates (♻️ Adds feature flag check for realtime collaboration Project Document updates #8209)
• Add more function job filters 🎨 (Add more function job filters 🎨 #8187)
• 🐛 Fix bug when notifying users based on wrong access rights (🐛 Fix bug when notifying users based on wrong access rights #8207)
• Bump actions/checkout from 4 to 5 (Bump actions/checkout from 4 to 5 #8204)

Devops check ⚠️ devops

• Add changes (if any) and release tags in https://github.com/ITISFoundation/osparc-ops-environments/tags
• Add changes (if any) and release tags in osparc-ops-deployment-configuration (staging.osparc.io & osparc-staging.speag.com)
• ...

e2e testing check 🧪

No response

Summary 📝

• make release-staging name=<sprint_name> version=<version> git_sha=<commit_sha>
  • https://github.com/ITISFoundation/osparc-simcore/releases/new?prerelease=1&target=<commit_sha>&tag=staging_<sprint_name><version>&title=Staging%20<sprint_name><version>
• Draft pre-release
• Announce (add redis key maintenance in every concerned deployment)

  {"start": "2023-02-01T12:30:00.000Z", "end": "2023-02-01T13:00:00.000Z", "reason": "Release ResistanceIsFutile9 "}

• Announce release in Mattermost

  :loud_sound:  Maintenance scheduled for **NAMED_DAY DD. MM from START_TIME - END_TIME**.
  =========================================================================
  
  @all Be aware that you will automatically be logged out and your projects stopped and saved during the maintenance time. Affected:
  *   [https://staging.osparc.io](https://staging.osparc.io/)
  *   [https://https://staging.s4l-lite.io/](https://https://staging.s4l-lite.io//)
  
  and on premises:
  *   [https://osparc-staging.speag.com](https://osparc-staging.speag.com/)
  *   [https://tip-staging.speag.com](https://tip-staging.speag.com/)
  *   [https://s4l-staging.speag.com](https://s4l-staging.speag.com/)
  *   [https://s4l-lite-staging.speag.com](https://s4l-lite-staging.speag.com/)
  
  
  Reason: Scheduled staging-release of STAGING_NAME_AND_VERSION.
  
  Thanks for your understanding and sorry for the inconveniences,
  
  Your friendly oSparc Team
  
  

Releasing

• Release (release draft)
• Check Release CI
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Check deployed
  • aws deploy
  • dalco deploy
• Delete announcement
• Check e2e runs
• Announce

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_<sprint_name><version>