♻️ preparation for osparc migration (merging deployments) (🗃️)

[matusdrobuliak66]

What do these changes do?

• ♻️ Remove project comments resource (🗃️)
• 🗃️ Add missing foreign keys
• 🗃️ Add zzz_resource_tracker_service_runs__osparc_io_archive_202508 where we will archive osparc service runs data.zzz prefix is so it is in the end of all tables.

PLAN for index increment:

table	increment column	serial sequence name
api_keys	id	api_keys_id_seq
comp_runs	run_id	comp_runs_run_id_seq
comp_tasks	task_id	comp_tasks_task_id_seq
folders_v2	folder_id	folders_v2_folder_id_seq
group_classifiers	id	group_classifiers_id_seq
groups	gid	groups_gid_seq
payments_autorecharge	id	payments_autorecharge_id_seq
projects_nodes	project_node_id	projects_nodes_project_node_id_seq
tags	id	tags_id_seq
tokens	token_id	tokens_token_id_seq
user_to_projects	id	user_to_projects_id_seq
users	id	users_id_seq
wallets	wallet_id	wallets_wallet_id_seq
workspaces	workspace_id	workspaces_workspace_id_seq

NOTE! resource_tracker_service_runs user ID needs to be manually incremented (foreign key can not be introduced, because all anonymous users are always deleted)

For migration:

-- users
UPDATE users SET id = id + 2000000;
SELECT setval('users_id_seq', (SELECT MAX(id) FROM users));
-- user_to_projects
UPDATE user_to_projects SET id = id + 2000000;
SELECT setval('user_to_projects_id_seq', (SELECT MAX(id) FROM user_to_projects));
-- EXPLICITELY resource_usage_tracker_service_runs (It is without the foreign key)
UPDATE resource_tracker_service_runs SET user_id = user_id + 2000000;

-- wallets
UPDATE wallets SET wallet_id = wallet_id + 2000000;
SELECT setval('wallets_wallet_id_seq', (SELECT MAX(wallet_id) FROM wallets));
-- workspaces
UPDATE workspaces SET workspace_id = workspace_id + 2000000;
SELECT setval('workspaces_workspace_id_seq', (SELECT MAX(workspace_id) FROM workspaces));
-- tokens
UPDATE tokens SET token_id = token_id + 2000000;
SELECT setval('tokens_token_id_seq', (SELECT MAX(token_id) FROM tokens));
-- tags
UPDATE tags SET id = id + 2000000;
SELECT setval('tags_id_seq', (SELECT MAX(id) FROM tags));
-- projects_nodes
UPDATE projects_nodes SET project_node_id = project_node_id + 2000000;
SELECT setval('projects_nodes_project_node_id_seq', (SELECT MAX(project_node_id) FROM projects_nodes));
-- payments_autorecharge
UPDATE payments_autorecharge SET id = id + 2000000;
SELECT setval('payments_autorecharge_id_seq', (SELECT MAX(id) FROM payments_autorecharge));
-- groups
UPDATE groups SET gid = gid + 2000000 where gid != 1;
SELECT setval('groups_gid_seq', (SELECT MAX(gid) FROM groups));
-- group_classifiers
UPDATE group_classifiers SET id = id + 2000000;
SELECT setval('group_classifiers_id_seq', (SELECT MAX(id) FROM group_classifiers));
-- folders_v2
UPDATE folders_v2 SET folder_id = folder_id + 2000000;
SELECT setval('folders_v2_folder_id_seq', (SELECT MAX(folder_id) FROM folders_v2));
-- comp_tasks
UPDATE comp_tasks SET task_id = task_id + 7000000;
SELECT setval('comp_tasks_task_id_seq', (SELECT MAX(task_id) FROM comp_tasks));
-- comp_runs
UPDATE comp_runs SET run_id = run_id + 2000000;
SELECT setval('comp_runs_run_id_seq', (SELECT MAX(run_id) FROM comp_runs));
-- api_keys
UPDATE api_keys SET id = id + 2000000;
SELECT setval('api_keys_id_seq', (SELECT MAX(id) FROM api_keys));

For archiving the runs table:

INSERT INTO zzz_resource_tracker_service_runs__osparc_io_archive_202508 (
    product_name,
    service_run_id,
    wallet_id,
    wallet_name,
    pricing_plan_id,
    pricing_unit_id,
    pricing_unit_cost_id,
    pricing_unit_cost,
    simcore_user_agent,
    user_id,
    user_email,
    project_id,
    project_name,
    node_id,
    node_name,
    parent_project_id,
    root_parent_project_id,
    root_parent_project_name,
    parent_node_id,
    root_parent_node_id,
    service_key,
    service_version,
    service_type,
    service_resources,
    service_additional_metadata,
    started_at,
    stopped_at,
    service_run_status,
    modified,
    last_heartbeat_at,
    service_run_status_msg,
    missed_heartbeat_counter
)
SELECT
    product_name,
    service_run_id,
    wallet_id,
    wallet_name,
    pricing_plan_id,
    pricing_unit_id,
    pricing_unit_cost_id,
    pricing_unit_cost,
    simcore_user_agent,
    user_id,
    user_email,
    project_id,
    project_name,
    node_id,
    node_name,
    parent_project_id,
    root_parent_project_id,
    root_parent_project_name,
    parent_node_id,
    root_parent_node_id,
    service_key,
    service_version,
    service_type::text::resourcetrackerservicetypeosparciohistory,
    service_resources,
    service_additional_metadata,
    started_at,
    stopped_at,
    service_run_status::text::resourcetrackerservicerunstatusosparciohistory,
    modified,
    last_heartbeat_at,
    service_run_status_msg,
    missed_heartbeat_counter
FROM resource_tracker_service_runs;

Related issue/s

• relates move of osparc.io: make db tables ready for merging osparc-issues#1867
• relates Reducing Overhead Costs by Merging Deployments (Aug. -> Feb) osparc-issues#1652

How to test

Dev-ops

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 88.77%. Comparing base (a5afe8d) to head (8c366e0).
Report is 1 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #7700      +/-   ##
==========================================
+ Coverage   88.00%   88.77%   +0.77%     
==========================================
  Files        1845     1552     -293     
  Lines       71182    61207    -9975     
  Branches     1220      546     -674     
==========================================
- Hits        62645    54338    -8307     
+ Misses       8185     6725    -1460     
+ Partials      352      144     -208     

Flag	Coverage Δ
integrationtests	62.77% <ø> (-1.50%)	⬇️
unittests	87.43% <100.00%> (+0.83%)	⬆️

Components	Coverage Δ
api	76.84% <ø> (ø)
pkg_aws_library	∅ <ø> (∅)
pkg_dask_task_models_library	∅ <ø> (∅)
pkg_models_library	93.25% <ø> (ø)
pkg_notifications_library	85.26% <ø> (ø)
pkg_postgres_database	86.57% <100.00%> (-1.62%)	⬇️
pkg_service_integration	∅ <ø> (∅)
pkg_service_library	∅ <ø> (∅)
pkg_settings_library	∅ <ø> (∅)
pkg_simcore_sdk	77.51% <ø> (-7.54%)	⬇️
agent	96.29% <ø> (ø)
api_server	92.31% <ø> (ø)
autoscaling	96.03% <ø> (ø)
catalog	92.29% <ø> (ø)
clusters_keeper	99.13% <ø> (ø)
dask_sidecar	91.79% <ø> (+0.22%)	⬆️
datcore_adapter	97.94% <ø> (ø)
director	76.73% <ø> (ø)
director_v2	90.66% <ø> (-0.44%)	⬇️
dynamic_scheduler	96.69% <ø> (ø)
dynamic_sidecar	90.09% <ø> (ø)
efs_guardian	89.65% <ø> (ø)
invitations	93.00% <ø> (ø)
payments	82.11% <ø> (-10.46%)	⬇️
resource_usage_tracker	86.28% <ø> (-2.73%)	⬇️
storage	77.66% <ø> (-9.95%)	⬇️
webclient	∅ <ø> (∅)
webserver	87.41% <ø> (-0.19%)	⬇️

---

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a5afe8d...8c366e0. Read the comment docs.

🚀 New features to boost your workflow:

• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[sanderegg]

did you try with the DBs already?
thanks!

[mrnicegyu11]

I dont fully get what happens in this PR (what is CASCADE?) or the introduction of the zzz_resource_tracker_service_runs__osparc_io_archive_202508 table, but I also dont see blockers. :--)

[pcrespov]

thx. Please double check mycomments. Specially theone of user_id

[pcrespov]

can perhaps also delete user_to_projects table?
Double check whether there are other tables that are not used....
TIP: Just check for references to the table variable with Vscode

[sonarqubecloud]

Quality Gate passed

Issues
2 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud