Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cleaner fails to remove randomforest.model/ #172

Open
bossie opened this issue May 24, 2022 · 0 comments
Open

cleaner fails to remove randomforest.model/ #172

bossie opened this issue May 24, 2022 · 0 comments

Comments

@bossie
Copy link
Collaborator

bossie commented May 24, 2022

Adding process 'e' without implementation
Adding process 'pi' without implementation
INFO:__main__:ConfigParams(): {'async_task_handler_environment': None,
 'batch_jobs_zookeeper_root_path': '/openeo/dev/jobs',
 'cache_shub_batch_results': False,
 'default_opensearch_endpoint': 'https://services.terrascope.be/catalogue',
 'is_ci_context': False,
 'is_kube_deploy': False,
 'layer_catalog_metadata_files': ['layercatalog.json'],
 's1backscatter_elev_geoid': None,
 'zookeepernodes': ['[epod-master1.vgt.vito.be:2181](http://epod-master1.vgt.vito.be:2181/)',
                    '[epod-master2.vgt.vito.be:2181](http://epod-master2.vgt.vito.be:2181/)',
                    '[epod-master3.vgt.vito.be:2181](http://epod-master3.vgt.vito.be:2181/)']}
INFO:__main__:removing batch jobs before 2022-03-25 03:00:02.394865...
INFO:openeogeotrellis.backend:Deleted job bontek/48a5da63-1aba-4c69-832a-87ddcd2785fb
INFO:openeogeotrellis.backend:Deleted job bontek/a7b2e8ad-673d-43e8-adb6-2d0f6179dd63
INFO:openeogeotrellis.backend:Deleted job bontek/579c64b6-451f-41e8-9648-874ee5115564
INFO:openeogeotrellis.backend:Deleted job vdboschj/a9461f0c-d56b-4f84-8055-2ed39bead9bb
INFO:openeogeotrellis.backend:Deleted job vdboschj/6aba63fe-0357-4b5e-ab9e-30e46745d056
INFO:openeogeotrellis.backend:Deleted job vdboschj/bd6de03b-7cc2-4e77-b5d5-2b2fa9a8a3c8
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/3cd0b952-eadf-4726-9830-9af4fc6dd090](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/3cd0b952-eadf-4726-9830-9af4fc6dd090)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/1d925597-c15c-4c8c-b380-4aee203dfad6](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/1d925597-c15c-4c8c-b380-4aee203dfad6)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/287c4227-0a42-4bda-bfe1-3059a2a8292a](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/287c4227-0a42-4bda-bfe1-3059a2a8292a)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/1b389f5d-a252-45c6-8872-6f42808e2e82](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/1b389f5d-a252-45c6-8872-6f42808e2e82)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/ed3d385a-ee8f-4037-a12f-50429bd4b8f3](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/ed3d385a-ee8f-4037-a12f-50429bd4b8f3)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/4f7d3949-a04d-4eff-99a9-8414df7c8e03](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/4f7d3949-a04d-4eff-99a9-8414df7c8e03)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/afd85099-ede6-4464-8526-ccbe0e0777ce](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/afd85099-ede6-4464-8526-ccbe0e0777ce)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/a7765ba9-6f02-44b5-81fb-a8b20b941422](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/a7765ba9-6f02-44b5-81fb-a8b20b941422)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/999a9b66-25f8-4771-9a5a-880fd5a3e14f](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/999a9b66-25f8-4771-9a5a-880fd5a3e14f)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/b5314ea6-9619-46f8-899e-d8fd66eb2a57](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/b5314ea6-9619-46f8-899e-d8fd66eb2a57)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/5a36cd6f-7e9c-4464-92c5-e6a1651dc392](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/5a36cd6f-7e9c-4464-92c5-e6a1651dc392)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/a1d0074b-f179-4c75-af3f-30b4b7d5c63c](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/a1d0074b-f179-4c75-af3f-30b4b7d5c63c)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/5f25d688-7336-4e7d-9e83-4410b5811f01](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/5f25d688-7336-4e7d-9e83-4410b5811f01)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/42c7b9f2-7346-4869-8bad-5dcfaebbe151](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/42c7b9f2-7346-4869-8bad-5dcfaebbe151)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/accbf35a-561f-4566-8cc6-26a6bb809d4f](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/accbf35a-561f-4566-8cc6-26a6bb809d4f)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/a6abdc33-6932-436c-8fba-e87874b45531](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/a6abdc33-6932-436c-8fba-e87874b45531)
INFO:openeogeotrellis.backend:Deleted job [af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/e591f8bf-281c-416f-80a8-2e230dd44b39](http://af0cbdbe992c057d157596dfbcf6e4f021f58d0c10e8e9ccaa30988cea558b62@egi.eu/e591f8bf-281c-416f-80a8-2e230dd44b39)
WARNING:openeogeotrellis.backend:Could not recursively delete /data/projects/OpenEO/d458856e-b315-4d13-a369-a2c86f3adaf2
Traceback (most recent call last):
  File "/opt/scripts/OpenEO/dev/venv/lib/python3.8/site-packages/openeogeotrellis/backend.py", line 1719, in _delete_job
    shutil.rmtree(job_dir)
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 718, in rmtree
    _rmtree_safe_fd(fd, path, onerror)
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 655, in _rmtree_safe_fd
    _rmtree_safe_fd(dirfd, fullname, onerror)
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 655, in _rmtree_safe_fd
    _rmtree_safe_fd(dirfd, fullname, onerror)
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 675, in _rmtree_safe_fd
    onerror(os.unlink, fullname, sys.exc_info())
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 673, in _rmtree_safe_fd
    os.unlink([entry.name](http://entry.name/), dir_fd=topfd)
PermissionError: [Errno 13] Permission denied: '_SUCCESS'
Traceback (most recent call last):
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/opt/scripts/OpenEO/dev/venv/lib/python3.8/site-packages/openeogeotrellis/cleaner.py", line 64, in <module>
    main()
  File "/opt/scripts/OpenEO/dev/venv/lib/python3.8/site-packages/openeogeotrellis/cleaner.py", line 59, in main
    remove_batch_jobs_before(max_date, java_gateway.jvm)
  File "/opt/scripts/OpenEO/dev/venv/lib/python3.8/site-packages/openeogeotrellis/cleaner.py", line 24, in remove_batch_jobs_before
    batch_jobs.delete_jobs_before(upper)
  File "/opt/scripts/OpenEO/dev/venv/lib/python3.8/site-packages/openeogeotrellis/backend.py", line 1802, in delete_jobs_before
    self._delete_job(job_id=job_info['job_id'], user_id=job_info['user_id'], propagate_errors=True)
  File "/opt/scripts/OpenEO/dev/venv/lib/python3.8/site-packages/openeogeotrellis/backend.py", line 1719, in _delete_job
    shutil.rmtree(job_dir)
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 718, in rmtree
    _rmtree_safe_fd(fd, path, onerror)
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 655, in _rmtree_safe_fd
    _rmtree_safe_fd(dirfd, fullname, onerror)
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 655, in _rmtree_safe_fd
    _rmtree_safe_fd(dirfd, fullname, onerror)
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 675, in _rmtree_safe_fd
    onerror(os.unlink, fullname, sys.exc_info())
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/shutil.py", line 673, in _rmtree_safe_fd
    os.unlink([entry.name](http://entry.name/), dir_fd=topfd)
PermissionError: [Errno 13] Permission denied: '_SUCCESS'

Workaround:

[vdboschj-admin@dataflow ~]$ cd /data/projects/OpenEO/d458856e-b315-4d13-a369-a2c86f3adaf2
[vdboschj-admin@dataflow d458856e-b315-4d13-a369-a2c86f3adaf2]$ sudo chmod -R g+w randomforest.model/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant