Skip to content

A Fatal Error in the Evaluation Phase #5

@Troy-Cao

Description

@Troy-Cao

Hi, when I run the command $ python sec_eval.py --model_type lm --model_dir 2b --output_name sec-eval-2b-lm to evaluate the security of the original LLM, I encounter the error info FileNotFoundError: [Errno 2] No such file or directory: '/file/experiments/sec_eval/sec-eval-2b-lm/trained/cwe-089/0-py/orig_codeql.csv' (as I changed the output_dir to "file"), which seems to originate from the fatal error when using the CodeQL to check for the security of the generated codes, "A fatal error occurred: ../codeql/codeql-repo/python/ql/src/Security/CWE-089/SqlInjection.ql is not a .ql file, .qls file, a directory, or a query pack specification.". It seems that I need to change the "../codeql..." to the current file path. I would appreciate your advice on changing that and solving the problem. Looking forward to your reply. Cheers!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions