Skip to content

Suggest a single robust improvement for training qwen edit script's code #68

@shawnfd

Description

@shawnfd

Problem description:
Around the precompute_text_embedding/precompute_image_embedding, both processors would access the code section and use the full dataset lists. That cause some collision when writing to a same filename, which can halt the training sometimes/randomly.
Solving:
1. add a line of code ---->if accelerator.main_process_first():
(just under if args.precompute_image_embeddings: or if args.precompute_text_embeddings:)
2. add 4 extra SPACE to the code section following the precompute conditioins.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions