ValueError: Trying to set a tensor of shape torch.Size([3072, 64]) in "weight" (which has shape torch.Size([3072, 384])), this looks incorrect.

[haozhuoyuan]

import torch
from diffusers import FluxFillPipeline
from diffusers.utils import load_image

image = load_image("https://huggingface.co/datasets/diffusers/diffusers-images-docs/resolve/main/cup.png")
mask = load_image("https://huggingface.co/datasets/diffusers/diffusers-images-docs/resolve/main/cup_mask.png")

pipe = FluxFillPipeline.from_pretrained("black-forest-labs/FLUX.1-Fill-dev", torch_dtype=torch.bfloat16).to("cuda")
image = pipe(
    prompt="a white paper cup",
    image=image,
    mask_image=mask,
    height=1632,
    width=1232,
    guidance_scale=30,
    num_inference_steps=50,
    max_sequence_length=512,
    generator=torch.Generator("cpu").manual_seed(0)
).images[0]
image.save(f"flux-fill-dev.png")

Traceback (most recent call last):
File "/workdir/flux/flask_flux_fill_demo.py", line 18, in
pipe = FluxFillPipeline.from_pretrained("/workdir/flux/checkpoints/flux_dev_fill", torch_dtype=torch.bfloat16).to("cuda")

File "/opt/conda/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)

File "/opt/conda/lib/python3.11/site-packages/diffusers/pipelines/pipeline_utils.py", line 924, in from_pretrained
loaded_sub_model = load_sub_model(

File "/opt/conda/lib/python3.11/site-packages/diffusers/pipelines/pipeline_loading_utils.py", line 725, in load_sub_model
loaded_sub_model = load_method(os.path.join(cached_folder, name), **loading_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/diffusers/models/modeling_utils.py", line 932, in from_pretrained
accelerate.load_checkpoint_and_dispatch(
File "/opt/conda/lib/python3.11/site-packages/accelerate/big_modeling.py", line 613, in load_checkpoint_and_dispatch
load_checkpoint_in_model(
File "/opt/conda/lib/python3.11/site-packages/accelerate/utils/modeling.py", line 1821, in load_checkpoint_in_model
set_module_tensor_to_device(
File "/opt/conda/lib/python3.11/site-packages/accelerate/utils/modeling.py", line 373, in set_module_tensor_to_device
raise ValueError(
ValueError: Trying to set a tensor of shape torch.Size([3072, 64]) in "weight" (which has shape torch.Size([3072, 384])), this looks incorrect.

Which big guy help me look at what problem, thank you, is it the environment, I have updated the diffusers and accelerate？