[bug]: unable to inpaint in webUI using RunwayML inpainting model

[lstein]

Is there an existing issue for this?

• I have searched the existing issues

OS

Linux

GPU

amd

VRAM

32GB

What happened?

After setting the model to inpaint-1.5, I loaded a 512x512 IAI-generated image into the new Unified Canvas panel, masked out a region of the image, entered a prompt and pressed "Invoke". The render got all the way to the end and then errored out. In the terminal, the following traceback appeared:

>> Ksampler using karras noise schedule (steps < 30)
Generating:   0%|                                                                                                                                                        | 0/1 [00:00<?, ?it/s]>> Sampling with k_heun starting at step 0 of 20 (20 new sampling steps)
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [00:03<00:00,  6.09it/s]
Generating:   0%|                                                                                                                                                        | 0/1 [00:03<?, ?it/s]
'Omnibus' object has no attribute 'pil_mask'


Traceback (most recent call last):
  File "/data/lstein/InvokeAI/backend/invoke_ai_web_server.py", line 1116, in generate_images
    self.generate.prompt2image(
  File "/data/lstein/InvokeAI/ldm/generate.py", line 482, in prompt2image
  File "/data/lstein/InvokeAI/ldm/invoke/generator/base.py", line 91, in generate
    image = make_image(x_T)
  File "/data/lstein/InvokeAI/ldm/invoke/generator/omnibus.py", line 136, in make_image
    return self.sample_to_image(samples)
  File "/data/lstein/InvokeAI/ldm/invoke/generator/omnibus.py", line 166, in sample_to_image
    if self.pil_image is None or self.pil_mask is None:
AttributeError: 'Omnibus' object has no attribute 'pil_mask'

On another occasion, a similar sequence of actions resulted in a different message:

>> Ksampler using karras noise schedule (steps < 30)
Generating:   0%|                                                                                                                                                        | 0/1 [00:00<?, ?it/s]>> Sampling with k_heun starting at step 0 of 20 (20 new sampling steps)
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [00:03<00:00,  6.09it/s]
Generating:   0%|                                                                                                                                                        | 0/1 [00:03<?, ?it/s]
operands could not be broadcast together with shapes (512,320) (704,512)


Traceback (most recent call last):
  File "/data/lstein/InvokeAI/backend/invoke_ai_web_server.py", line 1116, in generate_images
    self.generate.prompt2image(
  File "/data/lstein/InvokeAI/ldm/generate.py", line 482, in prompt2image
  File "/data/lstein/InvokeAI/ldm/invoke/generator/base.py", line 91, in generate
    image = make_image(x_T)
  File "/data/lstein/InvokeAI/ldm/invoke/generator/omnibus.py", line 136, in make_image
    return self.sample_to_image(samples)
  File "/data/lstein/InvokeAI/ldm/invoke/generator/omnibus.py", line 169, in sample_to_image
    corrected_result = super(Img2Img, self).repaste_and_color_correct(gen_result, self.pil_image, self.pil_mask, self.mask_blur_radius)
  File "/data/lstein/InvokeAI/ldm/invoke/generator/base.py", line 140, in repaste_and_color_correct
    mask_pixels = init_a_pixels * init_mask_pixels > 0
ValueError: operands could not be broadcast together with shapes (512,320) (704,512)

The first traceback is reproducible. I haven't been able to recreate the second.

Screenshots

No response

Additional context

No response

Contact Details

lincoln.stein@gmail.com