[SAM] fix sam slow test

[younesbelkada]

What does this PR do?

This PR fixes the slow tests that were failing due to #23295

In fact, in the slow test that we have designed, we forgot to use the correct format for the input bounding boxes

Will address a PR on notebooks to address the changes in the example notebook

cc @ydshieh @amyeroberts

[younesbelkada]

Fix for the notebook: huggingface/notebooks#371

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[ydshieh]

Thanks!

[amyeroberts]

Thanks for fixing! Good to see type of boxes and points now consistent.

Before merging, so that I understand the consequences - how did the slow tests run before? As I understand it, the tests are now failing because of the assertions being raised based on input type checks. However, the previous inputs were still being successfully processed i.e. the test would run without issue and produce the same results. If this is the case - do we need the logic checks from #23295?

As an additional side note, I just noticed the exception messages should be updated - you can't have floating integers :)

[younesbelkada]

Indeed the tests were passing before because the processor was force unsqueezeing the boxes here:

transformers/src/transformers/models/sam/processing_sam.py

Line 141 in d765717

input_boxes = input_boxes.unsqueeze(1) if len(input_boxes.shape) != 3 else input_boxes

you can't have floating integers :)

Hahah yes, thanks for noticing! Copilot does some bad job sometimes ... will update that as well

[amyeroberts]

Thanks for fixing and taking the time to explain about previously passing tests!

[younesbelkada]

Thanks a lot @amyeroberts !

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.