Colab code not working for ByteDance-Seed/Seed-OSS-36B-Instruct

[jenilsoni-ai]

!pip install --upgrade transformers

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ByteDance-Seed/Seed-OSS-36B-Instruct")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

-------------------------------------------------------------ERROR------------------------------------------------------------------

KeyError Traceback (most recent call last)
/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py in from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
1270 try:
-> 1271 config_class = CONFIG_MAPPING[config_dict["model_type"]]
1272 except KeyError:

3 frames
KeyError: 'seed_oss'

During handling of the above exception, another exception occurred:

ValueError Traceback (most recent call last)
/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py in from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
1271 config_class = CONFIG_MAPPING[config_dict["model_type"]]
1272 except KeyError:
-> 1273 raise ValueError(
1274 f"The checkpoint you are trying to load has model type {config_dict['model_type']} "
1275 "but Transformers does not recognize this architecture. This could be because of an "

ValueError: The checkpoint you are trying to load has model type seed_oss but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

You can update Transformers with the command pip install --upgrade transformers. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command pip install git+[https://github.com/huggingface/transformers.git](https://github.com/huggingface/transformers.git%60)

[silvacarl2]

i have the same issue.

[coyotte508]

cc @Vaibhavs10 maybe

[pcuenca]

I think support for this model was recently merged and has not made it to a release yet.

Installing transformers from source should work now:

!pip install --upgrade git+https://github.com/huggingface/transformers.git