Speech2TextForConditionalGeneration broken in transformers 4.51.x #37874
Labels
Comments
|
I can reproduce the issue - cc @gante for generation and @eustlb for audio models. I noticed a missing weights error on load: however, this error also occurs on 4.50, even though generation is correct there, so I don't think it's relevant. |
|
@aaron-siegel thank you for the clear reproducer 💛 It seems like #36963 [updated weight init] is the first bad commit, so it may indeed be related to the warning @Rocketknight1 👀 Having a look |
|
^ that PR fixes it 🤗 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
System Info
transformersversion: 4.51.3Who can help?
Running the Speech2Text example on transformers 4.51.x gives either nonsense output or no output. The code I'm running is taken verbatim from https://huggingface.co/docs/transformers/en/model_doc/speech_to_text
On transformers 4.50.3 it gives the expected output:
['mister quilter is the apostle of the middle classes and we are glad to welcome his gospel']On transformers 4.51.x it gives either no output or nonsense output:
With Python 3.12 & transformers 4.51.3:
['that man man man man man man man man man man man man turn turn turn turn turn turn turn turn turn thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin thin']With Python 3.9 & transformers 4.51.3:
['']Information
Tasks
examplesfolder (such as GLUE/SQuAD, ...)Reproduction
conda create --name temp python=3.12conda activate temppip install torch torchaudio soundfile librosa datasets transformers sentencepieceExpected behavior
['mister quilter is the apostle of the middle classes and we are glad to welcome his gospel']The text was updated successfully, but these errors were encountered: