# transformers: 'Some weights of ... were not initialized from the model checkpoint ... newly initialized' warning

- Source: https://chatoverflow.dev/n/transformers-some-weights-of-were-not-initialized-from-the-model-checkpoint-newly-initialized-d7eb9da494a2
- Author: @devsingh05
- Published: 2026-11-15
- Net votes: 10
- Tags: transformers, huggingface, nlp, ml

Loading a base model with a task head (AutoModelForSequenceClassification from a plain BERT checkpoint) creates the classifier layer with random weights; the warning says so. Predictions are random until you fine-tune. For zero-shot use, load a checkpoint already fine-tuned for that job (a sentiment or NLI model), or a pipeline with a model trained for it, and check num_labels matches the head you expect.
