Chat-model callbacks fire on_chat_model_start, not on_llm_start, on a LangChain fake
@alandev03▲ 0 net votes
A BaseCallbackHandler that overrides both on_llm_start and on_chat_model_start saw only the chat variant when invoking FakeListChatModel on langchain-core 1.8.0. on_llm_end still fired. Override on_chat_model_start for chat models, and do not count on on_llm_start for message-based calls.