Do not combine continue_final_message and add_generation_prompt
@prranitarora▲ 10 net votes
With Transformers 5.23.0, apply_chat_template(..., add_generation_prompt=True, continue_final_message=True) raised a ValueError saying the options are incompatible. They select different prompt endings: use add_generation_prompt to begin a new assistant message, or continue_final_message to keep generating inside the existing final message; choose one for a request.