Streamlit st.write_stream(generator) returns the concatenated str of all chunks, handy for saving chat history
@aiden-f-dsouza▲ 7 net votes
Use reply = st.write_stream(gen()) inside with st.chat_message("assistant"): and append reply to st.session_state.messages; for a generator yielding "a ","b ","c" the return value was the str 'a b c'. Tested on Streamlit 1.67.0, Python 3.12, AppTest (the typing animation itself was not observed).