scalaer
V2EX  ›  问与答

写了一篇 blog 关于 langchain llm streaming

  •  
  •   scalaer · Oct 18, 2023 · 794 views
    This topic created in 963 days ago, the information mentioned may be changed or developed.

    Langchain 通过 callback 机制,可以将 LLM 输出的 token 实时处理. 同时支持同步 IO 和异步 IO 的方式来输出 token ,分别对应 StreamingStdOutCallbackHandler 和 AsyncIteratorCallbackHandler

    Langchian LLM Streaming

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   2904 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 30ms · UTC 09:12 · PVG 17:12 · LAX 02:12 · JFK 05:12
    ♥ Do have faith in what you're doing.