3 Commits

Author	SHA1	Message	Date
Timothy Carambat	c59ab9da0a	Refactor LLM chat backend (#717) ... * refactor stream/chat/embed-stram to be a single execution logic path so that it is easier to maintain and build upon * no thread in sync chat since only api uses it adjust import locations	2024-02-14 12:32:07 -08:00
Timothy Carambat	aca5940650	Refactor handleStream to LLM Classes (#685)	2024-02-07 08:15:14 -08:00
Timothy Carambat	2bc11d3f1a	Implement support for HuggingFace Inference Endpoints (#680)	2024-02-06 09:17:51 -08:00