6 Commits

Author	SHA1	Message	Date
Alex Cheema	ea70c9fb76	reformat with yapf format.py	2024-08-22 14:05:43 +01:00
Alex Cheema	2084784470	per-request kv cache, remove all explicit reset functionality as it wasnt used. fixes #67	2024-07-25 17:09:34 -07:00
Alex Cheema	54c98607ef	more robust grpc discovery with asyncio and proper error handling, add flops to device capabilities. fixes #23 and progress on #33	2024-07-18 19:06:23 -07:00
Alex Cheema	1d5c28aed4	(partially) restore exo node equality by forwarding prompts to the dynamically selected head	2024-07-15 22:59:00 -07:00
Alex Cheema	e17905e295	add global reset	2024-07-15 22:35:54 -07:00
Alex Cheema	a009f7d608	move examples to examples dir	2024-07-14 23:48:20 -07:00