This is a great point. Context size has a large impact on memory requirements an... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		jmorgan on Nov 30, 2023 \| parent \| context \| favorite \| on: Llamafile lets you distribute and run LLMs with a ... This is a great point. Context size has a large impact on memory requirements and Ollama should take this into account (something to work on :)

insanitybit on Nov 30, 2023 [–]

Thanks for the work you've done already :D

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact