Here's a mega guide on keeping costs low with LLMs - https://portkey.ai/blog/imp...

		roh26it on July 19, 2024 \| parent \| context \| favorite \| on: Ask HN: Devs using LLMs, how are you keeping costs... Here's a mega guide on keeping costs low with LLMs - https://portkey.ai/blog/implementing-frugalgpt-smarter-llm-u... tl;dr: - Keep prompts short, combine prompts or make more detailed prompts but go to a smaller model - Simple and semantic cache lookups - Classify tasks and route to the best LLM using an AI gateway Portkey.ai could help with a lot of this

came across this guide earlier - valuable insights. thanks for sharing!