Thought Eddies

TIL

Using `llm` to handle large input context

Today, I ran into an issue where I wanted to use repomix to pack a large codebase into a single file to pass to an LLM, but I couldn't paste the output into any of the UIs I typically use. The React apps all became sluggish as I waited for ~500,000 tokens to paste.

TIL

Git Worktree

These days I use agents that write code often. When I am trying to build a new feature, I first write a markdown spec, then point the agent at it and send it on its way.

Posts

Create a Link Blog

RSS feeds for blogs and things you write or create are great. If you read a lot, you probably also have a lot of articles you've read that you share with others and occasionally revisit.

Posts

LLM Chat UI Concepts

A few concepts for LLM chat UIs

To write this post, I was going to take myself through some of the history of different chat interfaces. This is not that post. I was too impatient and decided to go in without any appreciation for prior art (beyond what I'm already aware of), because it seemed more fun at the time.

Posts

Models as Force Multipliers and their Limits in Software Development

You need to use models to build software to really understand their limits

I'm on a flight and wanted to write code to work on an idea. After a few moments of shifting mental gears, I popped open Zed, which allows me to code with a local LLM using ollama. My default impulse when writing code is to prompt a model. At first, I felt somewhat negative about this but with...

Posts

Goose as a Task Runner

Goose is a CLI language model-based agent. Goose exposes a chat interface and uses tool calling (mostly to invoke shell commands) to accomplish the objective prompted by the user. These tasks can include everything from writing code to running tests to converting a folder full of mov files to...