Thought Eddies

TIL

Fireworks.ai OpenAI Compatibility

I've starting playing around with Fireworks.ai to run inference using open source language models with an API. Fireworks' product is the best I've come across for this use case. While Fireworks has their own client, I wanted to try and use the OpenAI Python SDK compatibility approach, since I have...

TIL

Python Coroutines

Exploring accidental synchronous blocking in asynchronous programming in Python with coroutines.

Python coroutines allow for asynchronous programming in a language that earlier in its history, has only supported synchronous execution. I've previously compared taking a synchronous approach in Python to a parallel approach in Go using channels. If you're familiar with async/await in JavaScript,...

TIL

Render Python Encodings Error

Render is a platform as a service company that makes it easy to quickly deploy small apps. They have an easy-to-use free tier and I wanted run a Python app with dependencies managed by Poetry. Things had been going pretty well until I unexpectedly got the following error after a deploy

TIL

Kubernetes Liveness Check

When deploying software with Kubernetes, you need to expose a liveness HTTP request in the application. The Kubernetes default liveness HTTP endpoint is /healthz, which seems to be a Google convention, z-pages. A lot of Kubernetes deployments won't rely on the defaults. Here is an example...