I was pulling the openai/evals repo and trying to running some of the examples. The repo uses git-lfs, so I installed that to my system using home-manager.

{ config, pkgs, ... }:
let
    systemPackages = with pkgs; [
        # ...
        git-lfs
        # ...
    ];
in
{
    programs.git = {
        enable = true;
        lfs.enable = true;
        # ...
    };
};

After applying these changes, I could run

git lfs install
git lfs pull

to populate the jsonl files in the repo and run the examples.