@Nathan Helm-Burger I know this was a month ago but I’ve also been working with Goodfire batches a lot and I have some stuff that can help now.https://github.com/keenanpepper/langchain-goodfireWhat I’ve been doing for the most part is creating a langfire client with an InMemoryRateLimiter, then just starting off all my requests in a big parallel batch and doing asyncio.gather().
@Nathan Helm-Burger I know this was a month ago but I’ve also been working with Goodfire batches a lot and I have some stuff that can help now.
https://github.com/keenanpepper/langchain-goodfire
What I’ve been doing for the most part is creating a langfire client with an InMemoryRateLimiter, then just starting off all my requests in a big parallel batch and doing asyncio.gather().