I’m wondering about best practices for pasting content from LW into LLM context.
I would like to have a QA with Claude about a set of posts, and seek a good text representation to paste into context. Web search APIs still seem a bit hit and miss, and think a custom solution could have value. Something like a ‘paste to markdown’ button would be ideal.
I actually have a prototype of “Claude/LLM integrated into LessWrong” that makes it easy to load LW content into the context. I could enable that for you but it’s actually on Claude 3.5, iirc. Should maybe update it, check that it still works well, and let people try it out.
Making it easy to export content though is an alternative.
Cool! Thanks Ruby! Yes, would be keen to play around with that! What sort of tech stack are you using for this?
Your idea of Claude-integration was super interesting—and got me thinking about how best to let arbitrary LLMs interface with LW/AF content. So I asked Claude about it—see this chat. Claude suggested that building a custom MCP server might be ‘straightforward’ - and would allow anyone using the Claude API to immediately use the MCP server to access a structured form of LW/AF output. It would be ideal to have this as a default/optional feature of the Claude web-interface, but that would require Anthropic’s buy-in. How excited are you about these directions?
Re making exporting easy: I think a ‘paste to markdown’ button would still/also be helpful—and that I’d use this a lot if available, even without LLM integrations. Do you think others would also be interested? / Is anyone else also interested?
I’m wondering about best practices for pasting content from LW into LLM context.
I would like to have a QA with Claude about a set of posts, and seek a good text representation to paste into context. Web search APIs still seem a bit hit and miss, and think a custom solution could have value. Something like a ‘paste to markdown’ button would be ideal.
I think this code from 2022 might be a good first pass, which I found linked from this comment thread.
Does this sound like a good idea?
If so, might Lightcone Infrastructure be interested in creating such a feature?
I actually have a prototype of “Claude/LLM integrated into LessWrong” that makes it easy to load LW content into the context. I could enable that for you but it’s actually on Claude 3.5, iirc. Should maybe update it, check that it still works well, and let people try it out.
Making it easy to export content though is an alternative.
Cool! Thanks Ruby!
Yes, would be keen to play around with that!
What sort of tech stack are you using for this?
Your idea of Claude-integration was super interesting—and got me thinking about how best to let arbitrary LLMs interface with LW/AF content.
So I asked Claude about it—see this chat.
Claude suggested that building a custom MCP server might be ‘straightforward’ - and would allow anyone using the Claude API to immediately use the MCP server to access a structured form of LW/AF output.
It would be ideal to have this as a default/optional feature of the Claude web-interface, but that would require Anthropic’s buy-in.
How excited are you about these directions?
Re making exporting easy: I think a ‘paste to markdown’ button would still/also be helpful—and that I’d use this a lot if available, even without LLM integrations. Do you think others would also be interested? / Is anyone else also interested?