LessWrong Feed [new, now in beta]
The modern internet is replete with feeds such as Twitter, Facebook, Insta, TikTok, Substack, etc. They’re bad in ways but also good in ways. I’ve been exploring the idea that LessWrong could have a very good feed.
I’m posting this announcement with disjunctive hopes: (a) to find enthusiastic early adopters who will refine this into a great product, or (b) find people who’ll lead us to an understanding that we shouldn’t launch this or should launch it only if designed a very specific way.
You can check it out right now: www.lesswrong.com/feed
From there, you can also enable it on the frontpage in place of Recent Discussion. Below I have some practical notes on using the New Feed.
Note! This feature is very much in beta. It’s rough around the edges.
Why have a “feed”?
Far more than with other LessWrong feature announcements[1], I find myself starting to write this one from a defensive place: no, this feed is good actually.
The modern internet seems to have converged on feeds as a content presentation format that engages people effectively. There’s the Facebook newsfeed, Twitter, Insta, TikTok, Substack, etc. I think these feeds are rightly regarded with suspicion – I think it’s half that inherently the form factor, by being easier to consume[2], tempts you away from other content forms you more endorse spending attention on, e.g. reading a proper book. The other half is that the feed operators, via their chosen algorithms, are out to get you. They want you addicted, spending as much time as you can rather than spending the optimal time to get the optimal amount of content at high efficiency on your attention.
Why then should LessWrong get in on this game?[3] Well, because feeds actually have some useful properties as a way of finding and consuming content:
1. It’s quick and easy to sample content at varying depths (e.g just read the title, read a sentence, read a paragraph) when choosing what to read. In contrast with a posts list, you only have the title, karma, author to go by unless you click into it or read the hover-preview (finicky and not present on mobile).
2. From a UI-perspective, it’s easy to present many different kinds of content. Current LessWrong is crammed with sections: there’s the section with a list of posts, quick takes, popular comments, featured content, and then you have pages for wikitags, events/community, sequences, your bookmarks, stuff you started reading but didn’t finish, etc. With luck, a user will find and look at the sections of interest to them. Yet I don’t think we have that much luck and users miss a lot of stuff they’d like to have seen.
With a feed, you get a single place to focus your attention and we can serve up our best guess of what you’d like to see: here are some of the latest posts on topics you like, and by the way, here’s an event in your area you might like, also gentle reminder you bookmarked some stuff last week, and PSA here are some standout imported wiki pages from Arbital. Due to the nature of a feed, it’s easy to skip and it’s easy for us to learn what you do and don’t like[4].
To me, this is a lot of the promise of feeds. It makes it a lot simpler to present users with content of interest across diverse content types.
3. There are various conversations that seem good for people to be having that aren’t and shouldn’t be tied to a single post and being in its comments section. Someone writes a paragraph or two and then people discuss it. Twitter is where I see this happening, sometimes well. LessWrong’s Quick Takes move us in that direction too and we get some of it.
My feeling is that feeds are a good way for people to continue to participate in and follow along ongoing conversations. You open the feed, and it shows you the latest in the threads you were engaging in.
Contrast: a few months ago I subscribed to comments on a few LessWrong users[5]. Previously I’d subscribed to posts by some authors and this generated a small manageable number of notifications. Not so with comments. Suddenly my notifications drawer was filled with comments. I wanted to read them, but it wasn’t a great experience[6]. I realized that what I really wanted was a feed of comments by users who typically wrote comments I wanted to see.
Making Our Feed Good Actually
Incentive-wise, I think LessWrong escapes the worst of the pressures to make an addictive feed but perhaps not all of them. There’s no direct monetization of user attention whereby marginal scrolls equate strongly to marginal dollars. That said, donors are fond of activity graphs going up and I personally get clout if I can boast that the feature I built was highly successful.
Beyond claiming that there’s less incentive to be terrible, there are two principles I’ve followed so far in the design of the LessWrong feed that I think help.
Transparency. I’ll tell you how the algorithm is deciding what to show you[7], and you can decide/complain if you think it’s not working in a way you endorse.
Control. Beyond transparency, the user has a lot of ability to change what the feed shows and customize.
Encouraging longform content creation and consumption. I elaborate in the next section.
There are pressures against 1 and 2, supposing they’re even helpful. First, very few users adjust settings even when it would give them something they like more, so the LessWrong team still has to choose defaults. Second, in the long-term I think algorithmic output quality might be improved by using relatively opaque AI/ML methods as opposed to the simple dumb rules the current system uses, and that makes transparency harder.
A model of feeds taking over and why that’s bad
Suppose that as you consume content (written, audio, visual, etc), you experience enjoyment on a zero to ten scale[8]. I think what we have observed over decades is a trend towards shorter and shorter content with more concentrated peaks of reward. Movies replaced by TV episodes replaced by 5-minute YouTube videos replaced by 15-second TikTok reels. Books replaced by comics replaced by tweets and memes. Food has gotten sweeter (higher caloric density) and content has too.
Rather than watch a 5-minute YouTube video with a single reward high of “8”, a person can watch 10 TikTok reels with rewards like [2, 5, 9, 3, 7...] and get some nice intermittent reinforcement gambling action in there too. The format allows you to stop engaging with one piece of content and seek another very cheaply as soon as you are bored.
I can see this being in fact very bad. I think that for some content, the payoff requires you to wade through some effortful or less rewarding set up. If people are trained to bounce off of that and jump to more readily rewarding content, people lose the ability to stick through the harder stuff and there’s less reward for creating it.
Even if you suppose that all content could be made short and punchy and high-reward-density, it is still not good to put such a strong selection pressure on that over other things like is your content valuable, well-explained, etc.
The other content platforms are entirely happy to engage in Molochian destroying-everyone’s-general-intelligence games in exchange for money since, after all, it works. At least in the moment, users “want” higher density reward and opt for that. And if your platform doesn’t do it, you lose out to those who do.
It’s this kind of model that makes me wonder if LessWrong shouldn’t join the party. You can’t just use the One Ring for good. But I don’t know.
If people would like to mindfully try out the New Feed and other feeds they use, and report back on the experience, that’d be swell.
The third principle I’ve had in mind with design of the feed so far is to make it so the feed facilitates doing long-form content consumption even when habitually using the feed. This means things like:
The feed makes it easy to read long comments seamlessly, we’re not punishing content longer than N characters, etc.
It’s easy to launch into reading a long post or comment mid-feed, either in-place, in a nice popup view, or with navigation in a way that if you leave, you’re not worried about losing your place
While the feed contains quick takes and comment threads, a lot of what we’re recommending is long form content such as posts, sequences, long good wikitags, like those imported from Arbital.
Another direction I’m keen on is using the Feed as a place to remind people of content they’ve bookmarked but haven’t read yet, or stuff they started reading but didn’t finish (either a long post or not finishing all posts in a sequence). LessWrong has had a (not that successful) Continue Reading section that I think just needed more iterations rather than it was a bad idea (proof: Kindle and Netflix have “continue reading” sections that people do use).
Metrics-wise, I’d more want to target “time spent consuming LessWrong content that was initiated from the feed”[9] and “how quickly engaging with the feed led to someone reading something substantive” rather than just “time spent on the feed itself”. This is saying the feed should function a lot as content discovery mechanism rather than solely as a final destination.
Unregretted User Minutes
Unregretted user minutes seems like a good metric if you can measure it well. I have some confidence that LessWrong users can judge after the fact whether they endorse time they spent doing something or not.
I think it’s not crazy that after N minutes or M items in your feed, you get a card which polls you on how you’re feeling about your feed usage. This over time can be monitored as a signal as we make changes to the feed.
It’s really my least favorite argument, but perhaps it’s still valid to say that given LessWrong is competing for people’s attention with Twitter, etc., we should have a feed too. I don’t like it, but also personally when it’s late in the evening and I’m unwinding, I find I like having the LessWrong feed as an alternative to e.g. Twitter. It makes me think of how we’re often told that people say “LessWrong is the form of procrastination they feel least bad about”.
Proceeding with Caution
I think there’s reason to proceed but do so with caution. I feel like LessWrong’s current content-discovery mechanisms and user attention guidance are inadequate and are not getting people to see everything they’d want to see. Feeds have promise. I have enough hope to try doing a feed and hope to execute it with enough good judgment and integrity that it’s pretty great.
Practical Tips about the New Feed
You can try out the new (very much still under construction) LessWrong feed at: https://www.lesswrong.com/feed
I’m seeking beta users who are interested in regular interviews/chats about what is and isn’t working in making this a valuable feature. Please comment or message if you are.
Avoiding Confusion
Great products are self-explanatory and don’t require manuals, walkthroughs, etc. Unfortunately, I don’t think The Feed has hit that bar yet, so here are some things you might want to know:
Branching Comments Linear Slices
The LessWrong feed [currently] makes an opinionated choice about how to display comments. While comment threads by nature branch, the feed only ever displays a single “slice” (parent-child-grandchild-greatgrandchild) in one block. I believe this makes the reading experience a lot more straightforward. Other branches can be accessed by clicking on the comment icon (that has count of direct children), or waiting for other branches to appear in the feed[10].
Choose How Much Text To Display
A big question for the feed is how much content to display by default (e.g if a comment is 657 words, how many do you show?) and what the expand/read more behavior is.
At this stage, I’ve made this highly configurable so early adopters can experiment and help me figure out what works best as a default. You can adjust these in the New Feed settings.
Following/Subscribing
This is not currently emphasized, but LessWrong and the feed support subscribing/following and following users. Anyone you follow is by default more likely to show up in your feed and the settings allow you to increase how heavily they show up.
Although I haven’t made it, I think there’s merit to having a “Following”/”Subscribed” feed view where it’s only content from people you follow[11]. If nothing else, it means people have an easy alternative if they don’t like the recommendations you’re giving them. I might want to add this.
I anticipate that the new feed will supercede the Subscribed tab. Following or subscribing to a user in any form will treat you as following them for purposes of display in the new feed.
Settings, Settings Everywhere
The settings menu currently offers a lot of choice, though I eventually expect to figure out good defaults and hide or hardcode the settings.
As per the title, this feature is in beta and I’m seeking feedback. Any and all appreciated! And remember this is LessWrong: we put the doom in doomscrolling.
- ^
With the exception of announcing that we are experimenting with the frontpage posts list including suggestions by a recommender system – something closely related in spirit to this feature.
- ^
Feeds are eminently “low-brain” compatible.
- ^
We are trying to not be evil.
- ^
There are dangers here that I hope are navigable.
- ^
- ^
In the notifications drawer it’s either with an easy to lose hover or you’re expensively navigating away, plus it’s harder to get context on any comment.
- ^
At this time, the feed is very transparent with the exception of suggested posts drawn from the ~opaque recommendation engine that also fuels the Enriched and Recommended post lists. That engine is pretty good and there are worlds in which we use across other content too, or something like it.
- ^
Or better yet a minus ten to ten scale to allow for anti-enjoyment but that’s not important for this argument.
- ^
i.e. minutes spent reading on the feed + minutes spent reading a post you opened from the feed.
- ^
If a comment thread with multiple branches deemed of interest, the feed is likely to eventually show them all. Parent comments that have been seen will be collapsed/deemphasized.
- ^
Personally, on Twitter I go back and forth between “For You” and “Following” with it being a toss-up on what has better content.
Thread for feedback on the New Feed
Question, complaints, confusions, bug reports, feature requests, and long philosophical screeds – here is the place!
Clicking an inline-react control for a comment shown in overlay can cause the picker box to appear partially off the edge, and (presumably due to something about how it’s not a normal top-level scroll context) I can’t (usually? always?) scroll horizontally/vertically to reach all the contents.
Without having made much adaptation effort:
The “open stuff in a modal overlay page on top of the feed rather than linking normally, incidentally making the URL bar useless” is super confusing and annoying. Just now, when I tried to use my usual trick of Open Link in New Tab for getting around confusingly overridden navigation on the “Click to view all comments” link to this very thread, it wasn’t an actual link at all.
I don’t know how to interpret what’s going on when I’m only shown a subset of comments in a feed section and they don’t seem to be contiguous. Usually I feel like I’m missing context, fumble around with the controls that seem related to the relationships between comments to try to open the intervening ones, still can’t tell whether I’m missing things (I think the indentation behavior is different? How do I tell how many levels there are between two comments that look like they have a parent^N relationship?), and wind up giving up and trying to find a good thread parent to see in its entirety.
Cheers for the feedback, I apologize for confusing and annoyingness.
What do you mean by “makes the URL bar useless”? What’s the use you’re hoping would still be there? (typing in a different address should still work
The point of the modals is they don’t lose your place in the feed in a way that’s hard technically to do with proper navigation, though it’s possible we should just figure out how to do that.
And ah yeah, the “view all comments” isn’t a link on right-click, but I can make it be so (the titles are already that). That’s a good idea.
All comment threads are what I call a “linear-slice” (parent-child-child-child) with no branching. Conveying this relationship while breaking with the convention of the rest of the site (nesting) has proven tricky, but I’m reluctant to give up the horizontal space, and it looks cleaner. But two comments next to each other are just parent/child, and if there are ommitted comments, there’s a bar saying “+N” that when clicked, will display them.
Something I will do is make it so the post-modal and comments-modal is one, and when you click to view a particular comment, you’ll be shown it but the rest will also be there, which should hopefully help with orienting.
Thanks again for writing up those thoughts!
The URL is externalized mental context on which article I’m currently viewing, and it’s also common for me to copy the link out to use elsewhere. Previously it would stay the URL of the front page—I think that’s been changed since I wrote that, though.
Yeah, though as a desktop browser user, I already have a well-practiced way of doing that, which is to open stuff in new tabs if I want to keep my place. I would imagine doing a pre-link-following replacement of the history state to include an anchor that restores my position on Back would allow true top-level navigation here? Or, stashing the “read up to X so far” state somewhere seems to be a common thing. (You’ve presumably thought of all that already.)
Yeah, I figured it out eventually. It does seem tricky to get a good presentational design here; I don’t know of a great way to convey that difference in context, and I do feel like it’s awkward to remember the distinction or have to flip between the formats mentally when navigating around. Maybe if the visual frames were more distinct from the kind used in the nested-comments interface it’d be easier to remember that the chain isn’t siblings?
Thanks for continuing to try to improve the site!
it recommended me drama things I hadn’t seen otherwise. I’d suggest that it should be biased away from drama things, eg by one of the ranking weight factors being dot product with some prototypical drama examples. I’ve had a lot of success with that on my https://www.graze.social/ custom feeds.
I’m curious for examples, feel free to DM if you don’t want to draw further attention to them
As of today, the feed decided to present me with five year old posts (with few new comments mixed in; checking if a pair of them were duplicates, I noticed that they weren’t and found out a comment-based poll in https://www.lesswrong.com/posts/QBhoBJAxDHHuC7BeH/poll-on-de-accelerating-ai). That was quite interesting, and down that way lay discussions about curi.
That may be unhealthy amount of drama highlighted, but it showed, like, depth of the LW community history, which I saw a bit shallower. Meta-point from back there (about optimally ending discussions) seems like it ties into the recent discussions...
Currently I see the feed as tool to see new content faster and, correspondingly, to see more in total. It means a deficit of closure, though, of some functionality like “this post tries to summarize / amend and supersede / highlight gaps in / agree with an earlier bunch of work” (the said body of work being more than one early post, to eventually conclude this graph).
Seeing this comment in the update feed, I clicked “read 592 more words”. It opened an overlay which scrolled to a mostly-collapsed (as in, single-line-per-comment display) thread, of which the only non-collapsed comment was a completely different one. After a few tries, I noticed that there was a temporary, subtle highlight of the left bar of one of the collapsed comments, which turned out to be the one I’d clicked on originally. I imagine this was meant to implicitly expand the target…
Maybe it should inherit the current choice of page suggestion algorithm at the top of the page? I generally only want to see the most recent posts and having 3+ yr old posts appear was very confusing to me until I realised what had happened.
I’ve tried to get used to it, but it still feels significantly worse to me. Not quite sure why, I think the UI feels a bit busier which is part of it, but I think it’s mainly because it feels like it’s trying to control what I see in a way I don’t like.
The feed should display the post, if it chooses it at all, above (or together with) the comment from there.
Ah yeah, that’s pretty silly (the cards are randomly sampled currently so just silly luck to have them ordered like this).
Using the space bar to scroll in overlay puts the next line of text underneath the slightly-transparent header so that I have to adjust backward to see it, often after reading a few words from the wrong spot and getting confused. (Edited to add: okay, obviously not so often after I recognized the pattern, but I’m prospectively amused that if/when this gets changed I’ll have to adjust the habit a second time.)
(Is this what frontend Web development is just like? Should I pawn off as much of it as possible on AI in the future? Will that work, or will it drive the AI mad? Or will I be insufficiently inured when I have to dive in and fix a bug that it can’t handle, and then I’ll lose a day gibbering, thus canceling out the time and sanity saved?)
I just coded a fix for this, will get deployed soon.
Huh, I never scroll that way but I see what you mean. I’ll see what I can do.
Yeah, frontend web development is a lot like this. The current AIs are both stateless, already mad, and seemingly indefatigable though get a bit loopy the longer the conversation goes on. You feed them $$ and sanity points and problems get solved faster, hopefully. There’s sometimes sanity saved when debugging something gnarly, but in the regular course of things you (or at least I) am spending mine down. (It doesn’t matter how many times I ask it not to, Claude Opus 4 will revert to saying “you’re absolutely right!” about everything.) Move over autistic savant, we got alzheimers savant now.
(sorry for the snark, but I’m guessing leaving user emotions in during UX testing is valuable)
I just did the following:
Clicked on this answer to this post in the feed, which expanded the context to show the first part of the post itself.
Clicked on the title of the post in the expansion, which opened the whole thing in the post-over-feed overlay—or so I assumed.
Got terribly confused when the answer I’d originally gotten there from was absent. In fact, there was no indication of it being a question-type post—it was presented as though it were a basic article, with the comment section present but the answer section just missing!
Navigated to the original post in a new tab and facepalmed real hard.
This reeks of underlying fragility and has destroyed my confidence that the overlay is implemented in a way that will keep continued track of how posts are actually supposed to be presented. Until I see a “we refactored it so that it is now difficult to push changes that will desynchronize the presentation logic between these cases”, I’m going to have to assume it’s an attractive nuisance. 🙁
Edited to add: ah, I see dirk reported the same underlying issue—leaving this up in case the feeling/implication parts are still relevant.
This bug is at least fixed now! I await your next report, thanks.
Knowing user emotions is good! And it’s sometimes nice when people care enough to get mad. I’m working on fixing this now.
I’m afraid you’re right that the overlay does not automatically match the post page. Unfortunately it turns out a lot of complexity gets added because the overlway has its own scrolling context and I’m needing to make a lot of adjustment for that. Fortunately the core elements of the post page don’t really change, so once we’re matched it should stay matched.
Question answers don’t appear in the comments modal (or for that matter the entire-post modal).
This is fixed now. :)
True! That’s now next on my list.
I think this seems like it’s aiming addiction machine and it’s immoral.EDIT: I just saw “Choose how much the feed prioritizes content based on your past engagement versus popular or new content.”—this seems quite good and make the thing much less immoral!
EDIT2: just saw that there’s much more ability to customize—updated to this being pretty nice, potentially
EDIT3: saw the ‘Incognito mode’ - this is very good, I like that a lot
In the modal, when I’m writing a comment and go to add a link, hitting the checkmark after I put in the URL closes the modal.
This should be fixed now.
Seems to be working! Thanks for the fix :)
Oh, indeed. That’s no good. I’ll fix it.
I click “(read more)” and it seems to have no function. On Windows 11/Chrome, reproducible.
Huh, that’s pretty odd and not good. I’ll look into it. Any other buttons or interactions that do nothing?
Just tried all other buttons, none on my end!
All buttons within the feed don’d do anything, but other buttons on the site do? That’s very strange.
*Every non-”(read more)” button works as intended for me; i.e. none of the other buttons do nothing. Apologies if that was unclear.
The font for text in the New Feed is like 2pts larger than the feed on the rest of LW on mobile, which feels somewhat jarring
I agree it’s a stark difference. The intention here was to match other sites with feeds out of a general sense that our mobile font is too small.
If you wanted to choose one font size across mobile, which would you go for?
I prefer smaller font but I’m also young, like information density, and don’t have presbyopia, so idk how representative my preferences are
Also, I don’t like that if I click on the post in the update feed and then refresh the page I loose the post
Oh, very reasonable. I’ll have a think about how to solve that. So I can understand what you’re trying to do, why is it you want to refresh the page?
i.e. to see fresh comments
It might be that I have smth wrong with the internet but this beige widget isn’t loading
Oh, that’s the audio player widget. Seems it is broken here! Thank you for the report.
The new feed doesn’t load at all for me.
Hmm, that’s no good. Sorry for the slow reply, if you’re willing I’d like to debug it with you (will DM).
It’s working now. I think the problem was on my end.
I’ve been having a decent time using this for my LW frontpage for the past few weeks! Biggest improvement is just the average content quality compared to recent discussion which is strictly recency sorted, whereas this tends to more reliably show me stuff I want to read and haven’t read yet.
I’m usually a rss user but I’ll give this a try
I prefer the current rss. However, if this feed provided a customized rss link, I would see value in using it to set filters on the content that the current rss provides.
Hope this goes well!
random pitch but—maybe add anki integrations for extra nutritious content?
The idea seems cool but the feed doesn’t work well on my phone. It cuts the sides of the text which makes things unreadable. (I have a Samsung)
Hopefully fixed now. Also when enabled on the frontpage should work there regardless.
Oh bummer, which Samsung. Can you share a screenshot here or Intercom?
It’s Galaxy A54.
I’m not sure how to share screenshots on mobile on LW 😅
I also have the same issue, I got a Samsung S21 5G
Here’s the screenshots showing how much the sides are cut off
https://imgur.com/a/kRk2Jsd
Hopefully fixed now. Also when enabled on the frontpage should work there regardless.
Huh, that’s really cut off indeed. This doesn’t happen on any other LessWrong pages?
Nope! It looks as intended on all other pages that ive opened prevopusly, but I’m not a LW power user on my phone
Also have this issue on galax s24. (And not on other parts of the website)
Hopefully fixed now. Also when enabled on the frontpage should work there regardless.
I think a feed could be very good in principle. However, I’m worried that the feed design may in effect give an advantage to short-form content over long-form content. My perspective is that a big part of what’s made LessWrong so great is that the conversation is centered on posts a few thousand words long. (I see this length as a good compromise between various factors.) If the feed consists of “links to things a few thousand words long” right next to “short-form stuff right in the feed”, I think those the short-form stuff is likely to out-compete the long-form stuff, and I think that would be unfortunate.
I appreciate the effort to avoid the usual downsides of feeds. But your arguments that this feed will be good actually don’t persuade me. I already spend more time than I endorse on LessWrong, especially since the introduction of quick takes.
I wonder if a built-in version of aspects of Freedom might be a good idea: i.e. we make it so you can restrict your ability to look at Quicktakes or other sections of the site to an amount you endorse.
Yeah that would be great!
I would like for this to be configurable in settings.
> It’s really my least favorite argument, but perhaps it’s still valid to say that given LessWrong is competing for people’s attention with Twitter, etc., we should have a feed too.
I don’t think this should be a reason—to me, a good reason for a feed would be having a really good recommendation algorithm that can find useful things for people they wouldn’t normally come across.
I think it needs an easy way to indicate that you don’t want to read the rest of a post. Ideally this would be automatic but I don’t know how to do that.
Also, it sometimes offers posts that I did finish.
Could this be a bluesky/AT Pro feed?