Daniel V

Karma: 594

Daniel V 12 Jun 2026 15:01 UTC
3 points
1
on: Parkinson’s Heuristic: The Only Time To Do Anything
Related: The Mere Deadline Effect

Daniel V 30 May 2026 14:33 UTC
5 points
0
on: Data you could have observed but didn’t
Unobserved/unmeasured are equivalent in meaning but we might prefer tp say one over the other based on study type. Unmeasured pertains to when you could have taken a measurement (usually experiments or surveys), unobserved when you don’t have that in the data (usually secondary data). Either results in a column you wish you had, so they’re the same.
Omitted is when you turn to running a model. It is usually omitted because you don’t have the column, but you can omit a variable you do have in the data and then rectify that.
Missingness is completely different and is about cells, not columns, lacking data. “We are missing that data” is in line with the post but is not the same as the problem of “We have ‘missing data.’”

Daniel V 24 Feb 2026 15:38 UTC
1 point
0
on: Exponential GDP growth from linear growth in variety of goods

Even though the number of product categories is relevant to reconstructing GDP from deconstructed GDP, the number of product categories available is not Quantity in this equation, it’s n.

That’s why you’re not going to get “annual sales of Schmartphones would 60x over the time period, while maintaining constant GDP share” when the rest of the economy is growing at 0%. And why “The growth experienced by consumers however would be linear by any common sense understanding of the situation” is not true: the growth in the number of categories might be linear, but consumers would be buying exponentially more product value (quantity * price).

Daniel V 18 Feb 2026 20:46 UTC
2 points
1
on: Statistical Literacy
I appreciate an attempt to identify a new construct, but the thinking here is still too amorphous to benefit much from peer review.

I think the name for this construct needs help. “[Statistical literacy] is not about knowledge of statistical tools and techniques,” so why not call it something else? Contrast with literacy, graph literacy, numeracy, or lay rationalism. The construct definition is also missing:
This captures many of the things I think are covered by statistical literacy:
- It is not...
- It emphasises..
- It suggests...
- It tells...
Given that what the construct is hasn’t even been clearly stated, any propositions involving it have their wind taken out of their sails, but equally, any attempted critiques are just tilting at windmills.
All I can say is that whatever construct you’re working on, it might align with whatever Dan Luu does, which he doesn’t describe in any detail.

Daniel V 29 Dec 2025 14:15 UTC
1 point
0
on: Shared Houses Illegal?
My experience in some Southern towns is similar: either applied only to districts or zones so not as widely as people mythologize, or misinterpreted as referring to fewer people than the plain text reveals.

Daniel V 26 Oct 2025 14:23 UTC
3 points
0
in reply to: J Bostock’s comment on: Brightline is Actually Pretty Dangerous
My guess is the overall Amtrak number is the outlier, including lots of miles of open land. Perhaps relevant for assessing safety/mile when you’d otherwise drive or fly it, but not as relevant for assessing safety/risk in urban areas.

Daniel V 26 Oct 2025 14:07 UTC
9 points
0
on: Brightline is Actually Pretty Dangerous
Here’s some data (Miami Herald). It seems like a bit of a perfect storm of being in a denser and more night-active area, having more crossings, lacking fencing, not sounding horns (thanks locals!), etc. It’s easy to blame victims since the tracks don’t move, but it’s clear that design factors contribute to safety, and Brightline has leaned into just letting the deaths happen (including inaccurately characterizing them).

Daniel V 23 Aug 2025 13:46 UTC
4 points
3
in reply to: ouguoc’s comment on: Banning Said Achmiz (and broader thoughts on moderation)
I agree, the meta-point of selection bias is valid but the direction of bias is unclear.

Daniel V 27 Jul 2025 13:02 UTC
22 points
15
on: The Purpose of a System is what it Rewards
I agree this is better (the system rewards only a subset of what it does), but it is still overgeneralizing. Systems could have a different purpose but fallible reward structure (also Goodharting). You could be analyzing the purpose-reward link at the wrong level: political parties want change, so they seek power, so they need donations. This makes it look like the purpose is to just get donations because of rewards to bundlers, but it ignores the rewards at other levels and confuses local rewards with global purpose. Just as a system does a lot of things, so it rewards a lot of things.

Daniel V 23 Jul 2025 18:22 UTC
1 point
0
in reply to: Random Developer’s comment on: Shallow Water is Dangerous Too
That’s true and a very important point I wish I had included. I assumed consciousness and some unstated degree of able-bodiedness. A good hit to the head on the way in and/or certain physical limitations, and mere inches of depth will be the determinant.

Daniel V 21 Jul 2025 19:19 UTC
1 point
0
on: Monthly Roundup #32: July 2025
using urban firewood prices for what was mostly rural consumption.
Bernard Stanford: If you value all informal economy firewood production at market price, and then compare it to extant GDP estimates, you need to make sure ALL informal economic production is similarly valued, or you’ll massively overestimate firewood’s share of GDP. Seems to be what happened!
The approach seems to have a serious flaw in assuming that THIS sector of the informal economy was underestimated, but surely not any OTHER sector.
There are two different problems being raised here.
The outside quote is Zvi pointing out the issue of what price is used to multiply by quantity output to get value estimates. This is a good point because we want to multiply by a representative price, not a too-high price.
The inside quote is a related but distinct issue, which I disagree with. Bernard is arguing that if you are going to include an informal element in GDP, you have to include all informal elements. Sure, it’s the ideal, but 1) that’s not what’s going on here, and 2) even if it were, I’d be fine with it. First, firewood is already semi-included in GDP, this process is just attempting to get a better estimate. Imagine BLS sends people out to grocery stores to price milk and estimate milk consumption, but they only end up getting urban prices and only end up observing ¹⁄₃ of the milk consumed in the US. It’d actually be great to add back in the missing consumption. How do you price it? I guess with the only price you have (and Zvi is right that it’s a problematic price to use). Second, imagine BLS sends people out to start to price household dishwashing and estimate household dishwashing service provision, but they don’t bother to collect household vacuuming. It’d actually still be great to do that, though it’d be difficult to pull off.
So, I think what the authors did is actually a nice exercise, but the price issue means 28% could be an overestimate. How bad of one? The paper discusses Figure A11, recreating Barger’s (1955) estimates (though it only goes back to 1869), so what was the GDP share using that one? In the 1870s, the NBER paper in question reports a share of about 8% (on $500M of firewood). Barger reports about $350M of firewood (because of the lower price index), which would imply a share of about 5.4%. If the 28% was a 50% overestimate, that would mean the “true” share in the 1830s (if you assume Barger’s price index is “true”) could be more like 18.7%. That’s still quite high and far from “half an order of magnitude” overestimate, more like ¹⁄₅ of one. Is it absurd? Figure 6 here [pdf via academia.edu] has British and Swedish shares at 20% and 40%, respectively.

Daniel V 21 Jul 2025 17:15 UTC
4 points
2
on: Monthly Roundup #32: July 2025
I too have grown increasingly skeptical that meta-analysis in its typical form does anything all that useful.
Unfortunately, people can be bad at understanding meta-analyses. If you have studies that disagree like ⁵⁰⁄₅₀, it’s not necessarily true that half did something wrong. It’s possible there is a legitimate hidden moderator that changes the effect of the variable (probably being revealed by the meta-analysis but not picked up sufficiently by popular reporting). Or even revealing that half have a fatal flaw would be a contribution of the meta-analysis! Sometimes the effects are not totally comparable, in which case that should either be modeled/adjusted, or excluded (probably already considered by the meta-analyst [though the salient counter-examples where the researcher(s) screw up confirm that not all papers are perfect, though this is not unique to meta-analyses]). It is indeed problematic when a meta-analysis concludes the average effect is the effect, particularly with a bimodal distribution of effect sizes (would be crazy to conclude that in that case!).
The alternative “look at the studies individually” suffers from all the same issues: garbage in, garbage out; hidden moderators; non-comparability; over-concluding from an average. At least meta-analysis brings some systematic thinking to the evaluation of the literature. A strong meta-analysis interacts with these issues and hopefully avoids the pitfalls because it does what a weak meta-analysis does not—it explains inclusion criteria, considers variability, and explains differences rather than just reporting a mean.

Daniel V 20 Jul 2025 19:56 UTC
8 points
3
in reply to: tslarm’s comment on: Shallow Water is Dangerous Too
Yes, that’s what I meant, thanks.

Daniel V 20 Jul 2025 14:52 UTC
14 points
2
on: Shallow Water is Dangerous Too
I’m glad she’s totally fine. Maybe even a net positive for her and the family on future water safety. It showcases the importance of thinking about bodies of water beyond the prototypes.
A somewhat similar event occurred last weekend with my toddler in a pool. I was less than a foot away from him, as intended, and he was walking around in waist-deep water. Lost his feet but his waist is taller than his arms are long—so he needed me to intervene. He swallowed a little water in the less than two seconds he was sloshing around, but he otherwise didn’t care.
The lesson is the same: the bottom needs to be reliable enough that they can regain footing + footing may mean arm lengths + you basically can’t count on buoyancy/control (even if he had his arms straight out he might not know how to properly keep his head out, he might not know to hold his breath, and also he might be panicking) = don’t go swimming alone.

Daniel V 6 Jul 2025 13:24 UTC
24 points
2
on: Shutdown Resistance in Reasoning Models
I think it would be great to formally lay out alternative hypotheses for why this behavior arises, so we can begin to update their likelihoods based on evidence as it accumulates. I have several:
1. The LLM “misreads” the instruction with probability P. P could vary as a function of the prompt itself, perhaps as a function of both the specificity/detail (negatively so) and complexity (positively so) of the prompt. Thus, we’d expect variation in sabotage rates, but with some specificity that allows us to test this hypothesis (e.g., “Condition 1″ might outperform some prompts, but you’d also think “YOU MUST” would operate similarly).
2. The LLM “acts out” what it thinks we expect of it. To the extent that some prompts treat the LLM as more of an agent than computer, the LLM may lean into that role. (e.g., “Condition 1″ might outperform “YOU MUST”)
3. The LLM has a survival drive. As noted by Schlatter et al., this can be difficult to disambiguate from H2.
4. The LLM is task-focused. It prioritizes completing its defined task above all else. Maybe having shutdown described more as “part of” the task would reduce sabotage rates? (Edit: Such as in this comment by nostalgebraist.)
It would be valuable to figure out how variations across models would reflect on these hypotheses. Plus, what other hypotheses are there and what patterns of variation do they predict?

Daniel V 17 May 2025 13:22 UTC
6 points
1
on: P-Values Know When You’re Cheating
Yep, frequentist null hypothesis significance testing often gets critiqued for the epistemic failures of the people who use it, even when the core of the approach is fine. By the way, the term you’re describing is familywise error rate. The key questions are, do we care about that error rate, and who is in the family (answers depend on the research questions)?

Daniel V 9 May 2025 19:15 UTC
4 points
2
on: Cheaters Gonna Cheat Cheat Cheat Cheat Cheat
Alternatively or in addition to this, you can embrace AI and design new tasks and assignments that cause students to learn together with the AI.

This magical suggestion needs explication.

From what I’ve seen via Ethan Mollick, instead of copy-pasting, the new assignments that would be effective are the same as the usual—just “do the work,” but at the AI. Enter a simulation, but please don’t dual-screen the task. Teach the AI (I guess the benefit here is immediate feedback, as if you couldn’t use yourself or friend as a sounding board), but please don’t dual-screen the task. Have a conversation (again, not in class or on a discussion board or among friends), but please don’t dual-screen the task. Then show us you “did it.” You could of course do these things without AI, though maybe AI makes a better (and certainly faster) partner. But the crux is that you have to do the task yourself. Also note that this admits the pre-existing value of these kinds of tasks.

Students who will good-faith do the work and leverage AI for search, critique, and tutoring are...doing the work and getting the value, like (probably more efficiently than, possibly with higher returns than) those who do the work without AI. Students who won’t...are not doing the work and not getting the value, aside from the signaling value from passing the class. So there you have it—educators can be content that not doing the assignment delivers worse results for the student, but the student doesn’t mind as long as they get their grade, which is problematic. Thus, educators are not going quietly and are in fact very concerned about AI-proofing the work, including shifts to in-person testing and tasks.

However, that only preserves the benefit of the courses and in turn degree (I’m not saying pure signaling value doesn’t exist, I’m just saying human capital development value is non-zero and under threat). It does not insulate the college graduate from competition in knowledge work from AI (here’s the analogy: it would obviously be bad for the Ford brand to send lemons into the vehicle market, but even if they are sending decent cars out, they should still be worried about new entrants).

Daniel V 7 Apr 2025 12:21 UTC
1 point
0
on: How Gay is the Vatican?
Really enjoyed the post, but in the interest of rationality,
How many more older siblings should patrons of the Chelsea nightclub have than all other men in New York?
This question rests on the false premise(s) (i.e., model misspecification(s)) that homosexuality is only a function of birth order and that the Chelsea nightclub probability doesn’t stem from heavy selection. Relatedly, gwern notes that, “surely homosexuality is not the primary trait the Catholic Church hierarchy is trying to select for.” Maybe this was supposed to be more tongue-in-cheek. But identifying a cause does not require that it sufficiently explain something completely on its own.

Daniel V 26 Feb 2025 2:02 UTC
2 points
0
in reply to: Tim Garnett’s comment on: Economics Roundup #5
I agree with you. Unless the signal is so strong that people believe that their personal experience is not representative of the economy, it’s going to be overweighted. “I and half the people I know make less” will lead to discontent about the state of the economy. “I and half the people I know make less, but I am aware that GDP grew 40%, so the economy must be doing fine despite my personal experience” is possible, but let’s just say it’s not our prior.

Daniel V 26 Feb 2025 1:54 UTC
1 point
0
in reply to: JBlack’s comment on: Economics Roundup #5
Exactly, which is why the metric Mazlish prefers is so relevant and not bizarre, unless the premise that people judge the economy from their own experiences is incorrect.