Rene de Visser

Karma: 7

Rene de Visser 3 May 2019 14:45 UTC
1 point
on: Self-confirming predictions can be arbitrarily bad
I am not sure what exactly you are meaning by predicting. You can tell the donor a different amount, than you are internally expecting to obtain.

Rene de Visser 8 Jul 2021 15:07 UTC
1 point
on: How much chess engine progress is about adapting to bigger computers?
I think you can compare modern chess programs with each other to evaluate this.
Some comparisons have been made between different modern chess engines in TCEC.
Stockfish is particularly well adapted to using lots of cores. i.e. Stockfish has a much larger advantage over the other modern programs when lots of CPU cores a available as they have optimized hash table contention very well.
If you compare NNUE stockfish to classic stockfish is also the question of how much strength stockfish NNUE loses when playing on hardware that does not support SIMD.
Similarly you can look at compare Leela Chess with and without GPU.
On the old vs new:
Old chess engines will have been optimized to use much less memory, where as modern chess engines use a very large hash table.
i.e. 3. Software that is better-adapted to new, bigger computers. is quite a large component.

Rene de Visser 1 Mar 2022 16:18 UTC
2 points
on: 😱😱😱Xxx_ATTENTION_GRABBING_TITLE_xxX 😱😱😱
An agent typically maximizes their expected utility. i.e. they make the choices under their control that lead to the highest expected utility.
If they predict their efforts to solving aging and mitigating other risks to themselves have minimal effect on the expected utility they will spend most of their time playing Factorio while they can. This will lead to to the maximum expected utility.
If they spend all their time trying to not die, and then they die their total utility will be zero.

Rene de Visser 4 Mar 2022 8:53 UTC
3 points
in reply to: romeostevensit’s comment on: Recognizing and Dealing with Negative Automatic Thoughts
Yes, the postive reframing step from TEAM (version of CBT) / Feeling great by Dr David Burns is missing from the above, as is the “Magic Dial” step.
A bit odd, as I would have guessed that the above lists or taken directly from “Feeling Great”, or from his web site.

Rene de Visser 9 Mar 2022 12:59 UTC
1 point
in reply to: TekhneMakre’s comment on: We’re already in AI takeoff
What do you mean by “technical” here?
I think solving the alignment problem for government, corporations, and other coallitions would probably help solving the alignment problem in AGI.
I guess you are saying that even if we could solve the above alignment problems it would still not go all the way to solving it for AGI? What particular gaps are you thinking of?

Rene de Visser 9 Mar 2022 13:44 UTC
1 point
in reply to: TekhneMakre’s comment on: We’re already in AI takeoff
How do you know they don’t generalize? As far as I know, no one has solved these problems for coallitions of agents, regardless of human, theoritical or otherwise.

Rene de Visser 9 Mar 2022 16:31 UTC
3 points
in reply to: TekhneMakre’s comment on: We’re already in AI takeoff
I was thinking specifically here of maximizing the value function (desires) across the agents interacting with other. Or more specially adapting the system in a way that it self maintains “maximizing the value function (desires) across the agents” property.
An example is an ecomonic system which seeks to maximize the total wealthfare. Current systems though don’t maintain themselves. More powerful agents take over the control mechanisms (or adjust the market rules) so that they are favoured (lobbying, cheating, ignoring the rules, mitageting enforcement). Similar problems occur in other types of coallitions.
Postulating a more powerful agent that forces this maximization property (an aligned super AGI) is cheating unless you can describe how this agent works and self maintains itself and this goal.
However coming to a solution of a system of agents that self maintains this property with no “super agent” might lead to solutions for AGI alignment, or might prevent the creation of such a misaligned agent.
I read a while ago the design/theoritics of corruption resistent systems is an area that has not received much research.

Rene de Visser 11 May 2022 13:44 UTC
3 points
on: ProjectLawful.com: Eliezer’s latest story, past 1M words
I’d also like an EPUB version that is stripped as possible. I guess it might be necessary to prepend the characters name to know who is saying what, but I find the rest very distracting. I find it makes it hard to read.

Rene de Visser 28 Nov 2023 9:29 UTC
1 point
0
in reply to: gwern’s comment on: Why Q*, if real, might be a game changer
I wonder if giving lower rewards for correctly guessing common tokens, and higher rewards for correctly guessing uncommon tokens would improve models? I don’t think I’ve seen anyone trying this.
Found: https://ar5iv.labs.arxiv.org/html/1902.09191 - Improving Neural Response Diversity with Frequency-Aware Cross-Entropy Loss .