MattJ

Karma: 38

MattJ Apr 27, 2025, 8:32 PM
1 point
1
in reply to: James_Miller’s comment on: Our Reality: A Simulation Run by a Paperclip Maximizer
That doesn’t make sense to me. If someone wants to fool me that I’m looking att a tree he has to paint a tree in every detail. Depending on how closely I examine this tree he has to match my scrutiny to the finest detail. In the end, his rendering of a tree will be indistinguishable from an actual tree even at the molecular level.

MattJ Apr 19, 2025, 10:03 PM
15 points
16
on: Why Should I Assume CCP AGI is Worse Than USG AGI?
We don’t want an ASI to be ”democratic”. We want it to be ”moral”. Many people in the West conflate the two words thinking that democratic and moral is the same thing but it is not. Democracy is a certain system of organizing a state. Morality is how people and (in the future) an ASI behave towards one another.
There are no obvious reasons why an authocratic state would care more or less about a future ASI being immoral, but an argument can be made that autocratic states will be more cautious and put more restrictions on the development of an ASI because autocrats usually fear any kind of opposition and an ASI could be a powerful adversary of itself or in the hands of powerful competitors.

MattJ Feb 18, 2025, 10:10 PM
1 point
0
in reply to: Anon User’s comment on: Any Trump Supporters Want to Dialogue?
The actual peace deal will be something for the Ukraine to agree to. It is not up to Trump to dictate the terms. All Trump should do is to stop financing the war and we will have peace.
Having said that, if it is somehow possible for Trump to pressure Ukraine into agreeing to become a US colony, my support for Trump was a mistake. The war would be preferable to the peace.

MattJ Dec 17, 2024, 1:37 PM
−1 points
−5
on: Biological risk from the mirror world
Good post! We will soon have very powerful quantum computers that probably could simulate what will happen if a mirror bacteria is confronted with the human immune system. Maybe there is no risk at all or an existential risk to humanity. This should be a prioritized task for our first powerful quantum computer to find out.

MattJ Sep 28, 2024, 8:39 PM
1 point
−8
in reply to: k64’s comment on: Any Trump Supporters Want to Dialogue?
Because he says so.

MattJ Sep 28, 2024, 8:35 PM
4 points
0
on: Any Trump Supporters Want to Dialogue?
I’m not allowed to vote in the election but I hope Trump wins because I think he will negotiate a peace in Ukraine. If Harris wins I think the war will drag on for another couple of years at worst.

I have no problem getting pushback.

MattJ Jan 6, 2024, 4:51 PM
−1 points
0
on: The Next ChatGPT Moment: AI Avatars
I guess it could be a great tool to help people quickly learn to converse in a foreign language.

MattJ Dec 4, 2023, 7:54 PM
1 point
0
in reply to: Mitchell_Porter’s comment on: Nietzsche’s Morality in Plain English
The ”eternal recurrence” is surprisingly the most attractive picture of the ”afterlife”. The alternatives: the annihilation of the self or eternal life in heaven are both unattractive, for different reasons. Add to this that Nietzsche is right to say that the eternal recurrence is a view of the world which seems compatible with a scientific cosmology.

MattJ Aug 31, 2023, 11:03 AM
3 points
0
on: Immanuel Kant and the Decision Theory App Store
I remember I came up with a similar thought experiment to explain the Categorical Imperative.

Assume there is only one Self-Driving Car on the market, what principle would you want it to follow?

The first priciple we think of is: ”Always do what the driver would want you to do”.

This would certainly be the principle we would want if our SDC was the only car on the road. But there are other SDCs and so in a way we are choosing a principle for our own car which is also at the same time a ”universal law”, valid for every car on the road.

With this in mind, it is easy to show that the principle we could rationally want is: ”Always act on that principle which the driver can rationally will to become a universal law”.

Coincidently this is also Kant’s Categorical Imperative.

MattJ Aug 24, 2023, 4:41 PM
2 points
−1
in reply to: Quintin Pope’s comment on: Is this the beginning of the end for LLMS [as the royal road to AGI, whatever that is]?
Yes, but that ”generative AI can potentially replace millions of jobs” is not contradictory to the statement that it eventually ”may turn out to be a dud”.

I initially reacted in the same way as you to the exact same passage but came to the conclusion that it was not illogical. Maybe I’m wrong but I don’t think so.

MattJ Aug 24, 2023, 3:51 PM
1 point
0
in reply to: Quintin Pope’s comment on: Is this the beginning of the end for LLMS [as the royal road to AGI, whatever that is]?
I think the auther ment that there was a perception that it could replace millions of jobs, and so an incentive for business to press forward with their implementation plans, but that this would eventually back fire if the hallucination problem is insoluble.

MattJ Aug 24, 2023, 11:05 AM
1 point
−1
in reply to: Mitchell_Porter’s comment on: Steven Wolfram on AI Alignment
I am a Kantian and believe that those a priori rules have already been discovered.

But my point here was merely that you can isolate the part that belongs to pure ethics from evererything empirical, like in my example what a library is; why do people go to libraries; what is a microphone and what is it’s purpose and so on. What makes an action right or wrong at the most fundamental level however is independent of everything empirical and simply an a priori rule.

I guess also my broader point was that Stephen Wolfram is far too pessimistic about the prospects of making a moral AI. A future AI may soon have a greater understanding of the world and the people in it, and so all we have to do is to provide the right a priori rule and we will be fine.

Of course, the technical issue still remains: how do we make the AI stick to that rule, but that is not an ethical problem but an engineering problem.

MattJ Aug 23, 2023, 2:08 PM
2 points
1
on: Steven Wolfram on AI Alignment
You can’t isolate individual ”atoms” in ethics, according to Wolfram. Let’s put that to the test. Tell me if the following ”ethical atoms” are right or wrong:
1. I will speak in a loud voice
2…on a monday

3…in a public library

4…where I’ve been invited to speak about my new book and I don’t have a microphone.

Now, (1) seems morally permissible, and (2) doesn’t change the evaluation. (3) does make my action seem morally impermissible, but (4) turns it around again. I’m convinced all of this was very simple to everyone.

Ethics is the science about the a priori rules that make these judgments so easy to us, or at least that was Kant’s view which I share. It should be possible to make an AI do this calculation even faster than we do, and all we have to do is to provide the AI with the right a priori rules. When that is done, the rest is just empirical knowledge about libraries and human beings and we will eventually have a moral AI.

MattJ May 15, 2023, 8:23 PM
1 point
0
in reply to: JakubK’s comment on: Next Level Seinfeld
I think that was the point. Comedians of the future will be performers. They will not write their own jokes but be increasingly good at reading the lines written by AI.

When Chat GPT came out I asked it to write a Seinfeld episode about taking an IQ-test. In my judgment it was just as good and funny as every other Seinfeld episodes I’ve watched. Mildly amusing. Entertaining enough not to stop reading.

MattJ Apr 24, 2023, 1:06 PM
1 point
0
in reply to: Max H’s comment on: Why do we care about agency for alignment?
This answer is a little bit confusing to me. You say that ”agency” may be an important concept even if we don’t have a deep understanding of what it entails. But how about a simple understanding?

I thought that when people spoke about ”agency” and AI, they meant something like ”a capacity to set their own final goals”, but then you claim that Stockfish could best be understood by using the concept of ”agency”. I don’t see how.

I myself kind of agree with the sentiment in the original post that ”agency” is a superfluous concept, but want to understand the opposite view?

MattJ Apr 18, 2023, 9:12 PM
1 point
0
on: Scientism vs. people
You seem to hold the position that:
1. Scientists and not philosophers should do meta-ethics and normative ethics, until
2. AGIs can do it better at which point we should leave it to them.
I don’t believe that scientists either have the inclination or the competence to do what you ask of them, and secondly that letting AGIs decide right and wrong would be a nightmare scenario for the human race.

MattJ Apr 3, 2023, 6:53 PM
1 point
0
on: AI-kills-everyone scenarios require robotic infrastructure, but not necessarily nanotech
”Whom the gods would destroy, they first make mad.”

One way to kill everyone would be to turn the planet into a Peoples Temple and have everyone drink the kool-aid.

I think even those of us who think of ouselves as psychologically robust will be defenseless against the manipulations of a future GPT-9.

MattJ Mar 30, 2023, 6:23 PM
1 point
0
in reply to: RohanS’s comment on: ~100 Interesting Questions
I thought that was what was meant. The question is probably the easiest one to answer affirmatively with a high degree of confidence. I can think of several ongoing ”moral catastrophs”.

MattJ Mar 30, 2023, 6:04 PM
5 points
1
on: ~100 Interesting Questions
Very good, fundamental questions.. I don’t understand question 85 though. Here are two more good questions.
1. Are human beings aligned?
2. Is human alignment, insofar as it exists, a property of the goals we have when we act or a property of the actions themselves?

MattJ Mar 29, 2023, 7:28 PM
12 points
8
on: Nobody’s on the ball on AGI alignment
I don’t think the response to Covid should give us reason to be optimistic about our effectiveness at dealing with the threat from AI. Quite the opposite. Much of the measures taken were known to be useless from the start, like masks, while others were ineffective or harmful like shutting down schools or giving vaccine to young people who were not at risk of dying from Covid.

Everything can be explained by the incentives our politicians have to do anything. They want to be seen to take important questions seriously while not upsetting their doners in the pharma industry.

I can easily imagine something similar happening if the voters becomes concerned about AI. Some ineffective legislation dictated by Big tech.