Is any other information publicly available at the moment about the theft? The total amount stolen is large enough that it’s noteworthy as part of a consideration of SIAI’s financial practices.
Yes, I want to know that steps have been taken to minimize the possibility future thefts.
I don’t know all the details of the financial controls, but I do know that members of the board have been given the ability to monitor bank transactions and accounts online at will to detect unusual activity and have been reviewing transactions at the monthly board meetings. There has been a major turnover of the composition of the board, which now consists of three major recent donors, plus Michael Vassar and Eliezer Yudkowsky.
Also, the SIAI pressed criminal charges rather than a civil suit to cultivate an internal reputation to deter repeats.
At this point an admin should undelete the original SIAI Fundraising discussion post. I can’t seem to do it myself. I can update it with a pointer to this post.
Surely if the SIAI is pursuing legal restitution, there are documents with more details which can be posted. For example a copy of a civil complaint. (Normally civil complaints are a matter of public record.)
Let’s face reality: It’s totally embarrassing that an organization dedicated to reducing existential risk for humanity was not able to protect itself from an extremely common and mundane risk faced by organizations day after day.
Of greater concern is that the SIAI may be falling into the common institutional trap of suppressing information simply because it is embarrassing.
Ok, in that case a copy of the police report. As well as the name of the contractor and a copy of his or her contract. How could producing this information prejudice the SIAI’s ability to obtain restitution?
For one thing, the two risks are interrelated. Money is the life’s blood of any organization. (Indeed, Eliezer regularly emphasizes the importance of funding to SIAI’s mission). Thus, a major financial blow like this is a serious impediment to SIAI’s ability to do its job. If you seriously believe that SIAI is significantly reducing existential risk to mankind, then this theft represents an appreciable increase in existential risk to mankind.
Second, SIAI’s leadership is selling us an approach to thinking which is supposed to be of general application. i.e. it’s not just for preventing ai-related disasters, it’s also supposed to make you better at achieving more mundane goals in life. I can’t say for sure without knowing the details, but if a small not-for-profit has 100k+ stolen from it, it very likely represents a failure of thinking on the part of the organization.
There is an area of thought without which we can’t get anywhere, but which is hard to teach, and that is generating good hypotheses. Once we have a hypothesis in hand, then we can evaluate it. We can compare it to alternatives and use Bayes’ formula to update the probabilities that we assign the rival hypotheses. We can evaluate arguments for and against the hypothesis by for example identifying biases and other fallacious reasoning. But none of this will get us where we want to go unless we happen to have selected the true hypothesis (or one “true enough” in a restricted domain, as Newton’s law of gravity is true enough in a restricted domain). If all you have to evaluate is a bunch of false hypotheses, then Bayesian updating is just going to move you from one false hypothesis to another. You need to have the true hypothesis among your candidate hypotheses if Bayesian updating is ever going to take you to it. Of course, this is a tall order given that, by assumption, you don’t know ahead of time what the truth is. However, the record of discoveries so far suggests that the human race doesn’t completely suck at it.
Generating the true hypothesis (or indeed any hypothesis) involves, I am inclined to say, an act of imagination. For this reason, “use your imagination” is seriously good advice. People who are blindsided by reality sometimes say something like, they never imagined that something like this could happen. I’ve been blindsided by reality precisely because I never considered certain possibilities which consequently took me by surprise.
I agree. It reminds me of a fictional dialogue from a movie about the Apollo 1 disaster:
Clinton Anderson: [at the senate inquiry following the Apollo 1 fire] Colonel, what caused the fire? I’m not talking about wires and oxygen. It seems that some people think that NASA pressured North American to meet unrealistic and arbitrary deadlines and that in turn North American allowed safety to be compromised.
Frank Borman: I won’t deny there’s been pressure to meet deadlines, but safety has never been intentionally compromised.
Clinton Anderson: Then what caused the fire?
Frank Borman: A failure of imagination. We’ve always known there was the possibility of fire in a spacecraft. But the fear was that it would happen in space, when you’re 180 miles from terra firma and the nearest fire station. That was the worry. No one ever imagined it could happen on the ground. If anyone had thought of it, the test would’ve been classified as hazardous. But it wasn’t. We just didn’t think of it. Now who’s fault is that? Well, it’s North American’s fault. It’s NASA’s fault. It’s the fault of every person who ever worked on Apollo. It’s my fault. I didn’t think the test was hazardous. No one did. I wish to God we had.
Is any other information publicly available at the moment about the theft? The total amount stolen is large enough that it’s noteworthy as part of a consideration of SIAI’s financial practices.
Yes, I want to know that steps have been taken to minimize the possibility future thefts.
I don’t know all the details of the financial controls, but I do know that members of the board have been given the ability to monitor bank transactions and accounts online at will to detect unusual activity and have been reviewing transactions at the monthly board meetings. There has been a major turnover of the composition of the board, which now consists of three major recent donors, plus Michael Vassar and Eliezer Yudkowsky.
Also, the SIAI pressed criminal charges rather than a civil suit to cultivate an internal reputation to deter repeats.
See here. Incidentally, that post seems a lot like this one.
At this point an admin should undelete the original SIAI Fundraising discussion post. I can’t seem to do it myself. I can update it with a pointer to this post.
Surely if the SIAI is pursuing legal restitution, there are documents with more details which can be posted. For example a copy of a civil complaint. (Normally civil complaints are a matter of public record.)
Let’s face reality: It’s totally embarrassing that an organization dedicated to reducing existential risk for humanity was not able to protect itself from an extremely common and mundane risk faced by organizations day after day.
Of greater concern is that the SIAI may be falling into the common institutional trap of suppressing information simply because it is embarrassing.
It’s a criminal case.
Ok, in that case a copy of the police report. As well as the name of the contractor and a copy of his or her contract. How could producing this information prejudice the SIAI’s ability to obtain restitution?
Why is it embarrassing that an organization dedicated to reducing one sort of risk fell prey to a risk of another sort?
For one thing, the two risks are interrelated. Money is the life’s blood of any organization. (Indeed, Eliezer regularly emphasizes the importance of funding to SIAI’s mission). Thus, a major financial blow like this is a serious impediment to SIAI’s ability to do its job. If you seriously believe that SIAI is significantly reducing existential risk to mankind, then this theft represents an appreciable increase in existential risk to mankind.
Second, SIAI’s leadership is selling us an approach to thinking which is supposed to be of general application. i.e. it’s not just for preventing ai-related disasters, it’s also supposed to make you better at achieving more mundane goals in life. I can’t say for sure without knowing the details, but if a small not-for-profit has 100k+ stolen from it, it very likely represents a failure of thinking on the part of the organization.
There is an area of thought without which we can’t get anywhere, but which is hard to teach, and that is generating good hypotheses. Once we have a hypothesis in hand, then we can evaluate it. We can compare it to alternatives and use Bayes’ formula to update the probabilities that we assign the rival hypotheses. We can evaluate arguments for and against the hypothesis by for example identifying biases and other fallacious reasoning. But none of this will get us where we want to go unless we happen to have selected the true hypothesis (or one “true enough” in a restricted domain, as Newton’s law of gravity is true enough in a restricted domain). If all you have to evaluate is a bunch of false hypotheses, then Bayesian updating is just going to move you from one false hypothesis to another. You need to have the true hypothesis among your candidate hypotheses if Bayesian updating is ever going to take you to it. Of course, this is a tall order given that, by assumption, you don’t know ahead of time what the truth is. However, the record of discoveries so far suggests that the human race doesn’t completely suck at it.
Generating the true hypothesis (or indeed any hypothesis) involves, I am inclined to say, an act of imagination. For this reason, “use your imagination” is seriously good advice. People who are blindsided by reality sometimes say something like, they never imagined that something like this could happen. I’ve been blindsided by reality precisely because I never considered certain possibilities which consequently took me by surprise.
I agree. It reminds me of a fictional dialogue from a movie about the Apollo 1 disaster:
Clinton Anderson: [at the senate inquiry following the Apollo 1 fire] Colonel, what caused the fire? I’m not talking about wires and oxygen. It seems that some people think that NASA pressured North American to meet unrealistic and arbitrary deadlines and that in turn North American allowed safety to be compromised.
Frank Borman: I won’t deny there’s been pressure to meet deadlines, but safety has never been intentionally compromised.
Clinton Anderson: Then what caused the fire?
Frank Borman: A failure of imagination. We’ve always known there was the possibility of fire in a spacecraft. But the fear was that it would happen in space, when you’re 180 miles from terra firma and the nearest fire station. That was the worry. No one ever imagined it could happen on the ground. If anyone had thought of it, the test would’ve been classified as hazardous. But it wasn’t. We just didn’t think of it. Now who’s fault is that? Well, it’s North American’s fault. It’s NASA’s fault. It’s the fault of every person who ever worked on Apollo. It’s my fault. I didn’t think the test was hazardous. No one did. I wish to God we had.