In Nielsen’s first “problem for the author”, he writes,
An alternate, equivalent approach to defining causal models is as follows …
But I can’t tell the difference between the “alternate” approach and the original one. For example, Nielsen says that the alternate approach “introduces the overhead of dealing with the augmented graph”. Wasn’t this already necessary in the original approach?
Okay, suppose you have a two node system. One node is whether someone smokes, one node is whether there’s tar in their lungs. The smoking node has a causal influence on the tar node, but there’s also a random factor. Say if someone smokes they’ll have tar in their lungs, otherwise there’s only a 5% chance they do. This is only two nodes. To express this in the alternate approach, the tar node needs to be a deterministic function of other nodes, and an extra random node is required for this. It could be a “polluted atmosphere” node, value “yes” 5% of the time, and the tar node could be “yes” if either the smoking or polluted atmosphere nodes are “yes” (a deterministic function of its input nodes).
The smoking node has a causal influence on the tar node, but there’s also a random factor.
I don’t see how this is true of either approach.
Let X_smokes and X_tar be the random variables associated with your nodes. Under the first approach, if there are no other “exogenous” Y-nodes, then there is a function f_tar such that X_tar = f_tar(X_smokes). Doesn’t that mean that whether you have tar is entirely a function of whether you smoke?
Maybe I’m mistaken about what it means for one random variable to be a function of another. We can understand X_smokes and X_tar formally as functions from the sample space Ω of people* to the state space {0,1} of Boolean values, right? Usually, to say that one function f is a function of another function g is to say that, for some function F, f(x) = F(g(x)) for each element x of the domain. That is, the value of f at x is entirely determined by the value of g at x.
If this convention applies when the functions are random variables, then to say that X_tar = f_tar(X_smokes) is to say that, for each person 𝜔, X_tar(𝜔) = f_tar(X_smokes(𝜔)). Thus, for every smoker 𝜔, X_tar(𝜔) has the same value, namely f_tar(1). That is, the answer to whether a smoker has tar in their lungs is always the same. Similarly, among all nonsmokers, the answer f_tar(0) to whether they have tar in their lungs is always the same. Therefore, whether or not you smoke determines whether or not you have tar in your lungs.
Do people mean something different when they say that one random variable is a function of another? If so, what do they mean? If not, where is there room for a “random factor” when there are no exogenous Y-variables, even under the first approach described by Nielsen?
* ETA: I originally had the sample space Ω being the set of all possible worlds, which seems wrong on reflection.
Mostly the essay is careful not to flatly say that a node value X_1 is a function of a node value X_2.
Sometimes it is a random function of X_2 (note the qualifier “random”), sometimes it is a function of X_2 and a random value Y_1, where Y_1 does not have its own node (so does not increase the size of the graph). And of course there is an exception when proposing the alternate approach, where the nodes are divided into the random ones, and those which are a deterministic function of other node values.
In my example, I would not say the tar node value was a function of the smokes node value, it would be a function of the smokes node value and an extra random variable. In the alternate approach the extra random variable needs its own node, in the main approach it doesn’t, you can just assume every node may have extra random variables influencing it without representing them on the graph.
Mostly the essay is careful not to flatly say that a node value X_1 is a function of a node value X_2.
I’m not sure where you’re getting that. Here is how he describes the dependence among nodes under the “first approach”:
Motivated by the above discussion, one way we could define causal influence would be to require that X_j be a function of its parents:
X_j = f_j(X_{\mbox{pa}(j)}),
where f_j(\cdot) is some function. In fact, we’ll allow a slightly more general notion of causal influence, allowing X_j to not just be a deterministic function of the parents, but a random function. We do this by requiring that X_j be expressible in the form:
where f_j is a function, and Y_{j,\cdot} is a collection of random variables such that: (a) the Y_{j,\cdot} are independent of one another for different values of j; and (b) for each j, Y_{j,\cdot} is independent of all variables X_k, except when X_k is X_j itself, or a descendant of X_j.
So, unless you have some exogenous Y-nodes, X_j will be a deterministic function of its parent X-nodes. The only way he introduces randomness is by introducing the Y-nodes. My question is, how is that any different from the “alternative approach” that he discusses later?
I see. Thanks. I was thrown off because he’d already said that he would “overload” the notation for random variables, using it also to represent nodes or sets of nodes. But what you say makes sense.
I’m not sure what the real difference is, though. The graph is just a way to depict dependencies among random variables. If you’re already working with a collection of random variables with given dependencies, the graph is just, well, a graphical way to represent what you’re already dealing with. Am I right, then, in thinking that the only difference between the two “approaches” is whether you bother to create this auxiliary graphical structure to represent what you’re doing, instead of just working directly with the random variable X_i, Y_ij, and their dependency functions f_i ?
It’s easier for humans to think in terms of pictures. But if you were programming a computer to reason causally this way, wouldn’t you implement the two “approaches” in essentially the same way?
If you have a specified causal system you could represent it either way, yes.
Speculating on another reason he may have made the distinction: often he posed problems with specified causal graphs but unspecified functions. So he may have meant that in the problems like these, with one approach you can easily specify some node values as being deterministic functions of other node values, whereas with the other approach you don’t (since a specified graph rules out further random influences in one approach but not the other).
A stupid question:
In Nielsen’s first “problem for the author”, he writes,
But I can’t tell the difference between the “alternate” approach and the original one. For example, Nielsen says that the alternate approach “introduces the overhead of dealing with the augmented graph”. Wasn’t this already necessary in the original approach?
Okay, suppose you have a two node system. One node is whether someone smokes, one node is whether there’s tar in their lungs. The smoking node has a causal influence on the tar node, but there’s also a random factor. Say if someone smokes they’ll have tar in their lungs, otherwise there’s only a 5% chance they do. This is only two nodes. To express this in the alternate approach, the tar node needs to be a deterministic function of other nodes, and an extra random node is required for this. It could be a “polluted atmosphere” node, value “yes” 5% of the time, and the tar node could be “yes” if either the smoking or polluted atmosphere nodes are “yes” (a deterministic function of its input nodes).
I don’t see how this is true of either approach.
Let X_smokes and X_tar be the random variables associated with your nodes. Under the first approach, if there are no other “exogenous” Y-nodes, then there is a function f_tar such that X_tar = f_tar(X_smokes). Doesn’t that mean that whether you have tar is entirely a function of whether you smoke?
Maybe I’m mistaken about what it means for one random variable to be a function of another. We can understand X_smokes and X_tar formally as functions from the sample space Ω of people* to the state space {0,1} of Boolean values, right? Usually, to say that one function f is a function of another function g is to say that, for some function F, f(x) = F(g(x)) for each element x of the domain. That is, the value of f at x is entirely determined by the value of g at x.
If this convention applies when the functions are random variables, then to say that X_tar = f_tar(X_smokes) is to say that, for each person 𝜔, X_tar(𝜔) = f_tar(X_smokes(𝜔)). Thus, for every smoker 𝜔, X_tar(𝜔) has the same value, namely f_tar(1). That is, the answer to whether a smoker has tar in their lungs is always the same. Similarly, among all nonsmokers, the answer f_tar(0) to whether they have tar in their lungs is always the same. Therefore, whether or not you smoke determines whether or not you have tar in your lungs.
Do people mean something different when they say that one random variable is a function of another? If so, what do they mean? If not, where is there room for a “random factor” when there are no exogenous Y-variables, even under the first approach described by Nielsen?
* ETA: I originally had the sample space Ω being the set of all possible worlds, which seems wrong on reflection.
Mostly the essay is careful not to flatly say that a node value X_1 is a function of a node value X_2. Sometimes it is a random function of X_2 (note the qualifier “random”), sometimes it is a function of X_2 and a random value Y_1, where Y_1 does not have its own node (so does not increase the size of the graph). And of course there is an exception when proposing the alternate approach, where the nodes are divided into the random ones, and those which are a deterministic function of other node values.
In my example, I would not say the tar node value was a function of the smokes node value, it would be a function of the smokes node value and an extra random variable. In the alternate approach the extra random variable needs its own node, in the main approach it doesn’t, you can just assume every node may have extra random variables influencing it without representing them on the graph.
I’m not sure where you’re getting that. Here is how he describes the dependence among nodes under the “first approach”:
So, unless you have some exogenous Y-nodes, X_j will be a deterministic function of its parent X-nodes. The only way he introduces randomness is by introducing the Y-nodes. My question is, how is that any different from the “alternative approach” that he discusses later?
That is not the same as there being Y-nodes. Nodes would be part of the graph structure, and so be more visible when you look at the graph.
The only difference is whether the Y-values require their own nodes.
I see. Thanks. I was thrown off because he’d already said that he would “overload” the notation for random variables, using it also to represent nodes or sets of nodes. But what you say makes sense.
I’m not sure what the real difference is, though. The graph is just a way to depict dependencies among random variables. If you’re already working with a collection of random variables with given dependencies, the graph is just, well, a graphical way to represent what you’re already dealing with. Am I right, then, in thinking that the only difference between the two “approaches” is whether you bother to create this auxiliary graphical structure to represent what you’re doing, instead of just working directly with the random variable X_i, Y_ij, and their dependency functions f_i ?
It’s easier for humans to think in terms of pictures. But if you were programming a computer to reason causally this way, wouldn’t you implement the two “approaches” in essentially the same way?
If you have a specified causal system you could represent it either way, yes.
Speculating on another reason he may have made the distinction: often he posed problems with specified causal graphs but unspecified functions. So he may have meant that in the problems like these, with one approach you can easily specify some node values as being deterministic functions of other node values, whereas with the other approach you don’t (since a specified graph rules out further random influences in one approach but not the other).