This post refers to serial attempts to produce one specific thing that we preselected.
‘AI’ is a problem and a goal, not a specific thing. It’s what we label the thing which turns out to do what we want it to. “AI” is whatever works. We can no more ‘preselect’ the specific thing which will be the invention of ‘AI’ than Douglas Lenat could preselect Cyc as ‘AI’. (Because that didn’t work.)
For every specific invention, in hindsight it is clear that the earliest attempts had essentially zero chance of complete success, subsequent attempts had not much more, until eventually a relatively sharp threshold was reached due to meeting increasingly better understood prerequisites, and it became nearly inevitable. This is not at all the same as a model that has constant p per trial right from the start.
No it’s not. Innovation happens all the time by brute force, accident, trial-and-error, and serendipity. Literally the first example Clancy gives from Weitzman, of Edison testing lightbulb filaments, disproves that (an example one should remember from middle school history class). There was no ‘sharp threshold’ or ‘increasingly better understood prerequisites’. If Edison had tried the carbonized cotton thread first after his proof-of-concept using a metal filament, it would have worked; if he hadn’t eventually tried cotton after literally reaching in to grab thousands of other candidate plant materials, it wouldn’t’ve, and he would’ve gone on grabbing thousands of more materials with no greater chance of success in each trial until eventually he gave up or stumbled across another rare material which would work (bamboo apparently would’ve worked).
Attempts to produce a light bulb are exactly an example of what I mean.
Inventors in Ancient Greece would not have produced an electric light bulb, at all, even if thousands of them worked for hundreds of years. Early 18th century inventors could possibly have produced one if they had reason to put in immense effort. So rather than starting at Edison, this is where we should start that story. This is about the time period where p > 0 for a “trial” for the first time.
By the early 19th century the conditions were becoming ripe for the possibility of electric lighting, and some expensive and short-lived forms of electric light bulb were already being invented (Davy’s incandescent bulb and later arc lights). The techniques and materials still weren’t reliable or cheap enough at that time, and the theory and practice of electricity was still lacking, but people were attempting the task of making a long-lived, cheap and moderately efficient bulb and making progress with increasing degrees of success.
By the later 19th century there were dozens of successful incandescent light bulb designs, with the first patent granted about 40 years before Edison. Later versions were developed that had some narrow commercial use, and Edison’s bulb was an economically better incremental improvement that was sufficiently cheaper and longer-lived to go into mass production nearly 100 years after the first research prototype for incandescent lighting was developed.
I stated that the independent Bernoulli trial model does not work, except over the very shortest timescales, far shorter than the span of all attempts to make a thing. Edison’s attempts were indeed far shorter than the span of all attempts to make the thing.
The original post is talking about the span of all attempts to make the thing, and the constant-p model is not at all reasonable for that.
‘AI’ is a problem and a goal, not a specific thing. It’s what we label the thing which turns out to do what we want it to. “AI” is whatever works. We can no more ‘preselect’ the specific thing which will be the invention of ‘AI’ than Douglas Lenat could preselect Cyc as ‘AI’. (Because that didn’t work.)
No it’s not. Innovation happens all the time by brute force, accident, trial-and-error, and serendipity. Literally the first example Clancy gives from Weitzman, of Edison testing lightbulb filaments, disproves that (an example one should remember from middle school history class). There was no ‘sharp threshold’ or ‘increasingly better understood prerequisites’. If Edison had tried the carbonized cotton thread first after his proof-of-concept using a metal filament, it would have worked; if he hadn’t eventually tried cotton after literally reaching in to grab thousands of other candidate plant materials, it wouldn’t’ve, and he would’ve gone on grabbing thousands of more materials with no greater chance of success in each trial until eventually he gave up or stumbled across another rare material which would work (bamboo apparently would’ve worked).
Attempts to produce a light bulb are exactly an example of what I mean.
Inventors in Ancient Greece would not have produced an electric light bulb, at all, even if thousands of them worked for hundreds of years. Early 18th century inventors could possibly have produced one if they had reason to put in immense effort. So rather than starting at Edison, this is where we should start that story. This is about the time period where p > 0 for a “trial” for the first time.
By the early 19th century the conditions were becoming ripe for the possibility of electric lighting, and some expensive and short-lived forms of electric light bulb were already being invented (Davy’s incandescent bulb and later arc lights). The techniques and materials still weren’t reliable or cheap enough at that time, and the theory and practice of electricity was still lacking, but people were attempting the task of making a long-lived, cheap and moderately efficient bulb and making progress with increasing degrees of success.
By the later 19th century there were dozens of successful incandescent light bulb designs, with the first patent granted about 40 years before Edison. Later versions were developed that had some narrow commercial use, and Edison’s bulb was an economically better incremental improvement that was sufficiently cheaper and longer-lived to go into mass production nearly 100 years after the first research prototype for incandescent lighting was developed.
I stated that the independent Bernoulli trial model does not work, except over the very shortest timescales, far shorter than the span of all attempts to make a thing. Edison’s attempts were indeed far shorter than the span of all attempts to make the thing.
The original post is talking about the span of all attempts to make the thing, and the constant-p model is not at all reasonable for that.