Haven’t explored that option, thanks for the suggestion.
I agree sycophancy is part of the problem. However, the issue I’m getting at here has more to do with biases introduced by the way ideas are selected using my current approach.
Idea viability follows a multiplicative hurdle model based on independent factors. VALUE = A x B x C x D. AI (and human operator) only have intelligence and attention to address a subset of factors at one time (A and B). The others (C and D) are ignored. This problem is compounded by iteratively sampling ideas:
PARTIAL_VALUE1 = A1 x B1, PARTIAL_VALUE2 = A2 x B2, …
The problem is finally exacerbated by picking the idea with highest PARTIAL_VALUE and optimizing the in-focus factors (A and B) while refining technical execution plan focused on these factors.
Reintroducing the selected idea by itself to the AI identifies forgotten factors C and D, which contain fatal flaws simply because most untried ideas are unviable for multiple reasons in a competitive market. Selecting for ideas where in-focus factors (A and B) are viable also selects for ideas where out-of-focus factors (C and D) are unviable.
Haven’t explored that option, thanks for the suggestion.
I agree sycophancy is part of the problem. However, the issue I’m getting at here has more to do with biases introduced by the way ideas are selected using my current approach.
Idea viability follows a multiplicative hurdle model based on independent factors. VALUE = A x B x C x D. AI (and human operator) only have intelligence and attention to address a subset of factors at one time (A and B). The others (C and D) are ignored. This problem is compounded by iteratively sampling ideas:
PARTIAL_VALUE1 = A1 x B1, PARTIAL_VALUE2 = A2 x B2, …
The problem is finally exacerbated by picking the idea with highest PARTIAL_VALUE and optimizing the in-focus factors (A and B) while refining technical execution plan focused on these factors.
Reintroducing the selected idea by itself to the AI identifies forgotten factors C and D, which contain fatal flaws simply because most untried ideas are unviable for multiple reasons in a competitive market. Selecting for ideas where in-focus factors (A and B) are viable also selects for ideas where out-of-focus factors (C and D) are unviable.