Is complexity objective?
Kinda. Some notions of complexity are more useful than others. However, condition your machine on some real world sense data for a while, and any reasonable prior soon gets swamped by data—so in practice, this is not a big deal.
If it was a matter of gathering enough data we wouldn’t have to talk about Solomonoff induction at all.
Kinda. Some notions of complexity are more useful than others. However, condition your machine on some real world sense data for a while, and any reasonable prior soon gets swamped by data—so in practice, this is not a big deal.
If it was a matter of gathering enough data we wouldn’t have to talk about Solomonoff induction at all.