Inference kernels look like kernels (the core component of an operating system) specifically optimized to handle AI inference tasks. Aside from that … not sure, there’s a lot of possible numbers going on, but if it was specifically in the choosing by probability step and moderately equivalent to “higher temperature” the output would effectively get much more random, though might still be constrained to a near-sensible coherence.
Inference kernels look like kernels (the core component of an operating system) specifically optimized to handle AI inference tasks. Aside from that … not sure, there’s a lot of possible numbers going on, but if it was specifically in the choosing by probability step and moderately equivalent to “higher temperature” the output would effectively get much more random, though might still be constrained to a near-sensible coherence.