Great summary, and I swear I saved this question until reading to the end, but… Unity? Really? Huh. Maybe the extra cost is small because of simple environments and graphics processing being small relative to agent processing.
Great summary, and I swear I saved this question until reading to the end, but… Unity? Really? Huh. Maybe the extra cost is small because of simple environments and graphics processing being small relative to agent processing.