Sorry, explain again why floods of neurotransmitter molecules bopping around are ideally thermodynamically efficient? You’re assuming that they’re trying to do multiplication out to 8-bit precision using analog quantities? Why suppose the 8-bit precision? Even if that part was actually important, why not perhaps ding biology a few engineering points for trying to represent it using analog quantities requiring 2^16 particles bopping around? Optimally doing something incredibly inefficient is incredibly inefficient.
Sorry, explain again why floods of neurotransmitter molecules bopping around are ideally thermodynamically efficient? You’re assuming that they’re trying to do multiplication out to 8-bit precision using analog quantities? Why suppose the 8-bit precision?
I’m not assuming that, but its nonetheless useful as a benchmark for comparison. It helps illustrate that 1e5 eV is really not much—it just allows a single 8-bit analog mult for example.
Earlier in the thread I said:
Now most synapses are probably smaller/cheaper than 8-bit equiv, but most of the energy cost involved is in pushing data down irreversible dissipative wires (just as true in the brain as it is in a GPU). Now add in the additional costs of synaptic adjustment machinery for learning, cell maintenance tax, dendritic computation, etc
The synapse is clearly doing something somewhat more complex than just analog multiplication.
And in terms of communication costs (which are paid at the synaptic junction for the synapse → dendrite → soma path), that 1e5 eV is only enough to carry a reliable 1 bit signal only about ~100mm (1e5 nm) distance through irreversible nano/micro scale wires (the wire bit energy for axons/dendrites and modern cmos is about the same).
Reversible interconnect is much more complex—requires communicating through fully isolated particles over the wire distance, which is obviously much more practical for photons for various reasons, but they are very large etc. Many complex tradeoffs.
And in terms of communication costs (which are paid at the synaptic junction for the synapse → dendrite → soma path), that 1e5 eV is only enough to carry a reliable 1 bit signal only about ~100mm (1e5 nm) distance through irreversible wires (the wire bit energy for axons/dendrites and modern cmos is about the same).
If it applies in the specific cases of axons and cmos there should be justification of why it does, though given the amount of prior discussion I don’t think this would be fruitful.
No—Coax cables are enormous in radius (EM wavelengths), and do not achieve much better than 1 eV / nm in practice. In the same waveguide radius you can you just remove the copper filler and go pure optical and then get significantly below 1 eV/nm anyway—so why even mention coax?
The only thing that was ‘debunked’ was in a tangent conversation that had no bearing on the main point (about nanoscale wire interconnect smaller than EM wavelength—which is irreversible and consumes close to 1 eV/nm in both brains and computers), and it was just my initial conception that coax cables could be modeled in simplification as relays like RC interconnect.
There are many complex tradeoffs between size, speed, energy, etc. Reversible and irreversible comms occupy different regions of that pareto surface. Reversible communication is isomorphic to transmitting particles—in practice always photons—and requires complex/large transmitter/receivers and photon sized waveguides etc. Irreversible communication is isomorphic to domino-based computing, and has the advantage—and cost—of full error correction/erasure at every cycle, and easier to guide down narrow and complex paths.
Sorry, explain again why floods of neurotransmitter molecules bopping around are ideally thermodynamically efficient? You’re assuming that they’re trying to do multiplication out to 8-bit precision using analog quantities? Why suppose the 8-bit precision? Even if that part was actually important, why not perhaps ding biology a few engineering points for trying to represent it using analog quantities requiring 2^16 particles bopping around? Optimally doing something incredibly inefficient is incredibly inefficient.
I’m not assuming that, but its nonetheless useful as a benchmark for comparison. It helps illustrate that 1e5 eV is really not much—it just allows a single 8-bit analog mult for example.
Earlier in the thread I said:
The synapse is clearly doing something somewhat more complex than just analog multiplication.
And in terms of communication costs (which are paid at the synaptic junction for the synapse → dendrite → soma path), that 1e5 eV is only enough to carry a reliable 1 bit signal only about ~100mm (1e5 nm) distance through irreversible nano/micro scale wires (the wire bit energy for axons/dendrites and modern cmos is about the same).
Reversible interconnect is much more complex—requires communicating through fully isolated particles over the wire distance, which is obviously much more practical for photons for various reasons, but they are very large etc. Many complex tradeoffs.
This model of interconnect energy has been thoroughly debunked here, as coax cables violate it by a factor of 200: https://www.lesswrong.com/posts/fm88c8SvXvemk3BhW/brain-efficiency-cannell-prize-contest-award-ceremony
If it applies in the specific cases of axons and cmos there should be justification of why it does, though given the amount of prior discussion I don’t think this would be fruitful.
No—Coax cables are enormous in radius (EM wavelengths), and do not achieve much better than 1 eV / nm in practice. In the same waveguide radius you can you just remove the copper filler and go pure optical and then get significantly below 1 eV/nm anyway—so why even mention coax?
The only thing that was ‘debunked’ was in a tangent conversation that had no bearing on the main point (about nanoscale wire interconnect smaller than EM wavelength—which is irreversible and consumes close to 1 eV/nm in both brains and computers), and it was just my initial conception that coax cables could be modeled in simplification as relays like RC interconnect.
There are many complex tradeoffs between size, speed, energy, etc. Reversible and irreversible comms occupy different regions of that pareto surface. Reversible communication is isomorphic to transmitting particles—in practice always photons—and requires complex/large transmitter/receivers and photon sized waveguides etc. Irreversible communication is isomorphic to domino-based computing, and has the advantage—and cost—of full error correction/erasure at every cycle, and easier to guide down narrow and complex paths.