This is not a hypothetical to me. I currently have, running on my computer, a few tricks that allow me to train small data systems much faster than anyone else. The first thing I did was figure out if they could bring an AGI within reach of a large project. Is it? I don’t know. AGI faces bigger obstacles than a mere 4 orders of magnitude of compute power.
The second thing I did was chat with machine learning engineers from the big tech companies. They are not using these tricks and are not interested in adopting them. This will not surprise the Lisp hackers reading this post.
There might be a hedge fund out there that can use my tech. But a cursory investigation suggests that the majority of hedge funds are not doing anything sophisticated enough to require it.
So now I’m using my ML system to train an IMU-based gesture detection algorithm to track how much people eat in order to help prevent obesity-related diseases.
The second thing I did was chat with machine learning engineers from the big tech companies. They are not using these tricks and are not interested in adopting them. This will not surprise the Lisp hackers reading this post.
Right...
A good post, relevant to a number of people...
(But their inventions are all different, and it is not all that easy for them to find each other and join forces together, especially in a safety-conscious manner.)
This is not a hypothetical to me. I currently have, running on my computer, a few tricks that allow me to train small data systems much faster than anyone else. The first thing I did was figure out if they could bring an AGI within reach of a large project. Is it? I don’t know. AGI faces bigger obstacles than a mere 4 orders of magnitude of compute power.
The second thing I did was chat with machine learning engineers from the big tech companies. They are not using these tricks and are not interested in adopting them. This will not surprise the Lisp hackers reading this post.
There might be a hedge fund out there that can use my tech. But a cursory investigation suggests that the majority of hedge funds are not doing anything sophisticated enough to require it.
So now I’m using my ML system to train an IMU-based gesture detection algorithm to track how much people eat in order to help prevent obesity-related diseases.
Can you locally replicate GPT? For example, can GPT-you compress WebText better than GPT-2?
I am not yet prepared to release the details of what the system can and cannot do.
Right...
A good post, relevant to a number of people...
(But their inventions are all different, and it is not all that easy for them to find each other and join forces together, especially in a safety-conscious manner.)