Thanks! There are 17k virus genomes in public online databases with metadata (and plenty of metadata embedded in GPT-JT regarding lethality, transmissibility, etc of well known viruses).
Considering the hobbyist group with the most hands-on experience fine-tuning models are the guys using SD to make porn, how long until one of them (one!) gets bored and downloads GPT-JT and fine-tunes it on viruses for the lolz?
12 months? 6?
Then how long until someone (one!) with lab access decides to synthesize a few instead of shooting up a school?
Thanks! There are 17k virus genomes in public online databases with metadata (and plenty of metadata embedded in GPT-JT regarding lethality, transmissibility, etc of well known viruses).
Considering the hobbyist group with the most hands-on experience fine-tuning models are the guys using SD to make porn, how long until one of them (one!) gets bored and downloads GPT-JT and fine-tunes it on viruses for the lolz?
12 months? 6?
Then how long until someone (one!) with lab access decides to synthesize a few instead of shooting up a school?
24 months?
Two wackos away from a nightmare scenario.
Also, the Future of Life just released a podcast where a researcher trying to make low-lethality drugs just switched the prompt to high-lethality to see what would happen… Turns out the model independently discovered VX nerve agent 🤦♂️: https://twitter.com/flixrisk/status/1611364739539427329?s=46&t=RG78qN0CmOSULwUFowilUA
I could be wrong but it seems like engineering pandemic candidates is within the reach of fine-tuning hobbyists today.
This realistically seems like the first Bostrom black ball. Only hope I see is aligned ASI but few people expect it within the next 3 years.