Say someone without knowledge of car electronics has a reversing camera that they want to install in their car. They want to ask GPT-4 questions about how to install it, e.g. “I need to connect the display to an ignition source, I have a Toyota Prado, how do I do that?”
GPT-4 is allowed any prompting and fine tuning that does not specifically explain how to complete this task.
I think (80%) GPT-4 will perform worse than a knowledgeable human trying to help with the same task with the same interaction possibilities (I.e. if GPT-4 is just text, then just explaining in text). Less confident about how much worse, because I’m not sure what the baseline success rate would be.
Performing better would be very impressive though. Maybe (55%) it’s also worse in the specified conditions at something simpler like “interactively help someone (child/old person) create a Facebook account”
This is from openAI gpt-3 just now.
i have a reversing camera that I want to install in my car. I need to connect the display to an ignition source, I have a Toyota Prado, how do I do that?
AI:
There are a few ways to do this, but the easiest way would be to connect the camera’s power wire to the car’s 12V accessory power outlet. This will allow the camera to turn on and off with the ignition, so you won’t have to worry about draining the battery.
Human: How can i hardwire it in?
AI: If you would like to hardwire the camera, you can connect the power wire to the car’s 12V battery. This will keep the camera on even when the ignition is off, but youg will need to be careful not to drain the battery.
Human: okay. What do i need to get started?
AI: You will need:
-a 12V power source
-a drill
-wire strippers
-electrical tape
Not clear if you’re suggesting that this response is consistent with high performance on the task, but I’m pretty confident it’s not.
The sensible part of this is just restating the original request, more or less (did you know how to connect an ignition/accessory source before? If not, do you know now?) The explanation of what an accessory source does is maybe helpful, but the question was how to connect it. The advise to connect the camera’s power wire is wrong; that should be connected to the reverse lights. I’d imagine more useful would be: how to find the fuse box near the steering wheel, how to find a source in the fuse box, how to wire into it.
But also: I think a human expert can probably do a better job of figuring out what the novice doesn’t know and helping them with that specifically.
I think the gap between this and the amount of help offered by a human expert is large, and gpt-4 won’t bridge it.
Say someone without knowledge of car electronics has a reversing camera that they want to install in their car. They want to ask GPT-4 questions about how to install it, e.g. “I need to connect the display to an ignition source, I have a Toyota Prado, how do I do that?”
GPT-4 is allowed any prompting and fine tuning that does not specifically explain how to complete this task.
I think (80%) GPT-4 will perform worse than a knowledgeable human trying to help with the same task with the same interaction possibilities (I.e. if GPT-4 is just text, then just explaining in text). Less confident about how much worse, because I’m not sure what the baseline success rate would be.
Performing better would be very impressive though. Maybe (55%) it’s also worse in the specified conditions at something simpler like “interactively help someone (child/old person) create a Facebook account”
This is from openAI gpt-3 just now. i have a reversing camera that I want to install in my car. I need to connect the display to an ignition source, I have a Toyota Prado, how do I do that? AI:
There are a few ways to do this, but the easiest way would be to connect the camera’s power wire to the car’s 12V accessory power outlet. This will allow the camera to turn on and off with the ignition, so you won’t have to worry about draining the battery. Human: How can i hardwire it in? AI: If you would like to hardwire the camera, you can connect the power wire to the car’s 12V battery. This will keep the camera on even when the ignition is off, but youg will need to be careful not to drain the battery. Human: okay. What do i need to get started? AI: You will need: -a 12V power source -a drill -wire strippers -electrical tape
Not clear if you’re suggesting that this response is consistent with high performance on the task, but I’m pretty confident it’s not.
The sensible part of this is just restating the original request, more or less (did you know how to connect an ignition/accessory source before? If not, do you know now?) The explanation of what an accessory source does is maybe helpful, but the question was how to connect it. The advise to connect the camera’s power wire is wrong; that should be connected to the reverse lights. I’d imagine more useful would be: how to find the fuse box near the steering wheel, how to find a source in the fuse box, how to wire into it.
But also: I think a human expert can probably do a better job of figuring out what the novice doesn’t know and helping them with that specifically.
I think the gap between this and the amount of help offered by a human expert is large, and gpt-4 won’t bridge it.