There are things you can do about this. The most obvious one is to normalize the gradients at each stage. Also, LSTMs were created to help with this issue.
If these fixes are not enough to make neuralese work, you can take this post as claiming that neuralese would be good if it worked. :)
There are things you can do about this. The most obvious one is to normalize the gradients at each stage. Also, LSTMs were created to help with this issue.
If these fixes are not enough to make neuralese work, you can take this post as claiming that neuralese would be good if it worked. :)