Very true! Each iteration of matching pursuit uses as much compute as the entire encode() of a standard SAE, so it’s not only a parallelism problem (although it doesn’t help either). I’ll update the wording in the post.
encode()
Very true! Each iteration of matching pursuit uses as much compute as the entire
encode()of a standard SAE, so it’s not only a parallelism problem (although it doesn’t help either). I’ll update the wording in the post.