GreaterWrong is calling the same API against the LW server, then serving the resulting data to you as HTML. As a result it has the same limitations, so if you keep going to the next page on Recent Comments, eventually you’ll get to https://www.greaterwrong.com/recentcomments?offset=2020 and get an error “Exceeded maximum value for skip”.
Idle suggestion, probably not useful: have you checked if you can do what you want by using GreaterWrong instead?
GreaterWrong is calling the same API against the LW server, then serving the resulting data to you as HTML. As a result it has the same limitations, so if you keep going to the next page on Recent Comments, eventually you’ll get to https://www.greaterwrong.com/recentcomments?offset=2020 and get an error “Exceeded maximum value for skip”.