> One other way I have been thinking of is just delay the delivery of the pages, either limit bandwidth or just wait for a bit until you deliver the page. For one user a (lets say max)3s delay on some pages is not a huge deal, however at scale that adds up and means the client can't gather other pages in the meantime
Or some kind of vintage “set up a request in a form and press a submit form, and we’ll pretend to take a while to put things together.”
However you can implement it. There are several options but probably you'll want to do it server side since I believe most bots don't run javascript. If you search there are ways to implement something similar in nginx using modules or buildins.
Or some kind of vintage “set up a request in a form and press a submit form, and we’ll pretend to take a while to put things together.”