The rate is currently 1rps, which should be mentioned in the robots.txt file. …We may increase that in the months to come, so it could be worth re-checking. Thanks!
The rate is currently 1rps, which should be mentioned in the robots.txt file. …We may increase that in the months to come, so it could be worth re-checking. Thanks!