wikiless.tiekoetter.com
-
URL: https://wikiless.tiekoetter.com
Alternative front-end for Wikipedia
Source code: https://codeberg.org/orenom/Wikiless (Mirror: https://github.com/Metastem/wikiless)
-
I guess Wikipedia has finally decided to block my Server.
The back-end reports 429 from the wikipedia.org servers.
Currently Wikiless doesn't support proxy servers. I would have to fork Wikiless and implement it myself for it use my proxy back-end. I may have to look into this in the future.
-
I have implemented very long caching rules. This should mitigate the hammering of the wikipedia.org servers. From my usage when encountering an "INVALID_HTML" page (429 from upstream) refreshing a few times will get the page eventually. These cached pages are considered fresh for 6 hours and stale for up to 1 day, afterwards they are discarded if no other user requests the page in the meantime.
This is not optimal but a good enough intermediate solution.
-
After a bit more testing and one full day of evaluation Wikiless is now restored.
The aggressive caching didn't really help. I added Anubis on top of Wikiless and after a few minutes it completely removed the rate limit on the back-end.
Meaning JavaScript is now required for Wikiless but the barrage of bot requests gets filtered out. In my opinion a fair trade off.Shoutout to Anubis. This software is incredible at stopping bots/scrapers https://github.com/TecharoHQ/anubis
