wikiless.tiekoetter.com
-
URL: https://wikiless.tiekoetter.com
Alternative front-end for Wikipedia
Source code: https://github.com/tiekoetter/Wikiless
-
I guess Wikipedia has finally decided to block my Server.
The back-end reports 429 from the wikipedia.org servers.
Currently Wikiless doesn't support proxy servers. I would have to fork Wikiless and implement it myself for it use my proxy back-end. I may have to look into this in the future.
-
I have implemented very long caching rules. This should mitigate the hammering of the wikipedia.org servers. From my usage when encountering an "INVALID_HTML" page (429 from upstream) refreshing a few times will get the page eventually. These cached pages are considered fresh for 6 hours and stale for up to 1 day, afterwards they are discarded if no other user requests the page in the meantime.
This is not optimal but a good enough intermediate solution.
-
After a bit more testing and one full day of evaluation Wikiless is now restored.
The aggressive caching didn't really help. I added Anubis on top of Wikiless and after a few minutes it completely removed the rate limit on the back-end.
Meaning JavaScript is now required for Wikiless but the barrage of bot requests gets filtered out. In my opinion a fair trade off.Shoutout to Anubis. This software is incredible at stopping bots/scrapers https://github.com/TecharoHQ/anubis
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login