Crawling Gopher and gemini

[TheWanderer1983]

Have you considered incorporating Gopher and Gemini into this? Both really are part of the Small web.

[vprelovac]

not sure how would that work in the context of Small Web project as (afaik) both of these are not displayable in regular browsers?

[TheWanderer1983]

Both have proxies available that make them displayable via regular browsers.

example
https://gopher.floodgap.com/gopher/
https://portal.mozz.us/gemini/geminiprotocol.net/

[vprelovac]

Sure, can you add a few websites that would be relevant and show a way for them to be shown through proxy?

you can create a new file smallgopher.txt and smallgemini.txt for this