Skip to content

fahmih6/Weebs_Scraper

Repository files navigation

Weebs Scraper

Web scraper for Anoboy, Komiku, and Komikcast. Build using Node JS.

Getting Started

  1. Clone the repository, and navigate to the repository directory.

  2. Setup .env for Anoboy Link and Komikcast Link (Anoboy often get changed time to time, so make sure to check it regularly). Example :

ANOBOY_LINK="Enter Anoboy Link Here"
KOMIKCAST_LINK="Enter Komikcast Link Here"
  1. Run npm install.

  2. Run the code.

npm run start

Sample Result

  • Note that this scraper is deployed on a free Render service, so some features may not work properly and, it maybe out of quota sometimes.
  • Looks like our free IP/Domain has been blocked by Anoboy and Komikcast on some VPS providers, returning 403 errors.

Handling 403 Errors (Proxy)

If you are running this on a VPS and encounter a 403 Forbidden error (especially for Komikcast), it means the hosting IP is blocked by Cloudflare.

To fix this, you can set a proxy in services/manga-service-v2.js:

const proxyConfig = {
  protocol: "http",
  host: "your-proxy-ip",
  port: your - port,
  auth: {
    username: "your-username",
    password: "your-password",
  },
};

const axiosConfig = {
  timeout: 15000,
  proxy: proxyConfig,
  headers: {
    // ... headers
  },
};

Or ideally, use the KOMIKCAST_PROXY environment variable if the logic is implemented to read from .env.

1. Anoboy

https://weeb-scraper.onrender.com/api/anoboy
https://weeb-scraper.onrender.com/api/anoboy?s=kaguya
https://weeb-scraper.onrender.com/api/anoboy/2022~12~bleach-sennen-kessen-hen-episode-9~

2. Komiku

https://weeb-scraper.onrender.com/api/komiku
https://weeb-scraper.onrender.com/api/komiku?s=Kaguya

3. Komikcast

https://weeb-scraper.onrender.com/api/komikcast
https://weeb-scraper.onrender.com/api/komikcast?s=Kaguya

About

Web Scraper for Komikcast, Komiku, and Anoboy.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors