FOR PUBLISHERS
YouthOppsBot
A transparent crawler for public opportunities.
YouthOpp is an independent project run by an individual. It is not a registered nonprofit organization.
What we index
We collect factual information about scholarships, programmes, internships and other early-career opportunities from public pages and feeds. We credit and link to original publishers. Publishers remain the authority for eligibility, deadlines and applications; we do not reproduce full articles.
Identify our requests
Our crawler uses this HTTP User-Agent:
YouthOppsBot/1.0 (+https://youthopps.org/bot/)How we collect
We review robots.txt and applicable source terms before integrating a source. Collection uses public routes and respects access refusals; it does not bypass authentication or access restrictions.
Our collection policy requires each adapter to space publisher requests at least six seconds apart and allow no more than ten request starts in any rolling minute. Stricter source limits take priority. Publisher-wide request budgets are shared where required.
We back off after rate limits and temporary errors, honor applicable Retry-After instructions, and stop when access is refused or a source requires permission. Collection status and the last successful update are available on our source pages.
Questions, corrections and removal
Email [email protected] for crawler questions, private concerns, or requests to correct or remove a link or source. Include the affected URLs; a reason is optional. Please do not post sensitive information publicly.
A maintainer reviews requests; submitting a request does not automatically remove content. Current listings and historical Git copies are separate. See our source-removal policy and contact options.