# robots.txt — fpcoding.nl User-agent: * Allow: / Disallow: /panel/ Disallow: /portal/ Disallow: /klantenportaal/ Disallow: /mail/ Disallow: /maintenance/ Disallow: /includes/ Disallow: /PHPMailer/ Disallow: /push-daemon/ Disallow: /scripts/ # Demo's/concepten zijn klantpresentaties, geen zoekresultaten. Blijven gewoon # bereikbaar via een directe link; alleen niet crawlen (kost crawlbudget en # levert duplicate content op t.o.v. de echte site). Disallow: /demo/ Disallow: /enquete/ Disallow: /share/ Disallow: /events/ Disallow: /onderhoud.php Disallow: /status.php Disallow: /process_form.php Disallow: /payment.php Disallow: /paymentSucceed.php Disallow: /paymentDeclined.php Disallow: /newsletter_subscribe.php Disallow: /newsletter_unsubscribe.php Disallow: /error_page.php Disallow: /pagenotfound.html Disallow: /pitch Disallow: /pitch.html Disallow: /quote Disallow: /quote.php Disallow: /indexold.php Disallow: /*?*utm_ Disallow: /*?*gclid= Disallow: /*?*fbclid= # AI / LLM crawlers — toegestaan voor publieke pagina's User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: Applebot-Extended Allow: / # Bekende kwaadaardige / agressieve scrapers blokkeren User-agent: AhrefsBot Disallow: /* User-agent: SemrushBot Disallow: /* User-agent: MJ12bot Disallow: /* User-agent: DotBot Disallow: /* Sitemap: https://fpcoding.nl/sitemap.xml Host: fpcoding.nl