User-agent: * # Block spam/junk URL patterns Disallow: /travel/ Disallow: /stock-holdings/ Disallow: /together/ Disallow: /through/ Disallow: /news/ Disallow: /blog/ Disallow: /casino/ Disallow: /gambling/ Disallow: /crypto/ Disallow: /bitcoin/ Disallow: /forex/ Disallow: /trading/ Disallow: /loan/ Disallow: /loans/ Disallow: /credit/ Disallow: /insurance/ Disallow: /mortgage/ Disallow: /finance/ Disallow: /pharmacy/ Disallow: /pills/ Disallow: /viagra/ Disallow: /cbd/ Disallow: /drug/ Disallow: /drugs/ Disallow: /porn/ Disallow: /xxx/ Disallow: /sex/ Disallow: /adult/ Disallow: /dating/ Disallow: /escort/ Disallow: /watch/ Disallow: /download/ Disallow: /streaming/ Disallow: /movie/ Disallow: /movies/ Disallow: /film/ Disallow: /cheap/ Disallow: /discount/ Disallow: /sale/ Disallow: /offer/ Disallow: /deal/ Disallow: /buy/ Disallow: /online/ Disallow: /shop/ Disallow: /store/ Disallow: /outlet/ Disallow: /market/ # Allow legitimate paths Allow: /sailboat-listings Allow: /forum Allow: /dashboard Allow: /profile Allow: /api # Block admin and auth paths Disallow: /admin/ Disallow: /auth/ Disallow: /password/ Disallow: /email/ Disallow: /webhooks/ # Sitemap location (create this if you haven't already) Sitemap: https://sailboatsforsale.com/sitemap.xml