agents.txt for www.allied.vc
Created to optimize SEO and control crawler access on Squarespace
Allow all major user-agents full access to public-facing pages
User-agent: *
Disallow Squarespace system paths
Disallow: /search Disallow: /tag/ Disallow: /category/ Disallow: /archive/ Disallow: /blog/?author= Disallow: /blog/?format= Disallow: /blog/?tag= Disallow: /blog/?category= Disallow: /blog/?month= Disallow: /blog/?year= Disallow: /blog/?feed= Disallow: /blog/?utm_ Disallow: /blog/**?share=* Disallow: /config/ Disallow: /api/
Allow primary site sections
Allow: / Allow: /about Allow: /portfolio Allow: /apply Allow: /contact Allow: /thesis Allow: /founders Allow: /investors Allow: /news Allow: /scout Allow: /advise Allow: /guides Allow: /articles Allow: /rollup Allow: /glossary Allow: /tools
Allow crawl of Squarespace "Not Linked" pages that are valuable
Allow: /privacy Allow: /acknowledgments Allow: /testimonials
Sitemap location
Sitemap: https://www.allied.vc/sitemap.xml