User-agent: * Allow: / # Allow specific crawlers explicitly User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / User-agent: MJ12bot Allow: / User-agent: DotBot Allow: / Sitemap: https://nusatechno.id/sitemap.xml