User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: PetalBot Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: megaIndex.ru Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: SEOkicks Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: Orbbot Disallow: / User-Agent: * Crawl-delay: 30 Disallow:/api/ Disallow:/css/ Disallow:/assets/ Disallow:/fonts/ Disallow:/locales/ Disallow:/widget_images/ Disallow:/bookstore-finder/ Disallow:/advanced-search/ #Disallow:/product/ Disallow:/cart/ Disallow:/search/ Disallow:/profile/ Disallow:/payone/ Disallow:/account/ Disallow:/images/ Disallow:/include/ Disallow:/javascript/ Disallow:/messages/ Disallow:/modules/ Disallow:/video/ #disable consent for bots #Disallow: https://cdn.consentmanager.net/*