User-agent: * Disallow: /bbjavascript Disallow: /bbflash Disallow: /components Disallow: /common Disallow: /config Disallow: /css Disallow: /framework Disallow: /general Disallow: /includes Disallow: /javascript Disallow: /specific Disallow: /styles Disallow: /survey Disallow: /crawl.html # exclude crawl.html - needs to be available for FAST User-agent: FAST NXP Campaign Crawler Disallow: / Allow: /crawl.html Allow: /breaklimits/ Allow: /savespace/ Allow: /radiousb/ Allow: /3g_andmore/ Allow: /wireless_usb/ Allow: /radiousb/