User-agent: *
Disallow: /web/1
Disallow: /web/2
Crawl-delay: 3