User-agent: * Disallow: /pages/ Disallow: /index.php Disallow: /1/