User-agent: * Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /author Disallow: /tag Disallow: /contact-us/ Disallow: /direct-download/