User-agent: * Allow: /*.html$ Disallow: /*.asp$