User-agent: * 
Disallow: /assests/
Disallow:/cgi-bin/
Disallow:/images/