# All robots should avoid mirrored and internal pages User-agent: * Disallow: /epics Disallow: /asd Disallow: /Docs Disallow: /control/Soft/cdev Disallow: /control/SoftDist/dm2k/download Disallow: /control/SoftDist/MultiCAN/download Disallow: /control/SoftDist/p_server/download Disallow: /cgi-bin/lwgate Disallow: /MailLists #Disallow: /cgi-bin