# All robots will spider the domain

User-agent: *
Disallow:/WEB-INF/