#/robots.txt file to direct robots, crwlers, etc.

User-agent: *
Disallow: /data01
Disallow: /test
Disallow: /_private