User-agent: *

Disallow: /api/
Disallow: /core/
Disallow: /data/