156c28f49e
- Add robots.txt to repository for SEO compliance - Remove *.txt from .gitignore as it was blocking robots.txt - Robots.txt allows crawling except for /api/ paths