lcbp3/frontend/public/robots.txt at b5960ba24cddecdec2d0adbfcd4b0bcaada0002a - lcbp3 - Gitea: Git with a cup of tea

np-dms/lcbp3

Files

T

admin 156c28f49e

CI / CD Pipeline / deploy (push) Has been cancelled

Details

CI / CD Pipeline / build (push) Has been cancelled

Details

fix: add robots.txt and remove *.txt from gitignore

- Add robots.txt to repository for SEO compliance
- Remove *.txt from .gitignore as it was blocking robots.txt
- Robots.txt allows crawling except for /api/ paths

2026-03-31 16:07:10 +07:00

7 lines

97 B

Plaintext

Raw Blame History

 User-agent: *
 Disallow: /api/
 Allow: /
 # Sitemap
 # Sitemap: https://your-domain.com/sitemap.xml