About
AI2Bot crawls web content for the Allen Institute for AI to build open training datasets such as Dolma, which back its open language models.
Allen Institute training datasets
Details
- Type
- AI crawler
- Operator
- Allen Institute for AI
- Access
- Direct — crawls on the operator’s own schedule
- Traffic rank
- Documentation
- https://allenai.org/crawler