Masakhane Community Documentation and Open NLP Guides
Community documents, meeting notes, initiatives, publications and onboarding guidance for participatory NLP research on African languages.
Search titles, authors, subjects and dates from across the DARE African Knowledge Repository.
18 resources found in the repository.
Community documents, meeting notes, initiatives, publications and onboarding guidance for participatory NLP research on African languages.
Five-course series on open, locally relevant and unbiased AI training data for African languages, earth observation, data sharing standards and bias mitigation, with SCORM and video replication materials.
Translations of a subset of XNLI into 16 African languages with validation and test splits for natural language inference evaluation.
Translations of a subset of MMLU into 15 African languages to benchmark multitask knowledge and reasoning.
A 0.4B-parameter transformer language model trained on African languages by Lelapa AI, released with associated research (arXiv:2408.17024).
First large publicly available high-quality NER dataset for ten African languages, with PER/ORG/LOC/DATE annotations and train/dev/test splits.
Evaluation set of GSM8K translations into 16 African languages with 250 test problems per language for multilingual mathematical reasoning.
110,000+ annotated tweets for sentiment analysis across 14 under-represented African languages.
Largest publicly available topic-classification dataset based on Flores-200, covering 205 languages and dialects with a compact seven-class label set.
Speech version of FLoRes with ~2,009 n-way parallel sentences per language read by native speakers, for ASR, ST and language ID evaluation.
Largest MT benchmark for African languages in the news domain, with train/dev/test English-or-French to African-language translation pairs.
Human-annotated multilingual instruction-tuning dataset curated via an open-science annotation programme with substantial African-language participation.