Open data

Bayanat Labs Open: Free Arabic Dataset Resources

Every free Arabic dataset, tool and benchmark published by Bayanat Labs, with licence, DOI and citation (updated 4 November 2026). اقرأ بالعربية ←

Seeing BayanatLabs-OpenData in your logs? About our crawler

In the catalogue

36open releases
19datasets
4benchmarks
10tools
1report
2guides
3with a Zenodo DOI

Releases

Benchmark · Live

Bayanat Labs Arabic Citation Check

5,045 citation judgments over 2,240 works with DOIs: do Arabic references exist, and are they attributed correctly? Open data and a checker.

CC BY 4.0 (judgments, labels, results and page text); CC0 1.0 (work index, from OpenAlex); Apache-2.0 (checker code) · Updated
Tool · Live

Bayanat Labs Arabic Data Cost and Pilot Estimator

Illustrative Arabic data cost and pilot estimates from your own assumptions, not a quote: line-item hours, a range, a timeline and a pilot statement of work.

Apache-2.0 (code and app); CC BY 4.0 (fixtures, examples and page text); SIL OFL (fonts) · Updated
Dataset · Live

Bayanat Labs Open Arabic Books

1,545 Hindawi Foundation books from The Arabic E-Book Corpus, split into chapters with footnotes, front matter and licence wording set apart. CC BY 4.0.

CC BY 4.0 (dataset and page text), with the rights of each book as its colophon states them; Apache-2.0 (builder code) · Updated
Dataset · Live

Bayanat Labs Synthetic Saudi E-Invoices, Receipts and Bilingual Forms

Fully synthetic Saudi-style invoices, receipts and forms: 25,000 generated records, 34,517 clean page images, 103,551 degraded variant images. CC BY 4.0.

CC BY 4.0 (data, page text); Apache-2.0 (code); SIL OFL (fonts) · Updated
Dataset · Live

Bayanat Labs Arabic-Latin Name Variants

Latin spellings of Arabic names from Wikidata: 236,025 spellings of 144,875 Arabic name words, with labelled name pairs and a name-matching benchmark. CC0 1.0.

CC0 1.0 (data, derived from Wikidata); CC BY 4.0 (page text); Apache-2.0 (code) · Updated
Dataset · Live

Bayanat Labs Arabic Data Index

As of 1 November 2026, 3,564 de-duplicated Arabic AI datasets are on Hugging Face or in Masader; 46.94% declare an open-commercial licence, 12.71% none.

CC BY 4.0 (aggregates, charts and page text); CC0 1.0 (entities table); Apache-2.0 (code); each indexed dataset keeps its own licence · Updated
Dataset · Live

Bayanat Labs Arabic Web Rights Census

824 of 33,985 hosts checked, Arabic-language sites and popular domains under Arab and Arabic-script TLDs, block at least one AI-training crawler in robots.txt.

CC0 1.0 (data); CC BY 4.0 (card text, stats.json and charts); Apache-2.0 (code and web app) · Updated
Dataset · Live

Bayanat Labs Arabic Wikisource Public-Domain Works

40,782 public-domain works from Arabic Wikisource in chapters, with author, translator and editor death dates from Wikidata and a public-domain tier per work.

CC BY-SA 4.0 (transcribed text, from Arabic Wikisource contributors); CC BY 4.0 (tables, statistics and checks); Apache-2.0 (builder code) · Updated
Tool · Live

Bayanat Labs polite-fetch Crawler Library

Python library that fetches web pages under a published crawler policy: robots.txt, AI crawler blocks, TDMRep, Content-Signal, noai and stop rules.

Apache-2.0 (code); CC BY 4.0 (documentation); CC0 1.0 (crawler policy); MIT (bundled AI crawler names from ai.robots.txt) · Updated
Dataset · Live

Bayanat Labs Arab World Places Atlas

Free dataset of 1,301,051 places, 373,035 named streets and 185,214 admin areas in 22 Arab states, with Arabic and Latin names side by side.

Component-specific: CDLA-Permissive-2.0, Apache-2.0 or CC0-1.0 per place (Overture places); ODbL-1.0 for streets, divisions and place-name pairs (© OpenStreetMap contributors); Apache-2.0 for build scripts · Updated
Dataset · Live

Bayanat Labs Arab-World Wikidata Slice

844,634 Wikidata items tied to the 22 Arab League states, as Parquet from the 26 October 2026 dump, with an Arabic label gap index per state. CC0 1.0.

CC0 1.0 (data, from Wikidata); Apache-2.0 (builder code); CC BY 4.0 (documentation in the GitHub repository); Wikimedia Commons files named in the image column keep their own licences · Updated
Dataset · Live

Bayanat Labs Arabic Dataset Rights Index

Licence verdicts for 120 datasets on Hugging Face, the top 100 tagged Arabic and known copies: commercial training, redistribution, share-alike and card flags.

CC BY 4.0 (verdicts, flags, notes and documentation); CC0 1.0 (Hub metadata facts); Apache-2.0 (code); quoted card text stays under its owners' terms · Updated
Dataset · Live

Bayanat Labs Arabic Gazetteer

246,637 places in the 22 Arab League states with Arabic and Latin-script name variants, admin paths and place-matching examples. CC BY 4.0.

CC BY 4.0 (dataset; contains data from GeoNames under CC BY 4.0 and from Wikidata under CC0 1.0); Apache-2.0 (builder code) · Updated
Tool · Live

Bayanat Labs Arabic NER Offset Validator

Check Arabic NER annotations for offset-unit mix-ups, normalisation drift, clitic and grapheme boundaries and BIO/BILUO tag errors. Free tool and test cases.

Apache-2.0 (code and web app); CC BY 4.0 (test cases, offset-convention matrix and documentation); Unicode-derived data under the Unicode License v3 · Updated
Dataset · Live

Bayanat Labs Open Arabic Speech Hours Counter

Released Arabic speech hours by licence class, as of 30 October 2026: 36,221 hours open for commercial use across 8 corpora, other classes shown beside it.

CC BY 4.0 (table, feed, badge and documentation); Apache-2.0 (code and widget); each counted corpus keeps its own licence, and quoted publisher text stays under its owners' terms · Updated
Tool · Live

Bayanat Labs Arabic Token-Tax Calculator

Count the tokens of Arabic text with LLM tokenizers in your browser, compare it with English, check a context budget and estimate cost at dated list prices.

Apache-2.0 (code and calculator page); CC BY 4.0 (fixtures, price table and documentation); tokenizer files keep their own licences (MIT or Apache-2.0) · Updated
Benchmark · Live

Bayanat Labs Arabic Token-Tax Index

How many more tokens Arabic takes than English: LLM tokenisers measured on UN parallel text, with bootstrap intervals and the cost of a page.

CC BY 4.0 (index data and documentation); Apache-2.0 (harness code and leaderboard); UN sentence pairs under the United Nations Parallel Corpus disclaimer · Updated
Dataset · Live

Bayanat Labs Arabic Wikipedia Monthly

Clean Arabic, Egyptian and Moroccan Arabic Wikipedia text (1 October 2026 dumps) with revision links, sections, infoboxes, tables and a template flag.

CC BY-SA 4.0 (article text, from Wikipedia); CC BY 4.0 (labels config and documentation); Apache-2.0 (builder code) · Updated
Dataset · Live

Bayanat Labs Arabic Form Field Extraction

Question-based extraction of field values and locations from synthetic Arabic forms. Covers spatial relations, missing fields and ambiguous requests.

CC BY 4.0 fixtures, images, annotations and documentation; Apache-2.0 code; unmodified Noto fonts under SIL OFL · Updated
Dataset · Live

Bayanat Labs Arabic Public Data Reasoning

6,419 controlled Arabic questions over 4,400 World Bank observations, with executable answers, visible source cells and economy-disjoint splits.

CC BY 4.0 data/annotations with mandatory World Bank source terms and provider attribution; Apache-2.0 code · Updated
Dataset · Live

Bayanat Labs Arabic AI Model Tracker

89 Arabic and Arabic-capable AI model releases from 29 labs: date, sizes, Arabic varieties named, lab-reported scores, licence and weights status.

CC BY 4.0 (register, exports, charts and documentation); Apache-2.0 (crawler and build code); quotations stay with their authors · Updated
Tool · Live

Bayanat Labs Dataset Licence Compatibility Checker

Check whether dataset sources can be merged, trained on or redistributed, with the obligations, release licence options and the clause behind each step.

Apache-2.0 (code and web app); CC BY 4.0 (rules, test cases, schemas and documentation); quotations from licences and terms stay under their owners' terms · Updated
Dataset · Live

Bayanat Labs Arabic Document Atlas

200,286 unique document images with machine OCR, approximate word guides and source evidence, plus separate community text and PDF/reference pairs.

Component-specific rights: institution-asserted public-domain ACO images; CC BY 4.0 annotations/docs; CC BY-SA 4.0 community text and reference pairs; Apache-2.0 code · Updated
Guide · Live

Bayanat Labs Arabic Annotation Guidelines Template

Free Arabic annotation guidelines template under CC BY 4.0: sections for dialect, diacritics, Arabizi, examples and pilots. Licence, citation and reuse terms.

CC BY 4.0 · Updated
Dataset · Live

Bayanat Labs Arabic ASR Channel Pairs

Free Arabic speech test set: FLEURS recordings, clean and under simulated telephone, codec and room conditions, in aligned pairs, with Whisper WER.

CC BY 4.0 (audio, metadata and measurements); CC BY-SA 4.0 (transcript text); CC0 1.0 (conditions file and impulse responses); Apache-2.0 (renderer code) · Updated
Tool · Beta

Bayanat Labs Arabic Text Normalizer (arabic-normalize)

Release record for arabic-normalize: named, versioned Arabic normalisation policies in Python and JavaScript, with conformance fixtures. Apache-2.0 code.

Apache-2.0 (code); CC BY 4.0 (conformance fixtures) · Updated
Tool · Live

Bayanat Labs Arabic PII Pack for Presidio

Release record for arabic-pii-pack: Presidio recognisers and redaction for Gulf and Egyptian IDs, Arab IBANs and phones, plates and Arabic names.

Apache-2.0 (code and in-browser redactor); CC BY 4.0 (evaluation set, results and documentation) · Updated
Benchmark · Live

Bayanat Labs Arabic Unicode Conformance Suite

Release record for the Arabic Unicode Conformance Suite: test cases with exact expected outputs under six named normalisation policies, and a runner.

CC BY 4.0 (cases, policy specifications, documentation and reports); Apache-2.0 (code) · Updated
Tool · Live

Bayanat Labs ArabicWER: Arabic WER and CER Scorer

Release record for ArabicWER: Arabic WER and CER under six named, versioned normalisation policies, with conformance fixtures and a FLEURS case study.

Apache-2.0 (code); CC BY 4.0 (policies, specification, fixtures and case-study outputs) · Updated
Guide · Live

Bayanat Labs Contributor Consent Templates

Free consent form, contributor agreement, privacy notice and more for collecting open Arabic data under the Saudi PDPL, in English and Arabic. CC BY 4.0.

CC BY 4.0 · Updated
Tool · Beta

Bayanat Labs Dataset Template and Release Kit

Release record for the Bayanat Labs dataset template: a copier template, a bilingual dataset-card standard and a release kit with a card linter and gates.

Apache-2.0 (code); CC BY 4.0 (standard and docs) · Updated
Dataset · Live

Bayanat Labs GCC Format Validators and Arabic ITN/TN Test Pairs

Release record: Arabic spoken and written test pairs for ITN and TN, with Gulf format tables and validators for IDs, IBANs, phones, plates and Hijri dates.

CC BY 4.0 (test pairs and tables); CC0 1.0 (format facts); Apache-2.0 (phone plans and code) · Updated
Report · Live

Bayanat Labs Open-Programme Policy and Operating Manual

Release record for the Bayanat Labs open policies: the open-programme policy, the gated operating manual and the bl-score tool, in English and Arabic.

CC BY 4.0 (text); Apache-2.0 (code) · Updated
Tool · Beta

Bayanat Labs Arabic Agent Reliability Lab

Arabic Agent Reliability Lab release record: a local harness that grades Arabic AI agents by tool calls and final state. Apache-2.0 code, CC BY 4.0 data.

Apache-2.0 (code); CC BY 4.0 (open scenarios and receipts) · Updated
Dataset · Live

Bayanat Labs Arabic Retrieval Starter Kit

Download the free Arabic Retrieval Starter Kit v0.1: a synthetic Arabic and English RAG evaluation fixture under CC BY 4.0, with qrels, DOI and citation.

CC BY 4.0 · Updated
Benchmark · Results only

Bayanat Labs LabelBench

LabelBench release record: aggregate Arabic labeling results (CC BY 4.0), Apache-2.0 code on GitHub and PyPI, Zenodo DOI, citation and licences.

CC BY 4.0 (results, charts, report); Apache-2.0 (code) · Updated

All releases at a glance

ReleaseTypeLicenceSizeVersionDOIUpdated
Arabic Citation CheckBenchmarkCC BY 4.05045 citation judgments; one work can have many, so they are not a count of worksv0.1.0None
Arabic Data Cost and Pilot EstimatorToolApache-2.040 planning scenarios in the fixtures, text and speech in USD, SAR and AED; invented inputs, not pricesv0.1.0None
Open Arabic BooksDatasetCC BY 4.01545 books in this releasev0.1.0None
Synthetic Saudi E-Invoices, Receipts and Bilingual FormsDatasetCC BY 4.025000 generated recordsv0.1.0None
Arabic-Latin Name VariantsDatasetCC0 1.0236025 Latin spellings of Arabic name words, each given by at least two entitiesv0.1.0None
Arabic Data IndexDatasetCC BY 4.03564 de-duplicated Arabic AI datasets on Hugging Face or in Masader, as of 1 November 2026v0.1.0None
Arabic Web Rights CensusDatasetCC0 1.036190 hosts in the census list: Arabic-language hosts from Common Crawl plus popular domains under Arab and Arabic-script country-code TLDsv0.1.0None
Arabic Wikisource Public-Domain WorksDatasetCC BY-SA 4.040782 works in the core public-domain config, works-pd-core, with chapters, people and datesv0.1.0None
polite-fetchToolApache-2.0634 conformance tests, run against a local fixture server and never against real sitesv0.1.0None
Arab World Places AtlasDatasetComponent-specific rights1301051 points of interestv1.0.0None
Arab-World Wikidata SliceDatasetCC0 1.0844634 Wikidata items tied to the 22 Arab League states (entities config)v0.1.0None
Arabic Dataset Rights IndexDatasetCC BY 4.0120 datasets on Hugging Face indexed: the top 100 tagged Arabic and more repositories in sets of known copiesv0.1.0None
Arabic GazetteerDatasetCC BY 4.0246637 places in the 22 Arab League states, each with at least one Arabic namev0.1.0None
Arabic NER Offset ValidatorToolApache-2.027 finding codes, each with a message in English and Arabicv0.1.0None
Open Arabic Speech Hours CounterDatasetCC BY 4.036221 hours of released Arabic speech audio under an open licence that allows commercial use, after removing overlap the publishers statev0.1.0None
Arabic Token-Tax CalculatorToolApache-2.012 tokenizers in the command-line tool, at pinned revisionsv0.1.0None
Arabic Token-Tax IndexBenchmarkCC BY 4.012 tokenisers measuredv0.1.1None
Arabic Wikipedia MonthlyDatasetCC BY-SA 4.01632785 Egyptian Arabic Wikipedia articles with running text (arz)v0.1.0None
Arabic Form Field ExtractionDatasetCC BY 4.01152 rendered synthetic Arabic form imagesv0.1.0None
Arabic Public Data ReasoningDatasetCC BY 4.04400 real source observations, including missing cellsv0.1.0None
Arabic AI Model TrackerDatasetCC BY 4.089 model releases recordedv0.1.0None
Dataset Licence Compatibility CheckerToolApache-2.033 licences and terms encodedv0.1.0None
Arabic Document AtlasDatasetComponent-specific rights200286 unique decoded document images across image componentsv0.3.0None
Arabic Annotation Guidelines TemplateGuideCC BY 4.012 copy-ready template sectionsUnversionedNone
Arabic ASR Channel PairsDatasetCC BY 4.0500 clean FLEURS recordings (parents)v0.1.0None
Arabic Text Normalizer (arabic-normalize)ToolApache-2.080 conformance fixturesv0.1.0None
Arabic PII Pack for Presidio (arabic-pii-pack)ToolApache-2.01000 synthetic test sentences (every value generated)v0.1.0None
Arabic Unicode Conformance SuiteBenchmarkCC BY 4.0300 test casesv0.1.0None
ArabicWER (arabicwer)ToolApache-2.0120 conformance fixtures in the dev splitv0.1.0None
Contributor consent templatesGuideCC BY 4.0—v1.0None
Dataset template and release kitToolApache-2.0—v0.1.0None
GCC Format Validators and Arabic ITN/TN Test PairsDatasetCC BY 4.02000 ITN/TN test pairsv0.1.0None
Open-programme policy and operating manualReportCC BY 4.013 stages in the operating manualv1.0.1None
Arabic Agent Reliability LabToolApache-2.021 synthetic workflow familiesv0.2.010.5281/zenodo.23355782
Arabic Retrieval Starter KitDatasetCC BY 4.012 passages in Arabic and Englishv0.110.5281/zenodo.23355780
LabelBenchBenchmarkCC BY 4.012 model-task resultsv0.110.5281/zenodo.23355784

Why we publish open Arabic data

Bayanat Labs is a Riyadh-based Arabic data company. We build data, never models, so we never compete with the teams that use our work. We publish small open releases, benchmarks, tools and guides so anyone can test Arabic AI work in the open, check our methods and cite the result.

Bayanat Labs is not affiliated with bayanat.ae (the UAE open-data portal), the former Bayanat AI (now Space42), or the ARBML bayanat library.

Recent changes

Arabic Citation Check v0.1.0Judgments, work index and results on Hugging Face; static page of examples and baselines on Hugging Face Spaces; checker on GitHub.
Arabic Data Cost and Pilot Estimator v0.1.0Browser app in English and Arabic on Hugging Face Spaces; Python port, command-line tool, fixtures and method on GitHub.
Open Arabic Books v0.1.0Chapters, books and metadata on Hugging Face, with counts and checks; builder on GitHub.
Synthetic Saudi E-Invoices, Receipts and Bilingual Forms v0.1.0Fully synthetic invoices, receipts and forms with field boxes, UBL XML, QR codes and doc-QA on Hugging Face; static sample browser on Hugging Face Spaces; generator and validators on GitHub.
Arabic-Latin Name Variants v0.1.0Built from the Wikidata JSON dump of 26 October 2026: name pairs, spelling tables, full-name clusters and a name-matching test set on Hugging Face; static lookup page on Hugging Face Spaces; code on GitHub.
Arabic Data Index v0.1.0Snapshot as of 1 November 2026: aggregates, entities table, definitions and checks on Hugging Face; static dashboard on Hugging Face Spaces; code and method on GitHub.
Arabic Web Rights Census v0.1.0Census as of 31 October 2026: host, crawler-rule and aggregate tables, exclusion list and charts on Hugging Face; domain lookup web app on Hugging Face Spaces; code and method on GitHub.
Arabic Wikisource Public-Domain Works v0.1.0The two public-domain tiers, the authors and decisions tables, the JSON Lines export, statistics and checks on Hugging Face; builder on GitHub.

Work on Arabic data with us

Native Arabic speakers, linguists and domain professionals can join the Talent Network for remote, paid-per-task Arabic data work. It is free to apply.

Join the Talent Network →

Need production-grade, rights-cleared Arabic data? Start with Bayanat Labs

We publish synthetic fixtures, open benchmarks, results, code and guides for free. Data at scale is licensed or built to order from Bayanat Labs: ready-to-license Arabic speech and text datasets, including thirty thousand hours of Arabic speech data, with commercial AI-use rights written into the agreement, and custom collection, annotation and evaluation by a team of more than fifty thousand expert annotators, including vetted native speakers, linguists and licensed domain professionals. Work starts with a fixed-scope pilot with gold-standard QA and a quality report, usually within two weeks.