methodology · transparency

Coverage & verification

A live audit of what's in Tayyar's dataset and how far each row has been verified against external sources. Hand-coded scores remain marked unverified until they pass through the methodology pipeline. This page is the honest answer to "what would I be citing if I cited Tayyar today?"

Corpus status

Where the document-grounded scoring pipeline stands. As documents land and get scored, these numbers shift live. The "agreement" measurement appears on findings.

294 documents on file 92 parties + 79 politicians have at least one
0 analyses written one per (document × axis); produced by the scoring pipeline
1195 aggregate positions 72 declared/behavioral · 1123 hand-coded composite
94% party doc coverage 92/98 parties with at least one document

Coverage matrix — by country × content type

Counts of every content type by country. Heat intensity scales with the total — darkest cells are where you have least to read. Sorted by total content desc.

Country Parties Politicians Documents Quotes Bills Events Total
IL flag Israel 27 132 64 18 14 16 271
EG flag Egypt 9 20 25 17 5 7 83
LB flag Lebanon 6 19 29 10 4 14 82
PS flag Palestine 7 12 32 15 1 11 78
IQ flag Iraq 6 13 20 3 2 8 52
TN flag Tunisia 7 7 14 5 4 6 43
SY flag Syria 4 7 14 5 2 9 41
MA flag Morocco 5 7 13 4 2 2 33
YE flag Yemen 5 8 13 2 1 4 33
SA flag Saudi Arabia 10 9 5 2 6 32
JO flag Jordan 4 5 12 5 2 2 30
SD flag Sudan 4 4 12 1 1 4 26
DZ flag Algeria 6 5 9 1 1 3 25
LY flag Libya 2 7 5 4 1 1 20
BH flag Bahrain 3 5 4 1 2 15
MR flag Mauritania 3 2 6 1 1 13
QA flag Qatar 2 5 4 1 1 13
AE flag United Arab Emirates 5 5 1 2 13
OM flag Oman 2 2 1 1 6
KW flag Kuwait 2 1 1 1 5

0 empty · 1–2 sparse · 3–7 partial · 8–19 deep · 20+ dense

IRR — inter-rater reliability progress

The second rater's pass against the Pilot-Phase scores, blind to the baseline. Per-axis κ and r land on findings as the coding completes.

212 cells sampled (entity, axis) pairs drawn for blind-coding
126 cells coded 59% of the sample completed
7 axes with codings where at least one (entity, axis) pair has a second-rater score
2 re-coders distinct LLM re-coder handles — a reliability floor, not human anchors (see methodology)

Verification rollup

  • externally verified
  • first-pass verified
  • unverified
  • Countries 20 0 0 20
  • Parties 98 0 81 17
  • Politicians 274 0 109 165

Parties by government role

The richer alternative to a simple "in government / in opposition" cut. Captures coalition dynamics (lead party, major and minor partners, confidence-and-supply support), opposition tiers, and the extra-parliamentary / banned tail that the boolean would force into the wrong bucket.

  • lead party 10 10%
  • coalition major 12 12%
  • coalition minor 4 4%
  • opposition major 12 12%
  • opposition minor 16 16%
  • extra parliamentary 39 40%
  • banned 5 5%

By country

Country Parties Politicians Verified Lead In gov In opp Outlawed Dissolved
DZ flagAlgeria 6 5 6/6 1 2 3 1
BH flagBahrain 3 5 3/3 1 1
EG flagEgypt 9 20 7/9 1 2
IQ flagIraq 6 13 5/6 1 4 1 1
IL flagIsrael 27 132 17/27 1 7 11 2 2
JO flagJordan 4 5 4/4 1
LB flagLebanon 6 19 6/6 4 2
LY flagLibya 2 7 2/2 1
MR flagMauritania 3 2 3/3 1 1 2
MA flagMorocco 5 7 5/5 1 3 1
PS flagPalestine 7 12 7/7 2 2
SD flagSudan 4 4 3/4 3 1
SY flagSyria 4 7 3/4 1 1 2 1 1
TN flagTunisia 7 7 5/7 1 1
YE flagYemen 5 8 5/5 2 3 1
KW flagKuwait Tier 2 2 0/0
OM flagOman Tier 2 2 0/0
QA flagQatar Tier 2 2 0/0
SA flagSaudi Arabia Tier 2 10 0/0
AE flagUnited Arab Emirates Tier 2 5 0/0

Special legal status

Parties that are banned, dissolved, or operate under legal restrictions. These are tracked explicitly — for many MENA contexts, the most consequential political actors are also the ones the state is trying to suppress, and omitting them would give an incomplete picture.

Outlawed

  • IQ flag Ba'ath Party (Iraq)
  • DZ flag Islamic Salvation Front Banned by Algerian government decree on 1992-03-04 after the January military coup; ban formalized in legislation including the 1992 Political Parties Law. Founders Madani and Belhadj were imprisoned. The party has not been re-legalized.
  • IL flag Kach
  • SY flag Muslim Brotherhood (Syria)
  • IL flag Northern Islamic Movement Designated an illegal organization by the Israeli Ministry of Defense on 2015-11-17 under the 1945 Defense (Emergency) Regulations; designation has been challenged but remains in force.

Dissolved

Verified parties

Parties whose metadata (founding year, leadership, legal status, etc.) has been checked against external sources and carries per-field citations. The compass scores remain hand-coded priors and are not implied verified by this status — see the methodology page.

What this surface is for

Tayyar's contribution is the method — a reusable way to take political-position measurements where the standard comparative tools go dark — with this dataset as the worked example; the companion paper (Paper 1) sets it out. The verification pass advances country-by-country: every entity gets external-source citations on its factual claims, every legal status is documented, every politician's role is dated. Once entity metadata is complete and verified, the document-grounded scoring pass runs over real documents (manifestos, speeches, platform texts) and anchors the panel's scores in cited text, with full per-score provenance.

This page will keep updating as that work proceeds. The data endpoint always returns the full underlying tables for anyone who wants to audit the numbers themselves.