Purpose
The system seeks to detect errors, bias, and risk early; assign responsibilities; document decisions; and reduce the chance that a design problem reaches fieldwork or that a data problem reaches the report. Quality assurance does not mean research has no limitations; it means limitations are identified, managed, and disclosed.
Responsibilities
- Study lead: overall coherence, questions, and methodology.
- Field lead: training, allocation, monitoring, and safety.
- Data lead: structure, cleaning, access, and versioning.
- Analyst: rules, code, tables, and interpretation.
- Reviewer: relatively independent review of figures, narrative, and limitations.
- Authorized approver: final approval or request for revision.
Before implementation
- Review scope, questions, and deliverable matrix.
- Assess feasibility, access, and risk.
- Review sample, size, and assumptions.
- Review instrument linguistically, methodologically, and ethically.
- Test programming, routing, and values.
- Pilot and document changes.
- Approve field, quality, and security plans.
During data collection
- Track progress against sample or quotas.
- Review geographic and time distribution.
- Check impossible values, duplication, and patterns.
- Review duration and routing.
- Verify or recontact under the consent and quality plan.
- Observe researchers or review authorized recordings.
- Suspend work where a material failure appears.
Suspected field errors
A record is not deleted and a researcher is not accused on the basis of one signal. Indicators are combined, the case is reviewed, and the conclusion documented. Action may include retraining, verification, recollection, record exclusion, researcher suspension, or plan revision. The effect on findings and schedule is assessed.
Data management
- Clear variable and value templates.
- Log of data changes and reasons.
- Separation of raw and processed versions.
- Encryption or protection of sensitive files.
- Limited permissions and institutional accounts.
- Backups and restoration testing.
- Identification of the version used for each output.
Analytical checks
- Reproduce tables from documented code or rules.
- Review derivations, weights, and denominators.
- Match totals, percentages, and missing values.
- Compare versions and data sources.
- Review small cells and multiple testing.
- Challenge alternative interpretations and causal claims.
Report review
- Match every figure to an approved table or output.
- Ensure consistency across narrative, tables, charts, and summary.
- Include fieldwork dates, scope, and methods.
- Explain limitations and uncertainty.
- Review Arabic and English without changing meaning.
- Review privacy, rights, and citation.
- Manage version number and approval date.
Deviations and corrective action
Material deviation from protocol is logged with its reason, authorization, effect, corrective action, and disclosure requirements. Issue logs are used to improve instruments, training, and systems in later projects.
Quality indicators
- Response and completion rates.
- Error, recollection, and exclusion rates.
- Coverage against plan.
- Interviewer and interview consistency.
- Table or version errors.
- Time to resolve review comments.
- Participant complaints or privacy incidents.
- Completion of corrective action.
Quality plan
Each project has a plan proportionate to its design and risk. It identifies checkpoints, responsible persons, acceptance criteria, documentation, corrective action, and authority to pause or resume work. A generic plan is not copied without adapting it to the instrument, mode, and subject.
Version control
- Number and date every instrument, manual, dataset, table, and report.
- Prevent use of a superseded version after approval.
- Maintain a change log explaining what changed, why, and who approved it.
- Distinguish draft, review, final, and published versions.
- Protect the source version from accidental replacement.
Researcher and supervisor certification
- Training on purpose, instrument, ethics, and safety.
- Knowledge check and practical application.
- Performance assessment before independent assignment.
- Additional monitoring for new researchers or sensitive topics.
- Retraining or withdrawal of certification where error patterns arise.
Field quality indicators
| Area | Illustrative indicators |
|---|---|
| Completion | Case counts, distribution, contact, refusal, and partial completion. |
| Time | Interview duration, collection times, and unusual pauses. |
| Logic | Contradictory answers, routing errors, and implausible repeated patterns. |
| Location | Consistency with a sample point where location collection is lawful and safe. |
| Verification | Callback, authorized audio review, or supervisor audit. |
| Safety | Incidents, pressure, identity exposure, or consent failures. |
Investigating suspected problems
- Record the indicator without assuming guilt.
- Examine data, records, context, and comparative patterns.
- Seek clarification from the supervisor or researcher where needed.
- Decide whether the case is valid, requires verification, or should be removed.
- Assess whether the issue affects other cases or the sample.
- Document the decision, action, and approval.
Data checks
- Ranges, missing values, and coding.
- Duplicates and unexpected matching.
- Consistency of separated identifiers and linkage keys.
- Weights and outliers.
- Version comparison, case counts, and variable counts.
- Table reconciliation with source and calculation rules.
Analysis and report review
- Reproduce a sample of tables or indicators.
- Check denominators, percentages, rounding, and totals.
- Ensure narrative matches tables and charts.
- Review inference, causality, and categorical language.
- Check sources, citations, and versions.
- Review Arabic and English where material is bilingual.
Partner and contractor quality
Agreements define training, collection, delivery, security, audit, and review requirements. The Center does not rely only on a vendor’s certification and may request evidence, sample checks, or independent testing proportionate to risk.
Exceptions and deviations
A project may need to change mode, area, or schedule because of field conditions. The deviation, reason, timing, approval, and effect on quality and inference are recorded and disclosed where material.
Acceptance of deliverables
Delivery is not complete merely because a file was sent. Agreed requirements, version integrity, file accessibility, language and format consistency, authorized data or documentation, and closure of material comments are reviewed.