{
  "$schema": "folio-library-document/v1",
  "id": "10665-69034",
  "title": "The immunization data quality self-assessment (DSQ) tool",
  "variant": "pdf",
  "pages": 74,
  "tocSource": "outline",
  "tocMethod": null,
  "toc": [
    {
      "level": 1,
      "title": "Contents",
      "number": null,
      "page": 3,
      "pageLabel": "iii",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-000-contents"
    },
    {
      "level": 1,
      "title": "Acknowledgements",
      "number": null,
      "page": 5,
      "pageLabel": "v",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-001-acknowledgements"
    },
    {
      "level": 1,
      "title": "Abbreviations",
      "number": null,
      "page": 7,
      "pageLabel": "vii",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-002-abbreviations"
    },
    {
      "level": 1,
      "title": "Executive summary",
      "number": null,
      "page": 9,
      "pageLabel": "ix",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-003-executive-summary"
    },
    {
      "level": 1,
      "title": "A. Introduction",
      "number": null,
      "page": 11,
      "pageLabel": "1",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-004-a-introduction"
    },
    {
      "level": 1,
      "title": "B. Immnization data quality self-assessment toolbox",
      "number": null,
      "page": 12,
      "pageLabel": "2",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-005-b-immnization-data-quality-self-assessment-toolb"
    },
    {
      "level": 1,
      "title": "C. Where to conduct a DQS?",
      "number": null,
      "page": 37,
      "pageLabel": "27",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-006-c-where-to-conduct-a-dqs"
    },
    {
      "level": 1,
      "title": "D. Present the DQS findings",
      "number": null,
      "page": 40,
      "pageLabel": "30",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-007-d-present-the-dqs-findings"
    },
    {
      "level": 1,
      "title": "E. Conduct a DQS workshop",
      "number": null,
      "page": 44,
      "pageLabel": "34",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-008-e-conduct-a-dqs-workshop"
    },
    {
      "level": 1,
      "title": "F. Integrate DQS results into the routine activities",
      "number": null,
      "page": 47,
      "pageLabel": "37",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-009-f-integrate-dqs-results-into-the-routine-activit"
    },
    {
      "level": 1,
      "title": "Annex A: Sample chart for monitoring doses & drop-outs",
      "number": null,
      "page": 49,
      "pageLabel": "39",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": null
    },
    {
      "level": 1,
      "title": "Annex B: Example of completeness/timeliness reporting table",
      "number": null,
      "page": 51,
      "pageLabel": "41",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-010-annex-b-example-of-completenesstimeliness-report"
    },
    {
      "level": 1,
      "title": "Annex C: Standard questions to assess quality of monitoring system",
      "number": null,
      "page": 53,
      "pageLabel": "43",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-011-annex-c-standard-questions-to-assess-quality-of"
    },
    {
      "level": 1,
      "title": "Annex D: Child immunization card exercise",
      "number": null,
      "page": 67,
      "pageLabel": "57",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-012-annex-d-child-immunization-card-exercise"
    },
    {
      "level": 1,
      "title": "Annex E: Sampling of health units",
      "number": null,
      "page": 69,
      "pageLabel": "59",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-013-annex-e-sampling-of-health-units"
    },
    {
      "level": 1,
      "title": "Annex F: Data quality self-assessment workshop schedule",
      "number": null,
      "page": 72,
      "pageLabel": "62",
      "confidence": null,
      "evidence": null,
      "source": "outline",
      "section": "sec-014-annex-f-data-quality-self-assessment-workshop-sc"
    }
  ],
  "sections": [
    {
      "id": "sec-front-matter",
      "number": null,
      "title": "Front matter",
      "level": 1,
      "pageStart": 1,
      "pageEnd": 3,
      "labelStart": "i",
      "labelEnd": "iii",
      "words": 380,
      "summary": {
        "text": "The front matter of WHO's 2005 immunization data quality self-assessment (DQS) tool, with a partly garbled title, document code, ordering details, copyright and disclaimer.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "health organization",
          "heading": false
        },
        {
          "term": "world health",
          "heading": false
        },
        {
          "term": "fax",
          "heading": false
        },
        {
          "term": "biologicals",
          "heading": false
        },
        {
          "term": "vaccines",
          "heading": false
        },
        {
          "term": "email",
          "heading": false
        },
        {
          "term": "ivb",
          "heading": false
        },
        {
          "term": "marketing",
          "heading": false
        }
      ],
      "extract": "IVIVIB VB The iIVIV mmunization data qualityVIVI mIVIV lf-assessment (DQS) toolVIVI selIVI ImmunizationB n, Vaccines and BiologicalsB WHO/IVB/05.04 ORIGINAL: ENGLISH ii The Department of Immunization, Vaccines and Biologicals thanks the donors whose unspecified financial support has made the production of this publication possible. This publication was produced by the Vaccine Assessment and Monitoring team of the",
      "extractCut": true,
      "blocks": [
        "library/10665-69034/blocks/prose-sec-front-matter"
      ]
    },
    {
      "id": "sec-000-contents",
      "number": null,
      "title": "Contents",
      "level": 1,
      "pageStart": 3,
      "pageEnd": 5,
      "labelStart": "iii",
      "labelEnd": "v",
      "words": 322,
      "summary": {
        "text": "The table of contents of the data quality self-assessment tool, followed by acknowledgements of the countries and offices that tested it and GAVI's financial support.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "conduct dqs",
          "heading": false
        },
        {
          "term": "immunization card",
          "heading": false
        },
        {
          "term": "immunization data",
          "heading": false
        },
        {
          "term": "quality self-assessment",
          "heading": false
        },
        {
          "term": "completeness timeliness",
          "heading": false
        },
        {
          "term": "monitoring system",
          "heading": false
        },
        {
          "term": "workshop",
          "heading": false
        },
        {
          "term": "gavi",
          "heading": false
        }
      ],
      "extract": "Acknowledgments ............................................................................................................ v Abbreviations.................................................................................................................. vii Executive summary ......................................................................................................... ix A.",
      "extractCut": true
    },
    {
      "id": "sec-001-acknowledgements",
      "number": null,
      "title": "Acknowledgements",
      "level": 1,
      "pageStart": 5,
      "pageEnd": 7,
      "labelStart": "v",
      "labelEnd": "vii",
      "words": 2,
      "summary": {
        "text": "A near-empty acknowledgements section containing only page numbers.",
        "status": "draft"
      },
      "keywords": [],
      "extract": "vi vii",
      "extractCut": false
    },
    {
      "id": "sec-002-abbreviations",
      "number": null,
      "title": "Abbreviations",
      "level": 1,
      "pageStart": 7,
      "pageEnd": 9,
      "labelStart": "vii",
      "labelEnd": "ix",
      "words": 72,
      "summary": {
        "text": "The list of abbreviations used in the immunization data quality self-assessment tool, from AD syringe and AEFI to VVM.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "vaccine",
          "heading": false
        },
        {
          "term": "tetanus",
          "heading": false
        },
        {
          "term": "vvm",
          "heading": false
        },
        {
          "term": "vpd",
          "heading": false
        }
      ],
      "extract": "AD auto-disable (syringe) AEFI adverse events following immunization BCG bacille Calmette-Guérin (existing TB vaccine) DTP diphtheria–tetanus–pertussis vaccine DQS data quality self-assessment HU health unit MOH ministry of health NA not available NGO nongovernmental organization NID national immunization day OPV oral polio vaccine QI quality index QQ questions on quality RED Reaching Every District SE standard",
      "extractCut": true
    },
    {
      "id": "sec-003-executive-summary",
      "number": null,
      "title": "Executive summary",
      "level": 1,
      "pageStart": 9,
      "pageEnd": 11,
      "labelStart": "ix",
      "labelEnd": "1",
      "words": 717,
      "summary": {
        "text": "The executive summary describes the DQS as a flexible toolbox for assessing immunization monitoring systems at district and health unit levels, aimed at national and regional staff who adapt it. It aims to check the accuracy of reported immunization numbers and the quality of monitoring practices, in support of the Reaching Every District approach. Findings are analysed to identify strengths, weaknesses and practical recommendations, with the goal of building the most relevant options into routine practice.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "dqs",
          "heading": false
        },
        {
          "term": "flexible toolbox",
          "heading": false
        },
        {
          "term": "district monitoring",
          "heading": false
        },
        {
          "term": "immunization monitoring",
          "heading": false
        },
        {
          "term": "district levels",
          "heading": false
        },
        {
          "term": "improve district",
          "heading": false
        },
        {
          "term": "every district",
          "heading": false
        },
        {
          "term": "immunization activities",
          "heading": false
        }
      ],
      "extract": "What is the DQS? The DQS is a flexible toolbox of methods to evaluate different aspects of the immunization monitoring system at district and health unit (HU) levels. Immunization “monitoring” refers to the regular ongoing measurement of the level of achievement in vaccination coverage and other immunization system indicators (e.g. safety, vaccine management). Monitoring is closely linked with reporting because it",
      "extractCut": true
    },
    {
      "id": "sec-004-a-introduction",
      "number": null,
      "title": "A. Introduction",
      "level": 1,
      "pageStart": 11,
      "pageEnd": 12,
      "labelStart": "1",
      "labelEnd": "2",
      "words": 59,
      "summary": {
        "text": "A footnote describing the Reaching Every District strategy and its five parts, from reaching the underserved to involving local communities in planning sessions.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "increasing",
          "heading": false
        },
        {
          "term": "immunization",
          "heading": false
        },
        {
          "term": "drop-out",
          "heading": false
        }
      ],
      "extract": "1 Increasing immunization coverage at the health facility level. Geneva, WHO, 2002 (WHO/V&B/ 02.27). RED is a global strategy aimed at increasing coverage and decreasing drop-out rates. It is a five- part strategy: reaching the underserved, providing supportive supervision, increasing use of data for action, increasing micro-planning capacity at district levels and using local populations in planning immunization",
      "extractCut": true
    },
    {
      "id": "sec-005-b-immnization-data-quality-self-assessment-toolb",
      "number": null,
      "title": "B. Immnization data quality self-assessment toolbox",
      "level": 1,
      "pageStart": 12,
      "pageEnd": 37,
      "labelStart": "2",
      "labelEnd": "27",
      "words": 7242,
      "summary": {
        "text": "Presents the DQS toolbox options, summarised in a table of what can be assessed at district and health unit level. It explains in detail how to check reporting and recording accuracy by recounting immunizations across tally sheets, registers and reports and calculating accuracy ratios. Further sections cover completeness and timeliness of reporting, quality questions on the monitoring system, immunization card recording, vaccine wastage and safety monitoring. It ends with coverage denominators, which are explored through adaptable questions on quality.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "quality self-assessment",
          "heading": true
        },
        {
          "term": "district tabulations",
          "heading": false
        },
        {
          "term": "selected hus",
          "heading": false
        },
        {
          "term": "district reports",
          "heading": false
        },
        {
          "term": "re-counted immunizations",
          "heading": false
        },
        {
          "term": "data quality",
          "heading": true
        },
        {
          "term": "vial wastage",
          "heading": false
        },
        {
          "term": "district level",
          "heading": false
        }
      ],
      "extract": "2 1. DQS options: overview The DQS toolbox proposes several options to assess different aspects of the monitoring system at different levels. Table 1. Description of the main areas a DQS can assess Option District Health Unit Main measures Assess reporting accuracy X X Accuracy ratio Assess recording accuracy X Accuracy ratio (sample in the community) Assess completeness/ X X Completeness of district reporting (%)",
      "extractCut": true
    },
    {
      "id": "sec-006-c-where-to-conduct-a-dqs",
      "number": null,
      "title": "C. Where to conduct a DQS?",
      "level": 1,
      "pageStart": 37,
      "pageEnd": 40,
      "labelStart": "27",
      "labelEnd": "30",
      "words": 851,
      "summary": {
        "text": "Advises visiting at least three and at most six health units per district, since precision gains level off beyond six, and stresses that discussion of findings matters more than exact figures. It discusses how to select districts and health units and notes that results from one district cannot be extrapolated, though common problems can be shared through feedback.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "dqs",
          "heading": true
        },
        {
          "term": "six hus",
          "heading": false
        },
        {
          "term": "representative selection",
          "heading": false
        },
        {
          "term": "sample size",
          "heading": false
        },
        {
          "term": "random sampling",
          "heading": false
        },
        {
          "term": "wastage rate",
          "heading": false
        },
        {
          "term": "potential problems",
          "heading": false
        },
        {
          "term": "visited",
          "heading": false
        }
      ],
      "extract": "WHO/IVB/05.04 Ideally a DQS should be introduced in a country and conducted on an ongoing basis. In a district though, the number of sites to be visited is constrained by the desired precision and logistic issues, such as time available, the number of team members, distances, ease of travel, the ability to obtain security clearance in difficult areas, and the availability of vehicles, drivers and accommodation. A",
      "extractCut": true
    },
    {
      "id": "sec-007-d-present-the-dqs-findings",
      "number": null,
      "title": "D. Present the DQS findings",
      "level": 1,
      "pageStart": 40,
      "pageEnd": 44,
      "labelStart": "30",
      "labelEnd": "34",
      "words": 633,
      "summary": {
        "text": "Explains how to present DQS findings, using accuracy ratios in tables and bar charts with worked examples, and how to compare districts or the same district over time. It also covers presenting completeness, timeliness, quality index scores and wastage results, and mentions supporting spreadsheet workbooks.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "dqs findings",
          "heading": true
        },
        {
          "term": "district tabulation",
          "heading": false
        },
        {
          "term": "months verified",
          "heading": false
        },
        {
          "term": "radar graph",
          "heading": false
        },
        {
          "term": "district level",
          "heading": false
        },
        {
          "term": "selected hus",
          "heading": false
        },
        {
          "term": "months accurate",
          "heading": false
        },
        {
          "term": "quality indices",
          "heading": false
        }
      ],
      "extract": "30 The data quality assessment provides a certain amount of information on the status of records and practices related to the reporting system. All options in the DQS toolbox provide quantitative measures which can be followed easily over time and used to compare different areas. The use of the tool will be particularly interesting when several districts can be compared or a district can be compared to itself over",
      "extractCut": true
    },
    {
      "id": "sec-008-e-conduct-a-dqs-workshop",
      "number": null,
      "title": "E. Conduct a DQS workshop",
      "level": 1,
      "pageStart": 44,
      "pageEnd": 47,
      "labelStart": "34",
      "labelEnd": "37",
      "words": 1289,
      "summary": {
        "text": "Recommends introducing the DQS through a national workshop followed straight away by field assessments, and lists the workshop aims. In the first phase participants review monitoring tools and design and test their own assessment, and in the second they carry out fieldwork before reconvening to analyse results and make recommendations. It also advises involving local partners and academic institutions to sustain the work.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "dqs workshop",
          "heading": true
        },
        {
          "term": "field work",
          "heading": false
        },
        {
          "term": "quality self-assessment",
          "heading": false
        },
        {
          "term": "during phase",
          "heading": false
        },
        {
          "term": "week prior",
          "heading": false
        },
        {
          "term": "menu",
          "heading": false
        },
        {
          "term": "focal point",
          "heading": false
        },
        {
          "term": "data quality",
          "heading": false
        }
      ],
      "extract": "34 The suggested approach is to introduce the DQS in a country through a national workshop, followed immediately by an assessment in a number of districts and HUs. The workshop aims: • to sensitize key health personnel on the importance of accurately monitoring immunization activities and data quality; • to train key health personnel from the national and district levels in data quality self-assessment methodology",
      "extractCut": true
    },
    {
      "id": "sec-009-f-integrate-dqs-results-into-the-routine-activit",
      "number": null,
      "title": "F. Integrate DQS results into the routine activities",
      "level": 1,
      "pageStart": 47,
      "pageEnd": 51,
      "labelStart": "37",
      "labelEnd": "41",
      "words": 542,
      "summary": {
        "text": "Describes what a successful assessment should produce, such as a documented monitoring system, identified strengths and weaknesses, recommendations used to adjust microplans and supervision, and a follow-up plan. It discusses ways to build the self-designed tool into routine practice, and the block ends with part of an example monitoring chart of DTP doses and drop-out rates.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "integrate dqs",
          "heading": true
        },
        {
          "term": "dqs options",
          "heading": false
        },
        {
          "term": "dqs measures",
          "heading": false
        },
        {
          "term": "supervisory visits",
          "heading": false
        },
        {
          "term": "supportive supervisory",
          "heading": false
        },
        {
          "term": "quality self-assessment",
          "heading": false
        },
        {
          "term": "doses administered",
          "heading": false
        },
        {
          "term": "sample chart",
          "heading": false
        }
      ],
      "extract": "WHO/IVB/05.04 The key to DQS success depends on the success of the workshop and first assessment. A well-focused assessment should result in the following. • A documented monitoring system: The tool should help managers to estimate whether the information collected is reliable (accurate), and whether the information is properly used (the monitoring system is of good quality). • Identified weaknesses and strengths of",
      "extractCut": true
    },
    {
      "id": "sec-010-annex-b-example-of-completenesstimeliness-report",
      "number": null,
      "title": "Annex B: Example of completeness/timeliness reporting table",
      "level": 1,
      "pageStart": 51,
      "pageEnd": 53,
      "labelStart": "41",
      "labelEnd": "43",
      "words": 197,
      "summary": {
        "text": "Annex B gives an example table for tracking the completeness and timeliness of health unit reports received at the district office, with definitions of cumulative completeness and timeliness.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "completeness timeliness",
          "heading": true
        },
        {
          "term": "cumulative completeness",
          "heading": false
        },
        {
          "term": "total completeness",
          "heading": false
        },
        {
          "term": "reporting table",
          "heading": true
        },
        {
          "term": "month divided",
          "heading": false
        },
        {
          "term": "reports received",
          "heading": false
        }
      ],
      "extract": "reporting table The immunization data quality self-assessment (DQS) tool 42 Example of a completeness/timeliness reporting table Insert the date the HU reports were received at the district office. If a report is received after the deadline, enter the date in red. Display the table in the district office. Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Total Total completeness a timeliness a HU1 HU2 HU3 HU4 HU5 HU6",
      "extractCut": true
    },
    {
      "id": "sec-011-annex-c-standard-questions-to-assess-quality-of",
      "number": null,
      "title": "Annex C: Standard questions to assess quality of monitoring system",
      "level": 1,
      "pageStart": 53,
      "pageEnd": 67,
      "labelStart": "43",
      "labelEnd": "57",
      "words": 3426,
      "summary": {
        "text": "Annex C lists standard questions to assess the quality of the immunization monitoring system at district and health unit levels, with comments and weights. They cover recording, archiving, reporting, demographic data and use of data, such as vaccine ledgers, adverse event procedures and dated reports. The block ends with the start of a child immunization card exercise listing children due for vaccines.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "opv dtp",
          "heading": false
        },
        {
          "term": "monitoring system",
          "heading": true
        },
        {
          "term": "standard questions",
          "heading": true
        },
        {
          "term": "dtp vaccination",
          "heading": false
        },
        {
          "term": "district reports",
          "heading": false
        },
        {
          "term": "vaccine ledger",
          "heading": false
        },
        {
          "term": "child immunization",
          "heading": false
        },
        {
          "term": "district denominator",
          "heading": false
        }
      ],
      "extract": "the quality of the monitoring system The immunization data quality self-assessment (DQS) tool 44 Standard questions to assess the quality of the monitoring system QUESTIONS ON QUALITY (QQ), DISTRICT LEVEL Question Comment Weight (from 1 to 3) Recording component (district) 1 Are vaccine receipts and issues recorded in a vaccine ledger? To assess appropriate record-keeping of vaccine receipts and issues. 2 Does the",
      "extractCut": true
    },
    {
      "id": "sec-012-annex-d-child-immunization-card-exercise",
      "number": null,
      "title": "Annex D: Child immunization card exercise",
      "level": 1,
      "pageStart": 67,
      "pageEnd": 69,
      "labelStart": "57",
      "labelEnd": "59",
      "words": 262,
      "summary": {
        "text": "Annex D completes a child immunization card exercise for 20 infants, listing each child's history and due vaccines, with the correct totals for BCG, DTP and measles doses.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "opv dtp",
          "heading": false
        },
        {
          "term": "opv late",
          "heading": false
        },
        {
          "term": "dtp vaccination",
          "heading": false
        },
        {
          "term": "child old",
          "heading": false
        },
        {
          "term": "old enough",
          "heading": false
        },
        {
          "term": "measles vaccination",
          "heading": false
        },
        {
          "term": "child due",
          "heading": false
        },
        {
          "term": "bcg",
          "heading": false
        }
      ],
      "extract": "Child immunization card exercise (example for 20 infants) The immunization data quality self-assessment (DQS) tool 58 Child History Child 8 due for DTP1, OPV1 BCG given at birth Child old enough for OPV1/DTP1 vaccination Child 9 due for measles BCG, DTP1, OPV1 given on schedule, DP2/OPV2 given just two weeks ago Child old enough for measles vaccination Child 10 due for DTP3, OPV3 BCG, DTP1, OPV1, DTP2, OPV2 Child",
      "extractCut": true
    },
    {
      "id": "sec-013-annex-e-sampling-of-health-units",
      "number": null,
      "title": "Annex E: Sampling of health units",
      "level": 1,
      "pageStart": 69,
      "pageEnd": 72,
      "labelStart": "59",
      "labelEnd": "62",
      "words": 1164,
      "summary": {
        "text": "Annex E describes how to randomly select health units with probability proportional to size using systematic sampling, with a worked district example based on cumulative DTP3 numbers. It explains choosing a sampling interval and random start, and ends with a random number table.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "sampling",
          "heading": true
        },
        {
          "term": "sampling interval",
          "heading": false
        },
        {
          "term": "cumulative dtp",
          "heading": false
        },
        {
          "term": "random number",
          "heading": false
        },
        {
          "term": "sampling frame",
          "heading": false
        },
        {
          "term": "hus",
          "heading": false
        },
        {
          "term": "number table",
          "heading": false
        },
        {
          "term": "cumulative population",
          "heading": false
        }
      ],
      "extract": "WHO/IVB/05.04 A classical procedure is described below. It allows a random selection of HUs with a probability proportional to the size (estimated by the number of immunizations given during the previous year), using systematic sampling. The tool used to assist in the randomization is a random-number table. 1) Obtain the list of all HUs providing immunization services. This list is then the sampling frame from which",
      "extractCut": true
    },
    {
      "id": "sec-014-annex-f-data-quality-self-assessment-workshop-sc",
      "number": null,
      "title": "Annex F: Data quality self-assessment workshop schedule",
      "level": 1,
      "pageStart": 72,
      "pageEnd": 74,
      "labelStart": "62",
      "labelEnd": "64",
      "words": 361,
      "summary": {
        "text": "Annex F sets out a nine-day schedule for a data quality self-assessment workshop, covering monitoring tools, designing quality questions, supervision, sampling, data accuracy, fieldwork, analysis and presentation of results.",
        "status": "draft"
      },
      "keywords": [
        {
          "term": "plenary session",
          "heading": false
        },
        {
          "term": "quality self-assessment",
          "heading": true
        },
        {
          "term": "data quality",
          "heading": true
        },
        {
          "term": "coffee",
          "heading": false
        },
        {
          "term": "workshop",
          "heading": true
        },
        {
          "term": "lunch",
          "heading": false
        },
        {
          "term": "dqs",
          "heading": false
        },
        {
          "term": "group presentations",
          "heading": false
        }
      ],
      "extract": "62 Location: _______________________________________________ Dates: __________________________________________________ Day 1 Session 1: Introduction and overview 09.00 Opening of workshop MOH–WHO representatives (national–regional) 09.10 Introductions 09.20 Review of workshop objectives and DQS overview 10.00 Global/regional perspectives – 3 options proposed: What is data used for at regional level? The GAVI",
      "extractCut": true
    }
  ],
  "checks": {
    "tocAlignment": {
      "listed_not_found": {
        "count": 0,
        "items": []
      },
      "found_not_listed": {
        "count": 0,
        "items": []
      },
      "page_mismatch": {
        "count": 0,
        "items": []
      }
    },
    "figureSequenceGaps": [
      "table 3",
      "table 4",
      "table 5",
      "table 6"
    ],
    "pageLabelConflicts": {
      "count": 64,
      "items": [
        "p11: pdf-labels 66, printed 1, contents 1",
        "p12: pdf-labels 67, printed 2, contents 2",
        "p13: pdf-labels 68, printed 3, contents 3",
        "p14: pdf-labels 69, printed 4",
        "p15: pdf-labels 70, printed 5",
        "p16: pdf-labels 71, printed 6",
        "p17: pdf-labels 72, printed 7",
        "p18: pdf-labels 73, printed 8",
        "p19: pdf-labels 74, printed 9",
        "p20: pdf-labels 75, printed 10",
        "p21: pdf-labels 76, printed 11",
        "p22: pdf-labels 77, printed 12",
        "p23: pdf-labels 78, printed 13",
        "p24: pdf-labels 79, printed 14",
        "p25: pdf-labels 80, printed 15",
        "p26: pdf-labels 81, printed 16",
        "p27: pdf-labels 82, printed 17",
        "p28: pdf-labels 83, printed 18, contents 18",
        "p29: pdf-labels 84, printed 19",
        "p30: pdf-labels 85, printed 20, contents 20",
        "p31: pdf-labels 86, printed 21",
        "p32: pdf-labels 87, printed 22, contents 22",
        "p33: pdf-labels 88, printed 23, contents 23",
        "p34: pdf-labels 89, printed 24",
        "p35: pdf-labels 90, printed 25, contents 25",
        "p36: pdf-labels 91, printed 26, contents 26",
        "p37: pdf-labels 92, printed 27, contents 27",
        "p38: pdf-labels 93, printed 28",
        "p39: pdf-labels 94, printed 29",
        "p40: pdf-labels 95, printed 30, contents 30",
        "p41: pdf-labels 96, printed 31",
        "p42: pdf-labels 97, printed 32",
        "p43: pdf-labels 98, printed 33, contents 33",
        "p44: pdf-labels 99, printed 34",
        "p45: pdf-labels 100, printed 35, contents 35",
        "p46: pdf-labels 101, printed 36",
        "p47: pdf-labels 102, printed 37, contents 37",
        "p48: pdf-labels 103, printed 38",
        "p49: pdf-labels 104, printed 39, contents 39",
        "p50: pdf-labels 105, printed 40",
        "p51: pdf-labels 106, printed 41, contents 41",
        "p52: pdf-labels 107, printed 42",
        "p53: pdf-labels 108, printed 43, contents 43",
        "p54: pdf-labels 109, printed 44",
        "p55: pdf-labels 110, printed 45",
        "p56: pdf-labels 111, printed 46",
        "p57: pdf-labels 112, printed 47",
        "p58: pdf-labels 113, printed 48",
        "p59: pdf-labels 114, printed 49",
        "p60: pdf-labels 115, printed 50"
      ]
    }
  },
  "withheld": false,
  "keywords": [
    {
      "term": "dqs options",
      "heading": false
    },
    {
      "term": "dqs workshop",
      "heading": true
    },
    {
      "term": "dqs toolbox",
      "heading": false
    },
    {
      "term": "during dqs",
      "heading": false
    },
    {
      "term": "integrate dqs",
      "heading": true
    },
    {
      "term": "dqs findings",
      "heading": true
    },
    {
      "term": "conduct dqs",
      "heading": true
    },
    {
      "term": "dqs measures",
      "heading": false
    },
    {
      "term": "dqs concept",
      "heading": false
    },
    {
      "term": "district data",
      "heading": false
    },
    {
      "term": "immunization data",
      "heading": true
    },
    {
      "term": "district monitoring",
      "heading": false
    }
  ],
  "pageLabels": [
    {
      "physical": 1,
      "label": "i",
      "source": "pdf-labels",
      "confidence": 0.7
    },
    {
      "physical": 2,
      "label": "ii",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 3,
      "label": "iii",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 4,
      "label": "iv",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 5,
      "label": "v",
      "source": "printed",
      "confidence": 1
    },
    {
      "physical": 6,
      "label": "vi",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 7,
      "label": "vii",
      "source": "printed",
      "confidence": 1
    },
    {
      "physical": 8,
      "label": "viii",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 9,
      "label": "ix",
      "source": "printed",
      "confidence": 1
    },
    {
      "physical": 10,
      "label": "x",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 11,
      "label": "1",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 12,
      "label": "2",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 13,
      "label": "3",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 14,
      "label": "4",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 15,
      "label": "5",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 16,
      "label": "6",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 17,
      "label": "7",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 18,
      "label": "8",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 19,
      "label": "9",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 20,
      "label": "10",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 21,
      "label": "11",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 22,
      "label": "12",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 23,
      "label": "13",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 24,
      "label": "14",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 25,
      "label": "15",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 26,
      "label": "16",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 27,
      "label": "17",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 28,
      "label": "18",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 29,
      "label": "19",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 30,
      "label": "20",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 31,
      "label": "21",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 32,
      "label": "22",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 33,
      "label": "23",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 34,
      "label": "24",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 35,
      "label": "25",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 36,
      "label": "26",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 37,
      "label": "27",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 38,
      "label": "28",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 39,
      "label": "29",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 40,
      "label": "30",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 41,
      "label": "31",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 42,
      "label": "32",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 43,
      "label": "33",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 44,
      "label": "34",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 45,
      "label": "35",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 46,
      "label": "36",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 47,
      "label": "37",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 48,
      "label": "38",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 49,
      "label": "39",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 50,
      "label": "40",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 51,
      "label": "41",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 52,
      "label": "42",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 53,
      "label": "43",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 54,
      "label": "44",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 55,
      "label": "45",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 56,
      "label": "46",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 57,
      "label": "47",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 58,
      "label": "48",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 59,
      "label": "49",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 60,
      "label": "50",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 61,
      "label": "51",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 62,
      "label": "52",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 63,
      "label": "53",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 64,
      "label": "54",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 65,
      "label": "55",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 66,
      "label": "56",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 67,
      "label": "57",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 68,
      "label": "58",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 69,
      "label": "59",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 70,
      "label": "60",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 71,
      "label": "61",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 72,
      "label": "62",
      "source": "printed",
      "confidence": 0.85
    },
    {
      "physical": 73,
      "label": "63",
      "source": "printed",
      "confidence": 0.7
    },
    {
      "physical": 74,
      "label": "64",
      "source": "printed",
      "confidence": 0.7
    }
  ],
  "figures": [
    {
      "kind": "table",
      "number": "1",
      "title": "Description of the main areas a DQS can assess",
      "page": 12,
      "pageLabel": "2",
      "confidence": 0.6,
      "evidence": [
        "in-sequence"
      ]
    },
    {
      "kind": "figure",
      "number": "1",
      "title": "Reporting flow of immunization coverage data",
      "page": 13,
      "pageLabel": "3",
      "confidence": 0.9,
      "evidence": [
        "referenced",
        "in-sequence",
        "graphic"
      ]
    },
    {
      "kind": "table",
      "number": "2",
      "title": "Findings of accuracy assessment (HU registers/HU reports) in six HUs, province A",
      "page": 21,
      "pageLabel": "11",
      "confidence": 0.8,
      "evidence": [
        "referenced",
        "in-sequence"
      ]
    },
    {
      "kind": "table",
      "number": "7",
      "title": "Proposed components of the monitoring system",
      "page": 30,
      "pageLabel": "20",
      "confidence": 0.7,
      "evidence": [
        "referenced"
      ]
    },
    {
      "kind": "table",
      "number": "8",
      "title": "Method of assigning weights for each qualitative question in the DQS (scores in the table are examples, allowed range in the Excel tool is 1–3)",
      "page": 31,
      "pageLabel": "21",
      "confidence": 0.7,
      "evidence": [
        "referenced"
      ]
    },
    {
      "kind": "figure",
      "number": "2",
      "title": "Standard error reduction (in %) according to the sample size (i.e. number of sampled health units)*",
      "page": 38,
      "pageLabel": "28",
      "confidence": 0.9,
      "evidence": [
        "referenced",
        "in-sequence",
        "graphic"
      ]
    },
    {
      "kind": "table",
      "number": "9",
      "title": "Presentation of figures and accuracy rations",
      "page": 40,
      "pageLabel": "30",
      "confidence": 0.7,
      "evidence": [
        "referenced"
      ]
    },
    {
      "kind": "figure",
      "number": "3",
      "title": "Example presentation showing the proportion of re-counted measles immunizations that were reported by 6 HUs in 2003, District X",
      "page": 41,
      "pageLabel": "31",
      "confidence": 0.9,
      "evidence": [
        "referenced",
        "in-sequence",
        "graphic"
      ]
    },
    {
      "kind": "figure",
      "number": "4",
      "title": "Example presentation showing the quality indices for five components of a monitoring system, on a 0–10 scale",
      "page": 42,
      "pageLabel": "32",
      "confidence": 0.9,
      "evidence": [
        "referenced",
        "in-sequence",
        "graphic"
      ]
    }
  ],
  "images": [
    {
      "id": "vfig-p013",
      "file": "figures/vfig-p013.webp",
      "page": 13,
      "shows": [
        "Figure 1"
      ],
      "narratives": {
        "en": "Flow diagram (Figure 1, Reporting flow of immunization coverage data) in three panels: Health Unit, District and National. At the health unit, the child register and the community vaccination card feed tally sheets, which feed HU tabulations/monitoring chart and then the HU report; at district level, HU reports feed district tabulations/monitoring chart and the district report; at national level, district reports feed national tabulations and the WHO/UNICEF joint reporting form. Arrows carry each report up to the next level.",
        "ar": "مخطط انسيابي (الشكل 1، تدفق الإبلاغ عن بيانات التغطية بالتمنيع) في ثلاث لوحات: الوحدة الصحية، والمنطقة، والمستوى الوطني. في الوحدة الصحية، يغذّي سجلُّ الأطفال وبطاقةُ التطعيم المجتمعية أوراقَ العدّ، التي تغذّي جداول الوحدة الصحية/مخطط الرصد ثم تقرير الوحدة الصحية؛ وعلى مستوى المنطقة، تغذّي تقاريرُ الوحدات الصحية جداولَ المنطقة/مخطط الرصد وتقريرَ المنطقة؛ وعلى المستوى الوطني، تغذّي تقاريرُ المناطق الجداولَ الوطنية واستمارةَ الإبلاغ المشتركة بين منظمة الصحة العالمية واليونيسف. وتنقل الأسهم كل تقرير إلى المستوى الأعلى.",
        "zh": "流程图（图1，免疫接种覆盖率数据的报告流程），分为三栏：卫生单位、地区和国家。在卫生单位，儿童登记册和社区疫苗接种卡汇入计数表，计数表汇入卫生单位汇总表/监测图，再形成卫生单位报告；在地区一级，卫生单位报告汇入地区汇总表/监测图和地区报告；在国家一级，地区报告汇入国家汇总表以及世卫组织/联合国儿童基金会联合报告表。箭头将每份报告上报至上一级。",
        "es": "Diagrama de flujo (Figura 1, flujo de notificación de los datos de cobertura de inmunización) en tres paneles: unidad de salud, distrito y nivel nacional. En la unidad de salud, el registro infantil y la tarjeta de vacunación comunitaria alimentan las hojas de conteo, que alimentan las tabulaciones/gráfico de seguimiento de la unidad y luego el informe de la unidad de salud; en el distrito, los informes de las unidades alimentan las tabulaciones/gráfico de seguimiento del distrito y el informe del distrito; a nivel nacional, los informes de distrito alimentan las tabulaciones nacionales y el formulario conjunto de notificación OMS/UNICEF. Las flechas llevan cada informe al nivel siguiente.",
        "fr": "Diagramme de flux (Figure 1, Circuit de notification des données de couverture vaccinale) en trois panneaux : unité de santé, district et niveau national. À l'unité de santé, le registre des enfants et la carte de vaccination communautaire alimentent les feuilles de pointage, qui alimentent les tableaux/graphique de suivi de l'unité puis le rapport de l'unité de santé ; au district, les rapports des unités alimentent les tableaux/graphique de suivi du district et le rapport du district ; au niveau national, les rapports de district alimentent les tableaux nationaux et le formulaire de notification conjoint OMS/UNICEF. Des flèches font remonter chaque rapport au niveau supérieur.",
        "ru": "Блок-схема (рисунок 1, Поток отчётности по данным об охвате иммунизацией) из трёх панелей: медицинское учреждение, район и национальный уровень. В учреждении журнал регистрации детей и карта вакцинации (сообщество) поступают в учётные листы, затем в сводные таблицы/график мониторинга учреждения и в отчёт учреждения; на районном уровне отчёты учреждений поступают в районные сводные таблицы/график мониторинга и районный отчёт; на национальном уровне районные отчёты поступают в национальные сводные таблицы и совместную форму отчётности ВОЗ/ЮНИСЕФ. Стрелки передают каждый отчёт на следующий уровень."
      },
      "state": "draft"
    },
    {
      "id": "vfig-p038",
      "file": "figures/vfig-p038.webp",
      "page": 38,
      "shows": [
        "Figure 2"
      ],
      "narratives": {
        "en": "Line chart (Figure 2) of standard error reduction (0–100%) against the number of sampled health units (0–25). The curve rises steeply from 0% at one unit to about 50% at four units, then flattens, reaching about 80% at 25 units. A footnote says the example assumes a sample of 1000 per health unit with a 50% accuracy ratio.",
        "ar": "مخطط خطي (الشكل 2) لنسبة انخفاض الخطأ المعياري (0–100%) مقابل عدد الوحدات الصحية المشمولة بالعينة (0–25). يرتفع المنحنى بحدة من 0% عند وحدة واحدة إلى نحو 50% عند أربع وحدات، ثم يستوي ليبلغ نحو 80% عند 25 وحدة. وتذكر حاشية أن المثال يفترض عينة من 1000 لكل وحدة صحية بنسبة دقة 50%.",
        "zh": "折线图（图2），显示标准误差降低幅度（0–100%）与抽样卫生单位数（0–25）的关系。曲线从1个单位时的0%急剧上升至4个单位时的约50%，随后趋于平缓，25个单位时约为80%。脚注说明该示例假设每个卫生单位样本量为1000、准确率为50%。",
        "es": "Gráfico de líneas (Figura 2) de la reducción del error estándar (0–100%) según el número de unidades de salud muestreadas (0–25). La curva sube bruscamente del 0% con una unidad a cerca del 50% con cuatro, y luego se aplana hasta alrededor del 80% con 25 unidades. Una nota indica que el ejemplo supone una muestra de 1000 por unidad de salud con una razón de exactitud del 50%.",
        "fr": "Graphique linéaire (Figure 2) de la réduction de l'erreur type (0–100 %) en fonction du nombre d'unités de santé échantillonnées (0–25). La courbe monte fortement de 0 % pour une unité à environ 50 % pour quatre unités, puis s'aplatit pour atteindre environ 80 % à 25 unités. Une note précise que l'exemple suppose un échantillon de 1000 par unité de santé avec un ratio d'exactitude de 50 %.",
        "ru": "Линейный график (рисунок 2) снижения стандартной ошибки (0–100%) в зависимости от числа отобранных медицинских учреждений (0–25). Кривая резко растёт от 0% при одном учреждении до примерно 50% при четырёх, затем выполаживается и достигает около 80% при 25. В сноске указано, что пример рассчитан для выборки 1000 на учреждение при коэффициенте точности 50%."
      },
      "state": "draft"
    },
    {
      "id": "vfig-p041",
      "file": "figures/vfig-p041.webp",
      "page": 41,
      "shows": [
        "Figure 3"
      ],
      "narratives": {
        "en": "Paired bar chart (Figure 3) for six health units, HU1–HU6, in District X, 2003: each reported bar (on the HU reports found at district level) is at 100%, beside a hatched bar for the percentage verified by re-counting on the registers. Verified shares vary widely, from 100% at HU5 and roughly 90% at HU4 to roughly 60% at HU1 and HU2, under 40% at HU3 and about 25% at HU6.",
        "ar": "مخطط أعمدة مزدوجة (الشكل 3) لست وحدات صحية، من HU1 إلى HU6، في المنطقة X عام 2003: كل عمود للبيانات المبلَّغ عنها (في تقارير الوحدات الصحية الموجودة على مستوى المنطقة) عند 100%، وبجانبه عمود مظلَّل للنسبة المئوية التي جرى التحقق منها بإعادة العدّ في السجلات. وتتفاوت النسب المتحقَّق منها تفاوتًا كبيرًا، من 100% في HU5 ونحو 90% في HU4 إلى نحو 60% في HU1 وHU2، وأقل من 40% في HU3، ونحو 25% في HU6.",
        "zh": "成对柱状图（图3），显示2003年X地区六个卫生单位（HU1–HU6）的情况：每个报告值柱（地区一级所存卫生单位报告中的数据）均为100%，旁边的阴影柱为通过重新清点登记册核实的百分比。核实比例差异很大：HU5为100%，HU4约为90%，HU1和HU2约为60%，HU3低于40%，HU6约为25%。",
        "es": "Gráfico de barras pareadas (Figura 3) para seis unidades de salud, HU1–HU6, del Distrito X en 2003: cada barra de lo notificado (en los informes de las unidades encontrados a nivel de distrito) está al 100%, junto a una barra rayada con el porcentaje verificado mediante el recuento en los registros. Las proporciones verificadas varían mucho: 100% en HU5 y alrededor del 90% en HU4, frente a cerca del 60% en HU1 y HU2, menos del 40% en HU3 y alrededor del 25% en HU6.",
        "fr": "Graphique à barres appariées (Figure 3) pour six unités de santé, HU1 à HU6, du district X en 2003 : chaque barre des données notifiées (dans les rapports des unités trouvés au niveau du district) est à 100 %, à côté d'une barre hachurée indiquant le pourcentage vérifié par recomptage dans les registres. Les parts vérifiées varient fortement : 100 % pour HU5 et environ 90 % pour HU4, contre environ 60 % pour HU1 et HU2, moins de 40 % pour HU3 et environ 25 % pour HU6.",
        "ru": "Парная столбчатая диаграмма (рисунок 3) по шести медицинским учреждениям HU1–HU6 района X за 2003 г.: каждый столбец сообщённых данных (по отчётам учреждений, имеющимся на районном уровне) равен 100%, рядом заштрихованный столбец — доля, подтверждённая пересчётом по журналам. Подтверждённые доли сильно различаются: 100% в HU5 и около 90% в HU4, около 60% в HU1 и HU2, менее 40% в HU3 и около 25% в HU6."
      },
      "state": "draft"
    },
    {
      "id": "vfig-p042",
      "file": "figures/vfig-p042.webp",
      "page": 42,
      "shows": [
        "Figure 4"
      ],
      "narratives": {
        "en": "Radar chart (Figure 4) of example quality index scores on a 0–10 scale for five components of a monitoring system: Recording, Archiving and reporting, Demographics, Core outputs and Data use. Archiving and reporting scores highest (roughly 7) and Recording about 6, while Demographics, Core outputs and Data use are lower, at roughly 4–5.",
        "ar": "مخطط راداري (الشكل 4) لدرجات مؤشرات الجودة على سبيل المثال على مقياس من 0 إلى 10 لخمسة مكونات لنظام الرصد: التسجيل، والحفظ والإبلاغ، والبيانات الديمغرافية، والمخرجات الأساسية، واستخدام البيانات. ويسجّل الحفظ والإبلاغ أعلى درجة (نحو 7) والتسجيل نحو 6، في حين تنخفض البيانات الديمغرافية والمخرجات الأساسية واستخدام البيانات إلى نحو 4–5.",
        "zh": "雷达图（图4），以0–10分显示监测系统五个组成部分的示例质量指数得分：记录、存档和报告、人口统计、核心产出和数据使用。存档和报告得分最高（约7分），记录约6分，而人口统计、核心产出和数据使用较低，约为4–5分。",
        "es": "Gráfico radial (Figura 4) con puntuaciones de ejemplo de los índices de calidad, en una escala de 0 a 10, para cinco componentes de un sistema de seguimiento: registro, archivo y notificación, datos demográficos, productos básicos y uso de los datos. Archivo y notificación obtiene la puntuación más alta (alrededor de 7) y registro cerca de 6, mientras que datos demográficos, productos básicos y uso de los datos son más bajos, de alrededor de 4–5.",
        "fr": "Graphique radar (Figure 4) présentant des scores d'indices de qualité fictifs, sur une échelle de 0 à 10, pour cinq composantes d'un système de suivi : enregistrement, archivage et notification, données démographiques, produits essentiels et utilisation des données. L'archivage et la notification obtiennent le score le plus élevé (environ 7) et l'enregistrement environ 6, tandis que les données démographiques, les produits essentiels et l'utilisation des données sont plus faibles, autour de 4–5.",
        "ru": "Лепестковая диаграмма (рисунок 4) с примерными значениями индексов качества по шкале 0–10 для пяти компонентов системы мониторинга: регистрация, архивирование и отчётность, демографические данные, основные результаты и использование данных. Наивысший балл у архивирования и отчётности (около 7), у регистрации — около 6, а демографические данные, основные результаты и использование данных ниже — около 4–5."
      },
      "state": "draft"
    }
  ],
  "tables": [
    {
      "label": "Table 1",
      "caption": "Table 1. Description of the main areas a DQS can assess",
      "pages": [
        12
      ],
      "columns": [
        {
          "titles": "Option"
        },
        {
          "titles": "District"
        },
        {
          "titles": "Health Unit"
        },
        {
          "titles": "Main measures"
        }
      ],
      "rows": [
        [
          "Assess reporting accuracy",
          "X",
          "X",
          "Accuracy ratio"
        ],
        [
          "Assess recording accuracy (sample in the community)",
          "",
          "X",
          "Accuracy ratio"
        ],
        [
          "Assess completeness/timeliness of reporting",
          "X",
          "X",
          "Completeness of district reporting (%)\nTimeliness of district reporting (%)\nDistrict report availability at national level (%)\nCompleteness of HU reporting (%)\nTimeliness of HU reporting (%)\nHU report availability at district level (%)"
        ],
        [
          "Assess the quality of the monitoring system",
          "X",
          "X",
          "Quality index (QI) scores"
        ],
        [
          "Assess the quality of immunization card recording",
          "",
          "X",
          "Integrated in the QI"
        ],
        [
          "Estimate vaccine wastage",
          "X",
          "X",
          "Unopened vial wastage at district store level\nOpened vial wastage at HU level"
        ]
      ],
      "narratives": {
        "en": "The table lists the options of the immunization data quality self-assessment (DQS) toolbox, marks with an X whether each applies at district and/or health unit level, and gives the main measures produced.",
        "ar": "يسرد الجدول خيارات مجموعة أدوات التقييم الذاتي لجودة بيانات التمنيع، ويشير بعلامة X إلى ما إذا كان كل خيار ينطبق على مستوى المنطقة و/أو الوحدة الصحية، ويبيّن المقاييس الرئيسية الناتجة.",
        "zh": "该表列出免疫接种数据质量自我评估工具箱中的各项选项，用X标明每项适用于地区一级和/或卫生单位一级，并给出主要衡量指标。",
        "es": "La tabla enumera las opciones del conjunto de herramientas de autoevaluación de la calidad de los datos de inmunización (DQS), indica con una X si cada una se aplica en el nivel de distrito y/o de unidad de salud, y presenta las principales medidas obtenidas.",
        "fr": "Le tableau énumère les options de la boîte à outils d’auto-évaluation de la qualité des données de vaccination (DQS), indique par un X si chacune s’applique au niveau du district et/ou de l’unité de santé, et donne les principales mesures produites.",
        "ru": "В таблице перечислены варианты набора инструментов самооценки качества данных об иммунизации (DQS), крестиком отмечено, применяется ли каждый из них на уровне района и/или медицинского учреждения, и указаны основные получаемые показатели."
      },
      "csv": "tables/table-1.csv"
    },
    {
      "label": "Table 2",
      "caption": "Table 2: Findings of accuracy assessment (HU registers/HU reports) in six HUs, province A",
      "pages": [
        21
      ],
      "columns": [
        {
          "titles": "District (target population)"
        },
        {
          "titles": "HU"
        },
        {
          "titles": "Re-counted number of vaccinations in the HU register"
        },
        {
          "titles": "Reported number of vaccinations by the HU"
        },
        {
          "titles": "HU accuracy ratio"
        },
        {
          "titles": "Target population of the HU"
        },
        {
          "titles": "Weight of the HU in the district sample"
        }
      ],
      "rows": [
        [
          "1 (5000)",
          "1",
          "315",
          "336",
          "94%",
          "447",
          "58.2%"
        ],
        [
          "",
          "2",
          "280",
          "275",
          "102%",
          "321",
          "41.8%"
        ],
        [
          "2 (3000)",
          "3",
          "125",
          "154",
          "81%",
          "151",
          "43%"
        ],
        [
          "",
          "4",
          "120",
          "139",
          "86%",
          "200",
          "57%"
        ],
        [
          "3 (1000)",
          "5",
          "60",
          "54",
          "111%",
          "81",
          "48.5%"
        ],
        [
          "",
          "6",
          "78",
          "79",
          "99%",
          "86",
          "51.5%"
        ]
      ],
      "narratives": {
        "en": "For six health units (HUs) in three districts of an example province, the table compares the number of vaccinations re-counted in HU registers with the number reported by each HU, giving the HU accuracy ratio, target population and the weight of each HU in its district sample.",
        "ar": "يقارن الجدول، بالنسبة إلى ست وحدات صحية في ثلاث مناطق من إقليم افتراضي، عدد التطعيمات المعاد عدّها في سجلات الوحدات الصحية بالعدد المبلّغ عنه من كل وحدة، مع بيان نسبة الدقة للوحدة، والسكان المستهدفين، ووزن كل وحدة في عينة منطقتها.",
        "zh": "该表针对一个示例省份三个地区的六个卫生单位，将卫生单位登记册中重新清点的疫苗接种数与各单位报告的接种数进行比较，并给出卫生单位准确率、目标人口以及各单位在其所属地区样本中的权重。",
        "es": "Para seis unidades de salud de tres distritos de una provincia de ejemplo, la tabla compara el número de vacunaciones recontadas en los registros de cada unidad con el número notificado por ella, e indica la razón de exactitud de la unidad, su población destinataria y su peso en la muestra del distrito.",
        "fr": "Pour six unités de santé situées dans trois districts d’une province donnée en exemple, le tableau compare le nombre de vaccinations recomptées dans les registres de chaque unité au nombre qu’elle a notifié, et indique le ratio d’exactitude de l’unité, sa population cible et son poids dans l’échantillon du district.",
        "ru": "Для шести медицинских учреждений в трех районах условной провинции в таблице сопоставлено число прививок, пересчитанных по регистрационным журналам учреждения, с числом прививок, указанным в его отчетах, и приведены коэффициент точности учреждения, его целевая группа населения и вес учреждения в выборке района."
      },
      "csv": "tables/table-2.csv"
    },
    {
      "label": "Table 7",
      "caption": "Table 7: Proposed components of the monitoring system",
      "pages": [
        30
      ],
      "columns": [
        {
          "titles": "District level"
        },
        {
          "titles": "HU level"
        }
      ],
      "rows": [
        [
          "Recording\nPaper-form practices\nComputer practices",
          "Recording"
        ],
        [
          "Archiving\nPaper-form practices\nComputer practices",
          "Archiving"
        ],
        [
          "Reporting",
          "Reporting"
        ],
        [
          "Demographic information",
          "Demographic information"
        ],
        [
          "Core output / analyses",
          "Core output/ analyses"
        ],
        [
          "Evidence of using data for action",
          "Evidence of using data for action"
        ]
      ],
      "notes": "At district level, “Paper-form practices” and “Computer practices” are printed indented as sub-items of Recording and of Archiving.",
      "narratives": {
        "en": "The table lists the proposed components of the immunization monitoring system to be assessed at district level and at health unit (HU) level, from recording and archiving to evidence of using data for action.",
        "ar": "يسرد الجدول المكونات المقترحة لنظام رصد التمنيع التي ينبغي تقييمها على مستوى المنطقة وعلى مستوى الوحدة الصحية، بدءاً من التسجيل والأرشفة وصولاً إلى الأدلة على استخدام البيانات لاتخاذ الإجراءات.",
        "zh": "该表列出在地区一级和卫生单位一级需评估的免疫监测系统拟议组成部分，从记录和存档到利用数据采取行动的证据。",
        "es": "La tabla enumera los componentes propuestos del sistema de seguimiento de la inmunización que deben evaluarse en el nivel de distrito y en el de unidad de salud, desde el registro y el archivo hasta las pruebas del uso de los datos para la acción.",
        "fr": "Le tableau énumère les composantes proposées du système de suivi de la vaccination à évaluer au niveau du district et au niveau de l’unité de santé, de l’enregistrement et de l’archivage jusqu’aux preuves de l’utilisation des données pour l’action.",
        "ru": "В таблице перечислены предлагаемые компоненты системы мониторинга иммунизации, подлежащие оценке на уровне района и на уровне медицинского учреждения, — от регистрации и архивирования до свидетельств использования данных для принятия мер."
      },
      "csv": "tables/table-7.csv"
    },
    {
      "label": "Table 8",
      "caption": "Table 8: Method of assigning weights for each qualitative question in the DQS (scores in the table are examples, allowed range in the Excel tool is 1–3)",
      "pages": [
        31
      ],
      "columns": [
        {
          "titles": ""
        },
        {
          "titles": "Score Staff 1 a"
        },
        {
          "titles": "Score Staff 2 b"
        },
        {
          "titles": "Score Staff 3 c"
        },
        {
          "titles": "Average score (a+b+c) / 3"
        },
        {
          "titles": "Weight (rounding the decimal)"
        }
      ],
      "rows": [
        [
          "Q1",
          "3",
          "2",
          "2",
          "2.3",
          "2"
        ],
        [
          "Q2",
          "1",
          "1",
          "2",
          "1.3",
          "1"
        ],
        [
          "Q3",
          "3",
          "3",
          "2",
          "2.6",
          "3"
        ],
        [
          "Etc…",
          "",
          "",
          "",
          "",
          ""
        ]
      ],
      "narratives": {
        "en": "The table illustrates how a weight is assigned to each qualitative question in the DQS: three staff members score each question, the scores are averaged and the average is rounded to give the weight.",
        "ar": "يوضّح الجدول كيفية تحديد وزن لكل سؤال نوعي في التقييم الذاتي لجودة البيانات: يمنح ثلاثة موظفين درجة لكل سؤال، ويُحسب متوسط الدرجات، ثم يُقرَّب المتوسط للحصول على الوزن.",
        "zh": "该表说明如何为数据质量自我评估中的每个定性问题分配权重：三名工作人员分别为每个问题打分，计算平均分，再将平均分取整得到权重。",
        "es": "La tabla ilustra cómo se asigna un peso a cada pregunta cualitativa de la DQS: tres miembros del personal puntúan cada pregunta, se calcula el promedio de las puntuaciones y se redondea para obtener el peso.",
        "fr": "Le tableau illustre la manière d’attribuer un poids à chaque question qualitative du DQS : trois membres du personnel notent chaque question, la moyenne des notes est calculée puis arrondie pour obtenir le poids.",
        "ru": "В таблице показано, как каждому качественному вопросу DQS присваивается вес: три сотрудника оценивают каждый вопрос, оценки усредняются, и среднее значение округляется для получения веса."
      },
      "csv": "tables/table-8.csv"
    },
    {
      "label": "Table 9",
      "caption": "Table 9: Presentation of figures and accuracy rations",
      "pages": [
        40
      ],
      "columns": [
        {
          "titles": ""
        },
        {
          "titles": ""
        }
      ],
      "rows": [
        [
          "Accuracy of district tabulation, DTP3, year 2003 (October–December), district X",
          ""
        ],
        [
          "Total of HU reports",
          "3465"
        ],
        [
          "District tabulation",
          "3545"
        ],
        [
          "Accuracy ratio",
          "98%"
        ],
        [
          "DTP3 re-counting at HU level (register against HU reports, year 2003) Based on 4 HUs, district X",
          ""
        ],
        [
          "Verified",
          "6848"
        ],
        [
          "Reported",
          "10 845"
        ],
        [
          "Accuracy ratio",
          "63%"
        ]
      ],
      "notes": "The table has no column header row; two bold heading rows span both columns. Items in each block are printed as bullet lists. “rations” is as printed in the caption.",
      "narratives": {
        "en": "The table is an example of how to present DQS accuracy results: for a district, it shows the totals of health unit reports and the district tabulation for DTP3 with their accuracy ratio, and the verified and reported DTP3 counts from re-counting at four health units with their accuracy ratio.",
        "ar": "يمثّل الجدول مثالاً على كيفية عرض نتائج الدقة في التقييم الذاتي لجودة البيانات: فهو يبيّن لمنطقة ما مجموع تقارير الوحدات الصحية وجدولة المنطقة للجرعة الثالثة من لقاح الدفتيريا والكزاز والسعال الديكي مع نسبة الدقة، والأعداد المتحقق منها والمبلّغ عنها من إعادة العد في أربع وحدات صحية مع نسبة الدقة.",
        "zh": "该表举例说明如何呈现数据质量自我评估的准确性结果：针对一个地区，显示百白破第三剂的卫生单位报告合计数与地区汇总数及其准确率，以及在四个卫生单位重新清点所得的核实数与报告数及其准确率。",
        "es": "La tabla es un ejemplo de cómo presentar los resultados de exactitud de la DQS: para un distrito, muestra los totales de los informes de las unidades de salud y la tabulación distrital de la DTP3 con su razón de exactitud, y los recuentos de DTP3 verificados y notificados en cuatro unidades de salud con su razón de exactitud.",
        "fr": "Le tableau donne un exemple de présentation des résultats d’exactitude du DQS : pour un district, il présente le total des rapports des unités de santé et la compilation du district pour le DTC3 avec leur ratio d’exactitude, ainsi que les nombres de DTC3 vérifiés et notifiés lors du recomptage dans quatre unités de santé avec leur ratio d’exactitude.",
        "ru": "Таблица служит примером представления результатов оценки точности DQS: для района показаны итог по отчетам медицинских учреждений и районная сводка по АКДС3 с коэффициентом точности, а также проверенные и указанные в отчетах числа АКДС3 по результатам пересчета в четырех учреждениях с коэффициентом точности."
      },
      "csv": "tables/table-9.csv"
    }
  ],
  "coverage": [
    {
      "kind": "contents",
      "state": "found",
      "count": 16,
      "note": "outline"
    },
    {
      "kind": "sections",
      "state": "found",
      "count": 16,
      "note": "one level"
    },
    {
      "kind": "figures",
      "state": "found",
      "count": 4
    },
    {
      "kind": "tables",
      "state": "found",
      "count": 5
    },
    {
      "kind": "references",
      "state": "none",
      "note": "no such heading in the text"
    },
    {
      "kind": "glossary",
      "state": "not-extracted",
      "note": "a glossary section is in the text (p7); its entries are not extracted"
    },
    {
      "kind": "footnotes",
      "state": "not-extracted"
    },
    {
      "kind": "summaries",
      "state": "found",
      "count": 16,
      "note": "16 of 16 sections"
    }
  ],
  "links": {
    "repo": "litlfred/who-iris",
    "branch": "main",
    "dir": "library/10665-69034"
  }
}
