Process
https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure
JSON-LD · diagram · in graph folio-assistant-core.jsonld ·
| name | Ingestion subprocess — extract structure |
|---|---|
| summary | Extract the structure of an uploaded source: its text layer, OCR where it has none or where a page's text layer fails the page check, sections, structure and claim candidates. |
| description | Extract the structure of an uploaded source: its text layer, OCR where it has none or where a page's text layer fails the page check, sections, structure and claim candidates. Every step is an arm or rung of bun run cat ingest (cat-harness-tools scripts/ingest-document.ts). |
| enforcement | advisory |
| sourcePath | processes/library/ingest-extract-structure.bpmn |
| sourceUrl | https://github.com/litlfred/folio-assistant-core/blob/main/processes/library/ingest-extract-structure.bpmn |
| depiction | https://litlfred.github.io/folio-assistant/assets/img/workflows/ingest-extract-structure.svg |
| startNode | Binary in hand https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/StartEvent_Binary |
| nodeCount | 9 |
| flowCount | 9 |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
|---|---|
| from | Binary in hand https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/StartEvent_Binary |
| to | Embedded text layer? https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Gateway_HasText |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| name | yes |
|---|---|
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
| from | Embedded text layer? https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Gateway_HasText |
| to | Extract the text layer https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_ExtractText |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| name | no — scanned |
|---|---|
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
| from | Embedded text layer? https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Gateway_HasText |
| to | OCR to ocr/page-*.txt https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Ocr |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
|---|---|
| from | Extract the text layer https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_ExtractText |
| to | Check each page; OCR pages that fail https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_PageCheck |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
|---|---|
| from | Check each page; OCR pages that fail https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_PageCheck |
| to | Split into sections/*.md with doc_brief front-matter https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Sections |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
|---|---|
| from | OCR to ocr/page-*.txt https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Ocr |
| to | Split into sections/*.md with doc_brief front-matter https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Sections |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
|---|---|
| from | Split into sections/*.md with doc_brief front-matter https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Sections |
| to | Write structure.json https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Structure |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
|---|---|
| from | Write structure.json https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Structure |
| to | Extract claim candidates https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Candidates |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |
| partOf | Ingestion subprocess — extract structure https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure |
|---|---|
| from | Extract claim candidates https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/Task_Candidates |
| to | Structured https://litlfred.github.io/folio-assistant/folio-assistant-core/process/Process_ExtractStructure/node/EndEvent_Structured |
| inSubgraph | core-processes https://litlfred.github.io/folio-assistant/folio-assistant-core/directory/core-processes |