Process
IRIS CDN nightly change ingest
https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly
JSON-LD · diagram · in graph who-iris.jsonld ·
| name | IRIS CDN nightly change ingest |
|---|---|
| summary | Every night: ask the IRIS DSpace REST API which items changed since the last published run, ingest only those, rebuild the whole graph (sorted output keeps unchanged partitions byte-identical), and publish a signed release. |
| description | Every night: ask the IRIS DSpace REST API which items changed since the last published run, ingest only those, rebuild the whole graph (sorted output keeps unchanged partitions byte-identical), and publish a signed release. A night with no changes publishes nothing and commits nothing. |
| enforcement | strict |
| sourcePath | processes/iris-cdn-nightly.bpmn |
| sourceUrl | https://github.com/litlfred/who-iris/blob/main/processes/iris-cdn-nightly.bpmn |
| depiction | https://litlfred.github.io/folio-assistant/assets/img/workflows/iris-cdn-nightly.svg |
| startNode | Every night, 02:00 UTC https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Start_Nightly |
| nodeCount | 13 |
| flowCount | 12 |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
Flows
flow/N1
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Every night, 02:00 UTC https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Start_Nightly |
| to | Read the cursor of the last published run https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_ReadCursor |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N2
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Read the cursor of the last published run https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_ReadCursor |
| to | List items changed since the cursor https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_ListChanged |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N3
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | List items changed since the cursor https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_ListChanged |
| to | Anything changed? https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/GW_Any |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N4
| name | no |
|---|---|
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
| from | Anything changed? https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/GW_Any |
| to | Nothing published, nothing committed https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/End_NoChange |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N5
| name | yes |
|---|---|
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
| from | Anything changed? https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/GW_Any |
| to | Fetch the changed records and bitstream lists https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_FetchChanged |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N6
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Fetch the changed records and bitstream lists https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_FetchChanged |
| to | Fetch only bitstreams whose checksum changed https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_FetchNewBytes |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N7
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Fetch only bitstreams whose checksum changed https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_FetchNewBytes |
| to | Write canonical records into the library https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_WriteRecords |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N8
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Write canonical records into the library https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_WriteRecords |
| to | Rebuild the whole graph (sorted output) https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Call_Rebuild |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N9
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Rebuild the whole graph (sorted output) https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Call_Rebuild |
| to | Sign and publish the release https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Call_SignPublish |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N10
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Sign and publish the release https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Call_SignPublish |
| to | Commit the advanced cursor https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_AdvanceCursor |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N11
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Commit the advanced cursor https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_AdvanceCursor |
| to | Review the run report; open beans for anomalies https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_Review |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |
flow/N12
| partOf | IRIS CDN nightly change ingest https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly |
|---|---|
| from | Review the run report; open beans for anomalies https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/Task_Review |
| to | Night published and reviewed https://litlfred.github.io/folio-assistant/who-iris/process/Process_IrisCdnNightly/node/End_Done |
| inSubgraph | who-iris-processes https://litlfred.github.io/folio-assistant/who-iris/directory/who-iris-processes |