Skip to navigation

Platform Overview Diagram

The nodes represent system components where events or data arrive and places where events and data originate. The arrows show the direction of the flow of data and events. The intention of this diagram is to give a visible representation to the entire system at a high level.
 

The Platform

File Intake Service File Classifier File Splitter Document Classifier Document Extractor A Document Extractor B Document Extractor C Postprocessor J Postprocessor K Extracted Data Storage Raw Extracted Data Storage External File Storage Upload File Storage Internal File Storage Status Service

I did not connect the status service to all the places it might listen. It cluttered the diagram too much. It will listen to files coming into the system (the event from the intake service) and for new document events from the document classifier and other events as needed to mark completion of significant processing milestones. We should see at least a “new file provided”, “new file ready for processing” and messages for each extractor completion and each postprocessor completion. There may be additional places to listen for other details. The main lifecycle events for each item (document) are the minimum needed.

Another reason for the status service is that it will know which documents and files are being processed, which are completed and which are rejected. This information will be needed by the file intake service and the user interface applications.