Please enable JavaScript.
Coggle requires JavaScript to display documents.
Data Flow Architecture (What is Data Flow Architecture? (Whole system as…
-
Sub-categories
Batch Sequential
a data transformation subsystem can initiate its process only after its previous subsystem is complete
Traditional data processing model, widely used in 1950’s – 1970’s
-
-
-
-
Pipe & Filter
-
Basic concepts
-
-
Filter
Independent data stream transformer:
- Reads data from input data stream
- Process data and write to output stream
- Does not wait for batched data as a whole
- Does not even have to know identity of i/o streams
Classification
Active Filter:
- pulls in data and push out the transformed data (pull/push)
- works with a passive pipe that provides read/write mechanisms for pulling and pushing.
- Example: UNIX pipe.
Passive Filter:
- Lets connected pipe to push data in and pull data out.
- The filter must provide read/write mechanisms in this case.
Pipe
Data conduit:
- Moves data from one filter to another
- Two types: character or byte streams
Data Flow Methods
Push only:
- A data source may push data in a downstream
- A filter may push data in a downstream
Pull only:
- A data sink may pull data from an upstream
- Filter may pull data from an upstream
Push/Pull:
- A filter may pull data from an upstream and push transformed data in a downstream.
Applicable Design Domain:
- System can be broken into a series of processing steps over data stream
- Data format on the data stream is simple and stable, and easy to be adapted
- There are significant work which can be pipelined to gain the performance
- Suitable for producer/consumer model
Evaluation
Advantages:
- High concurrency
- Reusability is easy – plug and play.
- Modifiability: Low due to coupling between filters
- Simplicity: Clear
- Flexibility: High, very modular design
- Lower latency
Disadvantages:
- Not suitable for dynamic interactions
- Data standards (ASCII, XML?)
- Overhead of data transformation among filters such as parsing is repeated in two consecutive filters
- Difficult to configure a P&F system dynamically.
- Error handling issue
Process Control
-
Data
Controlled variable: target controlled variable
- E.g., Speed in a cruise control system
- E.g., Temperature in an auto H/A system.
-
Manipulated variable: can be adjusted by the controller
- E.g., motor rotation speed, etc.
-
-