Continuous flow compute point based data processing

摘要: A data processing system and method that provides two processes, checkpointing compute point propagation, permits a continuous flow of by allowing each process to (1) return normal operation after or (2) respond receipt indicator, independently the time required other processes for similar responsive actions. Checkpointing makes use command message from checkpoint processor sequentially propagates through stage sources sinks, triggering its state then pass on connected “downstream” processes. indicator marks blocks records should be processed as group within process. is triggered sinks without external control. Compute indicators also effectively self-synchronize multiple flows Use rather than checkpoints avoids delay saving imposes, while permitting processing, including outputting results.