Summary

Timely Dataflow

• Motivation

  • A Simplest Example
  • A Simple Example
  • When to use Timely Dataflow
  • When not to use Timely Dataflow

• Core Concepts

  • Dataflow
  • Timestamps
  • Progress

• Building Timely Dataflows

  • Creating Inputs
  • Observing Outputs
  • Adding Operators
  • Creating Operators
  • A Worked Example

• Running Timely Dataflows

  • Providing Input
  • Monitoring Probes
  • Operator Execution
  • Extending Dataflows

• Advanced Timely Dataflow

  • Scopes
  • Iteration
  • Flow Control
  • Capture and Replay
  • Custom Datatypes

• Internals

  • Communication
  • Progress Tracking