P3s
!!!UNDER CONSTRUCTION!!!
States of Pilots and Jobs
Pilots
States:
- active
- dispatched
- running
- finished (completion of a job)
- stopped (timeout w/o getting a job)
Jobs
States:
- defined
- dispatched (sent to a pilot)
- running
- finished
DAG
- Vertex and Edge tables: vertices are jobs and the edges are data
- Leaves of a DAG: can only be a job, not data (since all data are edges and not vertices). This also has the benefit of not having final data unaccounted for - it must me either flushed or moved to permanent storage in most cases. The job/task responsible for either of these operations forms the leaf.