Difference between revisions of "P3s"

From DUNE
Jump to navigation Jump to search
Line 18: Line 18:
 
=DAG=
 
=DAG=
 
* Vertex and Edge tables: vertices are jobs and the edges are data
 
* Vertex and Edge tables: vertices are jobs and the edges are data
* Leaves of a DAG: can only be a job, not data (since all data are edges and not vertices). This also
+
* Leaves of a DAG: can only be a job, not data (since all data are edges and not vertices). This also has the benefit of not having final data unaccounted for - it must me either flushed or moved to permanent
has the benefit of not having final data unaccounted for - it must me either flushed or moved to permanent
 
 
storage in most cases. The job/task responsible for it forms the leaf.
 
storage in most cases. The job/task responsible for it forms the leaf.

Revision as of 22:40, 4 December 2016

!!!UNDER CONSTRUCTION!!!

States of Pilots and Jobs

Pilots

States:

  • active
  • dispatched
  • running
  • finished (completion of a job)
  • stopped (timeout w/o getting a job)

Jobs

States:

  • defined
  • dispatched (sent to a pilot)
  • running
  • finished

DAG

  • Vertex and Edge tables: vertices are jobs and the edges are data
  • Leaves of a DAG: can only be a job, not data (since all data are edges and not vertices). This also has the benefit of not having final data unaccounted for - it must me either flushed or moved to permanent

storage in most cases. The job/task responsible for it forms the leaf.