DryPipe
Navigation
Getting Started
Install
Github repo
Writing Pipelines
The DryPipe DSL
Tasks
The DAG
Well behaved DAG generators
Dividing work into smaller chunks
File dependencies between Tasks
Variable dependencies between Tasks
Calling Python functions from Tasks
Dynamic DAGs
Semi hardcoded DAGs
Input file driven DAGs
DAG driven by task execution
When NOT to use dsl.wait_for
Pipeline composition
Directory structure
Task launch script and variables
Pipeline specific variables
Generated scripts
DryPipe variables
Runtime configuration
Task level configs
Pipeline level configs
DryPipe CLI
Positional Arguments
Named Arguments
Sub-commands
run
Named Arguments
prepare
Named Arguments
service
Named Arguments
upgrade-drypipe
Named Arguments
restart-failed-array-tasks
Named Arguments
report-execution-times
Named Arguments
task
Named Arguments
restart
Named Arguments
poll-task
Named Arguments
remote-exec
Named Arguments
fetch-remote-state
Named Arguments
upload-drypipe-for-remote-instance
Named Arguments
upload-task-inputs
Named Arguments
sbatch
Named Arguments
sbatch-gen
Named Arguments
dump-env
Named Arguments
array-submit
Named Arguments
array-upload
Named Arguments
array-download
Named Arguments
array-submit-from-remote
Named Arguments
array-watch-from-remote
Named Arguments
array-create-parent
Named Arguments
list-states
Named Arguments
array-rsync-list
Named Arguments
call
Positional Arguments
Named Arguments
Definitions
Related Topics
Documentation overview
Index