Creating workflows

HydroFlows provides a framework that allows users to define methods, compose workflows, and execute them within HydroFlows or with supported workflow engines. It is designed to simplify the process of creating complex model and data pipelines by providing an interactive environment to define methods and compose workflows. By defining workflows in HydroFlows and exported these to supported workflow engines, users can take advantage of the capabilities of these engines, while saving time and effort to learn the sometimes complicated syntax of a workflow engines.

The framework is built around the following components as shown in the diagram below:

This section provides an overview of the HydroFlows framework and its components. It includes the following subsections:

• Terminology: This section provides definitions of key terms used throughout the HydroFlows framework.

• Define Method: This section provides instructions on how to create methods and highlights some special methods.

• Compose Workflow: This section guides users on how to compose workflows by linking methods defined in the previous section, including wildcards to ot generalize rules to different input files.

• Execute Workflow: This section explains the steps to execute workflows within HydroFlows or with supported workflow engines.

• Add Own Method: This section describes how users can add their own custom methods to the HydroFlows framework.

• Terminology
• Define a method
  • Using predefined methods
  • Expand and reduce methods
  • Using python scripts as methods
  • Define a custom method
• Compose a workflow
  • Initialize a workflow
  • Create workflow rules (basic)
  • Create workflow rules (repeat wildcards)
  • Create workflow rules (expand and reduce wildcards)
  • More workflow examples
• Execute a Workflow
  • Execute with HydroFlows
  • Export to and execute with Workflow Engine
• Create a custom methods (advanced)
  • Creating a basic method
  • Creating an expand method
  • Creating a reduce method
  • Registering the method