DataCROP Maize Workflow Management Editor User Guide
Overview
The editor sidebar currently includes seven pages:
- Warehouse: Create and manage reusable data models (workflows list, digital resources, workers, data kinds, and admin-only catalogs).
- Workflow Lab: Configure workflow DAG metadata, design flow graphs, assign processors/workers/resources, and run/stop workflows.
- Airflow DAGs: Opens the Airflow UI in an iframe.
- Kibana Visualizations: Opens Kibana dashboards in an iframe.
- Celery Workers Status: Opens Celery workers status in an iframe.
- Logstash Monitor: Shows Logstash pipeline health, event counters, and last checked status for saved Logstash Pipeline processors.
- Settings: Theme/preferences, registry credentials, admin initialization, and read-only user profile.
This guide focuses on the pages where most daily work happens: Warehouse, Workflow Lab, Logstash Pipelines, operational monitoring pages, and Settings.
Read This First
Use this sequence when onboarding a new environment:
- Getting Started
- Creating Data Models
- Creating Workflows
- Logstash Pipelines
- Settings
- Airflow and Operational Views
Access Notes
- Some Warehouse tabs are admin-only (Processor Definitions, Data Interface Types).
- The Initialize Resources action is visible only to admins in Settings.
- If initialization is missing, Warehouse shows a warning and links to Settings.
. Getting Started
Before using the Workflow Editor, choose a deployment path on the Maize Setup page: either the single-script Maize MVP approach or the manual per-repository setup.
. Creating Data Models
This page documents the current Warehouse behavior implemented in the frontend.
. Creating Workflows
This page documents the current Lab implementation: workflow details, flow editor behavior, runtime actions, and template usage.
. Logstash Pipelines
1 item
. Settings
The Settings page controls user-level preferences, registry credentials, and admin resource initialization.
. Airflow And Operational Views
The editor includes several read-only operational pages for inspecting workflow execution, visualizations, and worker health without leaving WME.