Skip to main content

DataCROP Maize Workflow Management Editor User Guide

Overview

The editor sidebar currently includes seven pages:

  • Warehouse: Create and manage reusable data models (workflows list, digital resources, workers, data kinds, and admin-only catalogs).
  • Workflow Lab: Configure workflow DAG metadata, design flow graphs, assign processors/workers/resources, and run/stop workflows.
  • Airflow DAGs: Opens the Airflow UI in an iframe.
  • Kibana Visualizations: Opens Kibana dashboards in an iframe.
  • Celery Workers Status: Opens Celery workers status in an iframe.
  • Logstash Monitor: Shows Logstash pipeline health, event counters, and last checked status for saved Logstash Pipeline processors.
  • Settings: Theme/preferences, registry credentials, admin initialization, and read-only user profile.

This guide focuses on the pages where most daily work happens: Warehouse, Workflow Lab, Logstash Pipelines, operational monitoring pages, and Settings.

Read This First

Use this sequence when onboarding a new environment:

  1. Getting Started
  2. Creating Data Models
  3. Creating Workflows
  4. Logstash Pipelines
  5. Settings
  6. Airflow and Operational Views

Access Notes

  • Some Warehouse tabs are admin-only (Processor Definitions, Data Interface Types).
  • The Initialize Resources action is visible only to admins in Settings.
  • If initialization is missing, Warehouse shows a warning and links to Settings.