Skip to main content
DataCROP™ Maize · Workflow Management Engine

Workflows Made Easy

Describe processing components and data sources once, connect them on a drag-and-drop canvas, and run them as Docker containers on your own workers — with Airflow scheduling, managed Logstash pipelines, Kibana observability and a Workflow Assistant (Preview) that drafts workflows for you.

QuickstartWhat is DataCROP Maize?GitHub
Deploy with the Maize MVP
git clone https://github.com/datacrop/maize-mvp.git
cd maize-mvp
cp .env.example .env   # then set HOST_IP
./setup.sh             # option 1: deploy everything

DataCROP Maize in three minutes

A narrated tour of the Workflow Management Engine.

DataCROP Maize Workflow Management Editor — 3-minute introduction

What you can do

Everything a workflow needs, from catalogue to running containers.

Model componentsWrap ML models, LLM services or scripts as processor definitions: a container image or a Compose app from GitHub, with declared interfaces and parameters.Describe your dataKafka, Elasticsearch, MQTT, MongoDB, S3, Redis, RabbitMQ, HTTP and Beats resources, with data kinds and schemas.Connect visuallyDrag-and-drop workflows that only allow compatible links. Connected resources become environment variables automatically.Deploy anywhereAirflow DAGs run each processor on the worker you choose — once or on a schedule — across as many workers as you need.Pipelines without codeManaged Logstash pipelines between resources, with an AI assistant that drafts, explains and fixes filters.Observe & operateObservations, auto-built Kibana dashboards, Worker Runtime logs and start/stop/restart, Airflow run history.Workflow AssistantDescribe what you need; an AI agent drafts the workflow and resources for you to review in the Lab. (Preview)Bring your own codeA tiny contract — read environment variables — and a worked example to package any component.

Start here

Pick the path that matches what you came to do.

Deploy with the Maize MVPWalk through your first workflowObserve your data in KibanaPackage your own processorUnderstand the architectureLook something up

Community

Questions, bugs and everything around DataCROP.

Contact DataCROPReport an issueDataCROP ForumWebsiteDockerHubOpenHUB stats