Skip to main content

Data kinds

A data kind documents what flows through a digital resource: its shape and its schema. Linking resources to data kinds makes workflows self-describing and lets the Kibana integration pick the right dashboard (resources of kind Observation get the Observation dashboard).

Warehouse → Data Kinds: payload shape and cardinality for each kind.
Warehouse → Data Kinds: payload shape and cardinality for each kind.

Fields​

FieldValues
Name, DescriptionFree text
Payload ShapeStructured · Tabular · Text · Binary
CardinalitySingle · Collection · Stream
Schema FormatJSON (JSON Schema) · CSV (columns table) · XML (XSD) · Avro (JSON or IDL)
SchemaThe schema itself. CSV kinds use a columns table (name, type string / number / integer / boolean / date, required).
Telemetry Event: a structured stream with a JSON Schema.
Telemetry Event: a structured stream with a JSON Schema.

Built-in data kinds​

Initialize Resources creates: Observation, Telemetry Event, Asset State, Tabular Records, Generic JSON Payload, XML Document, Avro Record, Document and Binary Blob. Their schemas are listed in Data kinds reference. You can duplicate and adapt them.

tip

The Observation kind must keep its schema: WME's observation pipelines and the Observation dashboard rely on it.