Creating Data Models

Warehouse Tab

My Workflows

Description: This section displays a list of workflows you have created.

Features:

  • View Workflows: Browse your existing workflows.
  • Create Workflow: Redirects you to the Lab tab for creating a new workflow.

Workflows Image

My Digital Resources

Description: The Digital Resource entity represents the instantiation of a data source within the system.

Purpose: Provides a context and connection interface for accessing and utilizing data.

Key Attributes:

  • dataInterfaceTypeID: Links to the data interface type (e.g., kafka, elasticsearch, API REST).
  • dataKindID: (Optional) Links to the type of data the resource manages.
  • parameterValue: A list of parameter values required by the selected data interface type.

Functionality: Provides reusable, parameterized connection details (for example Kafka topic configuration or Elasticsearch connection details) that processors can reference as workflow inputs/outputs.

DS Image

My Workers

Description: This section allows you to view and create worker assets.

Purpose: Worker assets are responsible for executing processors within workflows.

Features:

  • Define worker specifications.
  • Assign workers to processors for deployment.

Workers Image

My Data Kinds

Description: The Data Kind entity defines the type of data managed in the system.

Purpose: Provides metadata about data structure, format, and type.

Key Attributes:

  • modelType: Specifies the data’s structural type (e.g., simple or complex).
  • format: Indicates the format (e.g., JSON, XML).
  • quantityKind: Defines whether the data is quantitative or qualitative.

Functionality: Facilitates precise processing and analysis of data.

Datakind Image