How wis2box works

wis2box is implemented in the spirit of the Twelve-Factor App methodology.

wis2box is a Docker and Python-based platform with the capabilities for centres to publish their data holdings to the WMO Information System with a plug and play capability supporting data publishing, discovery and access.

High level system context

The following diagram provides a high level overview of the main functions of wis2box:

how wis2box works: System context

Core wis2box functionality includes the ability to:

  • integrate your existing data processing pipeline

  • cache station metadata from the OSCAR/Surface station metadata management tool

  • process and transform your weather/climate/water data into official WMO data formats

  • create and publish discovery metadata of your datasets

  • provide your data via OGC and PubSub standards mechanisms to your data, enabling easy access for web applications, desktop GIS tools, mobile applications

  • connect your wis2box to the WIS 2.0 network

  • make your data and services available to market search engines

  • subscribe to and download weather/climate/water data from the WIS 2.0 network

Docker Compose

wis2box is built as Docker Compose application, allowing for easy install and container management.

Container workflow

Let’s dive a little deeper. The following diagram provides a view of all wis2box containers:

how wis2box works: Containers

Container functionality can be described as follows:

  • Storage: core data and metadata persistence, the initial data entry point of wis2box. Data pipelines and workflow are triggered from here

  • Internal Message Broker: internal message bus

  • Public Message Broker: public facing broker. Provides data and metadata notifications

  • Data Management: the epicentre of wis2box. Provides core wis2box administration and data/workflow/publishing utilities

  • API Application: OGC APIs providing geospatial web services

  • Web Application: user interface

Technology

wis2box is built on free and open source (FOSS) technology.

Container

Function

Technology

Standards

Storage

data and metadata storage

MinIO Elasticsearch

S3

Internal Message Broker

PubSub

mosquitto

MQTT

Public Message Broker

PubSub

mosquitto

MQTT

Data Management

data processing and publishing

ecCodes csv2bufr bufr2geojson OWSLib pygeometa pyoscar

WCMP WMDR

API Application

data discovery and access

pygeoapi

OGC API

Web Application

data discovery and visualization

Vue.js Leaflet

OGC API