Relativistic Documentation

Relativistic is the fastest way to get a compliant data stack based on open source tools up and running, both locally and on cloud providers, saving hundreds of thousands of dollars in vendor costs.

Relativistic configures open source data tools on a Kubernetes cluster via Terraform. It allows you to deploy over a dozen of the most popular data tools on Kubernetes in under 5 minutes. From dashboarding to ETLs to DAG schedulers to metrics and more, Relativistic has you covered.

Many open source data tools are better than their closed source counterparts. The issue is deploying them in a way that is secure, scalable, maintainable, and compliant. Relativistic comes from the learnings of a data consultancy deploying the same tools to dozens of clients, and how to get running in a day.

Demo

Example - Set up Superset

Prerequisites:

main.tf

provider "kubernetes" {
  config_path = "~/.kube/config"
}

provider "helm" {
  kubernetes {
    config_path = "~/.kube/config"
  }
}

module "relativistic" {
    source = "kadreio/relativistic/kubernetes"
    superset_enabled = true
    superset_default_password = "starting_password_to_change"
    superset_default_user = "[email protected]"
    superset_secret_key = random_string.cookie_key.result
}

resource "random_string" "cookie_key" {
    length  = 32
    special = false
}

command

$ terraform init
$ terraform apply --auto-approve
$ open http://localhost:30086

For other examples, such as minikube, see Installation

Supported Tools

Module

Description

Category

Status

Argo Workflows

Container-native workflow engine

ETL

Release

Argo CD

Declarative GitOps continuous delivery tool

Operations

Release

Apache Superset

Modern data exploration and visualization platform

Visualization

Release

Airbyte

Data integration and ETL platform

ETL

Beta

PostgreSQL

PostgreSQL database for analytics

Storage

Beta

Clickhouse

Column-oriented database management system

Storage

In Development

Apache Airflow

Workflow management and scheduling platform

ETL

In Development

Dagster

Data orchestration platform

ETL

In development

Prometheus / Loki / Grafana

Monitoring and alerting toolkit

Monitoring

In development

Kubernetes Dashboard

Web-based Kubernetes user interface

Operations

In Development

Windmill

Developer platform for building internal tools and workflows

Operations

In Development

Lightdash

Open-source BI tool for dbt users

Visualization

In development