Relativistic Documentation
Relativistic is the fastest way to get a compliant data stack based on open source tools up and running, both locally and on cloud providers, saving hundreds of thousands of dollars in vendor costs.
Relativistic configures open source data tools on a Kubernetes cluster via Terraform. It allows you to deploy over a dozen of the most popular data tools on Kubernetes in under 5 minutes. From dashboarding to ETLs to DAG schedulers to metrics and more, Relativistic has you covered.
Many open source data tools are better than their closed source counterparts. The issue is deploying them in a way that is secure, scalable, maintainable, and compliant. Relativistic comes from the learnings of a data consultancy deploying the same tools to dozens of clients, and how to get running in a day.
Demo
Example - Set up Superset
Prerequisites:
main.tf
provider "kubernetes" {
config_path = "~/.kube/config"
}
provider "helm" {
kubernetes {
config_path = "~/.kube/config"
}
}
module "relativistic" {
source = "kadreio/relativistic/kubernetes"
superset_enabled = true
superset_default_password = "starting_password_to_change"
superset_default_user = "[email protected]"
superset_secret_key = random_string.cookie_key.result
}
resource "random_string" "cookie_key" {
length = 32
special = false
}
command
$ terraform init
$ terraform apply --auto-approve
$ open http://localhost:30086
For other examples, such as minikube, see Installation
Supported Tools
Module |
Description |
Category |
Status |
---|---|---|---|
Argo Workflows |
Container-native workflow engine |
ETL |
Release |
Argo CD |
Declarative GitOps continuous delivery tool |
Operations |
Release |
Apache Superset |
Modern data exploration and visualization platform |
Visualization |
Release |
Airbyte |
Data integration and ETL platform |
ETL |
Beta |
PostgreSQL |
PostgreSQL database for analytics |
Storage |
Beta |
Clickhouse |
Column-oriented database management system |
Storage |
In Development |
Apache Airflow |
Workflow management and scheduling platform |
ETL |
In Development |
Dagster |
Data orchestration platform |
ETL |
In development |
Prometheus / Loki / Grafana |
Monitoring and alerting toolkit |
Monitoring |
In development |
Kubernetes Dashboard |
Web-based Kubernetes user interface |
Operations |
In Development |
Windmill |
Developer platform for building internal tools and workflows |
Operations |
In Development |
Lightdash |
Open-source BI tool for dbt users |
Visualization |
In development |