Skip to main content

Tech Architecture

Schema Builder and Data Lakehouse Architecture

Pipeline Flow

① JSON-LD Editor (Schema Builder)
• Author schemas with @context, @type, @id
• SPARQL autocompletion against ontology endpoints
• Real-time AJV + JSON-LD 1.1 validation
• Visual diagram (Vue Flow)



② JSON-LD Canonical Layer
• CareLex/eClinical @context namespace
• OWL import/export for SureClinical archives
• Versioned schema catalog/registry



③ Schema Translation Service (Mapper View + Plugins)
• JSON-LD → DDL (PostgreSQL / DuckDB CREATE TABLE)
• JSON-LD → OWL (Nuxeo archive format)
• JSON-LD → JSON Schema (API validation)
• JSON-LD → SQL INSERT (Faker.js seed data)



④ Data Warehouse / Lakehouse + Visualizer
• Tables, views, metrics auto-created from DDL
• Superset datasets auto-registered via CARD /provision
• NL2SQL grounded by compiled schema metadata

Layer Responsibilities

LayerComponentRole
AuthoringSchema Builder (Vue 3)JSON-LD schema creation, editing, validation, and visualization
CanonicalJSON-LD 1.1W3C-standard pivot format — single source of truth
TranslationMapper View + Plugin RegistryConverts JSON-LD nodes into SQL DDL, OWL, JSON Schema, INSERT data
StoragePostgreSQL / DuckDB / IcebergAnalytical warehouse populated from plugin-generated DDL
AIOpenAI-compatible endpointSchema and data authoring via natural language
VisualizationApache SupersetDashboards auto-provisioned via the CARD /provision endpoint

Integration Points

Schema Builder integrates with the rest of the SureCentric platform through three contracts:

OWL / Nuxeo (SureDrive) Schema Builder imports OWL/RDF-XML content models from SureDrive archives via the Spring Boot owlapi-jsonld sidecar service and exports back to OWL for archive deployment.

SQL Warehouse (CARD Pipeline) The Mapper View + plugin pipeline generates CREATE TABLE DDL. The CARD system provisions this DDL into DuckDB/PostgreSQL and registers the resulting tables as Superset datasets automatically.

AI Services (SureLLM) The AI View can be pointed at any OpenAI-compatible endpoint — including SureLLM (the SureCentric private LLM gateway) — by configuring the aiIntegration.endpoint and aiIntegration.model keys in Settings.


Technology Stack

LayerTechnology
FrameworkVue 3 + Vite + TypeScript
UI ComponentsPrimeVue 4 (Lara preset, SureCentric brand #29619B)
JSON-LD processingjsonld.js (W3C JSON-LD 1.1 processor)
JSON Schema validationAJV (Draft 2020-12) + custom JSON-LD multi-error linter
DiagramVue Flow + dagre layout
Code editorAce Editor with gutter annotations
Seed data@faker-js/faker with seeded RNG for reproducibility
Plugin loaderNative ES import() with Blob URL sandboxing
State managementPinia (Vue 3 reactive stores + sessionStorage persistence)
AI gatewayAny OpenAI-compatible endpoint (default model: gpt-4o-mini)
OWL serviceSpring Boot + owlapi-jsonld (OWL/RDF-XML import/export)
CARD APINode.js 20 + Express + TypeScript (port 3099)
DatabasePostgreSQL 17 (CARD profiles) + DuckDB v1.2.1 (analytical warehouse)
VisualizationApache Superset 4.0.0 (dashboards, SQL Lab)
Upstream baseMetaConfigurator v2.2.0 (MIT)
DeploymentDocker Compose (local) · Cloudflare Pages (docs) · Cloudflare Workers (MCP index)