Target platform

TL;DR

The platform maps Keycloak groups to managed Kubernetes namespaces and uses each namespace as the shared home for a group’s services and workloads. The platform team builds and maintains the access rules, workload identities, network controls, resource limits, approved configurations, monitoring, and cleanup attached to each namespace. New packs and services can use this common platform design instead of creating a separate security and operations model each time. Based on the same group-to-tenant mapping, the platform gives each service a dedicated Kubernetes identity and project-scoped AWS IAM role. EKS Pod Identity, STS, S3 policies, and KMS then enforce what that service can access.

Identity + authorization plane
PeopleUsersBrowser clients
Identity providerKeycloakOIDC login · full group paths
Data authorizationGeneric data catalogMetadata · grants · durable references
ATEP Kubernetes cluster
checkmaite-packUI + API
Web UIRayJob submitterStatus · cancel

OIDC authentication · project authorization · audited submissions

data-science-packJupyterHub + JupyterLab
User notebookTenant ServiceAccountRay client

Direct tenant execution: the notebook can launch and connect to its own RayCluster.

Extensible platformOther NIC packs
ServicesAPIsWorkflows

Reuse tenant identity, policy, compute, and S3.

Cluster control + orchestrationKubernetes API
KubeRay operatorArgo Workflows
Shared team boundary · not a per-user namespaceGroup A namespaceRBAC · quota · admission · NetworkPolicy
Notebook path · separate data planesInteractive RayClusters
AliceBob
One on demand per active user/session
UI pathRayJob + RayClusterOne ephemeral cluster per run
Serving pathRayServiceOne per group
runner ServiceAccountserving ServiceAccounttokenless by default
Repeated boundaryGroup BSeparate namespace

Its own clusters, RayService, identities, quota, and data grants.

AWS data planeEKS Pod Identity → IAM rolesNo static credentials
API result readerNotebook · Group ARunner / workflow · Group AServing · Group ANIC pack service roles
Durable Kubernetes workload storageS3Datasets · models · run inputs · resultsArgo artifacts · group-separated prefixes
IdentityControl and submissionData and AWS identity

On a small screen, swipe the diagram horizontally.

7platform capabilities
22delivery tasks
3Ray lifecycles

Organize delivery around shared capabilities, then let notebooks, the UI, serving, and future services consume them.

22 items shown