LogoLogo
HomeBlogGitHub
latest
latest
  • New DOCS
  • What is Evidently?
  • Get Started
    • Evidently Cloud
      • Quickstart - LLM tracing
      • Quickstart - LLM evaluations
      • Quickstart - Data and ML checks
      • Quickstart - No-code evaluations
    • Evidently OSS
      • OSS Quickstart - LLM evals
      • OSS Quickstart - Data and ML monitoring
  • Presets
    • All Presets
    • Data Drift
    • Data Quality
    • Target Drift
    • Regression Performance
    • Classification Performance
    • NoTargetPerformance
    • Text Evals
    • Recommender System
  • Tutorials and Examples
    • All Tutorials
    • Tutorial - Tracing
    • Tutorial - Reports and Tests
    • Tutorial - Data & ML Monitoring
    • Tutorial - LLM Evaluation
    • Self-host ML Monitoring
    • LLM as a judge
    • LLM Regression Testing
  • Setup
    • Installation
    • Evidently Cloud
    • Self-hosting
  • User Guide
    • 📂Projects
      • Projects overview
      • Manage Projects
    • 📶Tracing
      • Tracing overview
      • Set up tracing
    • 🔢Input data
      • Input data overview
      • Column mapping
      • Data for Classification
      • Data for Recommendations
      • Load data to pandas
    • 🚦Tests and Reports
      • Reports and Tests Overview
      • Get a Report
      • Run a Test Suite
      • Evaluate Text Data
      • Output formats
      • Generate multiple Tests or Metrics
      • Run Evidently on Spark
    • 📊Evaluations
      • Evaluations overview
      • Generate snapshots
      • Run no code evals
    • 🔎Monitoring
      • Monitoring overview
      • Batch monitoring
      • Collector service
      • Scheduled evaluations
      • Send alerts
    • 📈Dashboard
      • Dashboard overview
      • Pre-built Tabs
      • Panel types
      • Adding Panels
    • 📚Datasets
      • Datasets overview
      • Work with Datasets
    • 🛠️Customization
      • Data drift parameters
      • Embeddings drift parameters
      • Feature importance in data drift
      • Text evals with LLM-as-judge
      • Text evals with HuggingFace
      • Add a custom text descriptor
      • Add a custom drift method
      • Add a custom Metric or Test
      • Customize JSON output
      • Show raw data in Reports
      • Add text comments to Reports
      • Change color schema
    • How-to guides
  • Reference
    • All tests
    • All metrics
      • Ranking metrics
    • Data drift algorithm
    • API Reference
      • evidently.calculations
        • evidently.calculations.stattests
      • evidently.metrics
        • evidently.metrics.classification_performance
        • evidently.metrics.data_drift
        • evidently.metrics.data_integrity
        • evidently.metrics.data_quality
        • evidently.metrics.regression_performance
      • evidently.metric_preset
      • evidently.options
      • evidently.pipeline
      • evidently.renderers
      • evidently.report
      • evidently.suite
      • evidently.test_preset
      • evidently.test_suite
      • evidently.tests
      • evidently.utils
  • Integrations
    • Integrations
      • Evidently integrations
      • Notebook environments
      • Evidently and Airflow
      • Evidently and MLflow
      • Evidently and DVCLive
      • Evidently and Metaflow
  • SUPPORT
    • Migration
    • Contact
    • F.A.Q.
    • Telemetry
    • Changelog
  • GitHub Page
  • Website
Powered by GitBook
On this page
  • 1. Create a Workspace
  • Local Workspace
  • Remote Workspace
  • Remote snapshot storage
  • [DANGER] Delete Workspace
  • 2. Launch the UI service
  1. Setup

Self-hosting

How to self-host the open-source Evidently UI service.

PreviousEvidently CloudNextProjects

Last updated 2 months ago

You are looking at the old Evidently documentation: this API is available with versions 0.6.7 or lower. Check the newer version .

In addition to using Evidently Python library, you can self-host the UI Service to get a monitoring Dashboard and organize the results of your evaluations. This is optional: you can also run evaluations and render results directly in Python or export them elsewhere.

Evidently Cloud. Sign up for a free account to get a managed version with extra features.

Evidently Enterprise. This page explains how to self-host the open-source platform. For the Enterprise version with extra features and support, . Host it in your cloud or on-premises.

To get a self-hostable Dashboard, you must:

  1. Create a Workspace (local or remote) to store your data.

  2. Launch the UI service.

1. Create a Workspace

Once you , you will need to create a workspace. This designates a remote or local directory where you will store the evaluation results (as JSON snapshots of the Evidently Reports or Test Suites). The UI Service will read the data from this source.

There are three scenarios, based on where you run the UI Service and store data.

  • Local Workspace. Both the UI Service and data storage are local.

  • Remote Workspace. Both the UI Service and data storage are remote.

  • Workspace with remote data storage. You run the UI Service and store data on different servers.

Local Workspace

In this scenario, you generate, store the snapshots and run the monitoring UI on the same machine.

Imports:

from evidently.ui.workspace import Workspace
from evidently.ui.workspace import WorkspaceBase

To create a local Workspace and assign a name:

ws = Workspace.create("evidently_ui_workspace")

You can pass a path parameter to specify the path to a local directory.

Remote Workspace

In this scenario, you send the snapshots to a remote server. You must run the Monitoring UI on the same remote server. It will directly interface with the filesystem where the snapshots are stored.

Imports:

from evidently.ui.remote import RemoteWorkspace
from evidently.ui.workspace import Workspace
from evidently.ui.workspace import WorkspaceBase

To create a remote Workspace (UI should be running at this address):

workspace = RemoteWorkspace("http://localhost:8000")

You can pass the following parameters:

Parameter
Description

self.base_url = base_url

URL for the remote UI service.

self.secret = secret

String with secret, None by default. Use it if access to the URL is protected by a password.

Remote snapshot storage

In the examples above, you store the snapshots and run the UI on the same server. Alternatively, you can store snapshots in a remote data store (such as an S3 bucket). The Monitoring UI service will interface with the designated data store to read the snapshot data.

To connect to data stores Evidently uses fsspec that allows accessing data on remote file systems via a standard Python interface.

For example, to read snapshots from an S3 bucket (with MinIO running on localhost:9000), you must specify environment variables:

FSSPEC_S3_ENDPOINT_URL=http://localhost:9000/
FSSPEC_S3_KEY=my_key FSSPEC_S3_SECRET=my_secret
evidently ui --workspace s3://my_bucket/workspace

[DANGER] Delete Workspace

To delete a Workspace (for example, an empty or a test Workspace), run the command from the Terminal:

cd src/evidently/ui/
rm -r workspace

You are deleting all the data. This command will delete the snapshots stored in the folder. To maintain access to the generated snapshots, you must store them elsewhere.

2. Launch the UI service

To launch the Evidently UI service, you must run a command in the Terminal.

Option 1. If you log snapshots to a local Workspace directory, you run Evidently UI over it. Run the following command from the directory where the Workspace folder is located.

evidently ui

Option 2. If you have your Project in a different Workspace, specify the path:

evidently ui --workspace . /workspace

Option 3. If you have your Project in a specified Workspace and run the UI service at the specific port (if the default port 8000 is occupied).

evidently ui --workspace ./workspace --port 8080

To view the Evidently interface, go to URL http://localhost:8000 or a specified port in your web browser.

Code example. shows a complete Python script to create and populate a local Workspace.

Code example. See the .

You can verify supported data stores in the Fsspec documentation: and .

here
Evidently Cloud
contact us
install Evidently
Self-hosting tutorial
remote service example
built-in implementations
other implementations