CaraML Docs
CaraML Homepage
  • Introduction
    • What is CaraML?
    • Architecture
      • Feature Store Architecture
      • Models Architecture
      • Routers Architecture
      • Experiments Architecture
      • Pipelines Architecture
    • Core Concepts
      • Models Concepts
      • Router Concepts
      • Experiment Concepts
  • User guides
    • Projects
      • Create a project
      • Managing secrets
    • Feature Store
    • Models
      • Create a Model
        • Custom Model
      • Deploy a Model
        • Deploying a Model Version
        • Severing a Model Version
        • Configuring Transformer
          • Standard Transformer
            • Standard Transformer Expressions
            • Standard Transformer UPI
          • Custom Transformer
        • Redeploying a Model Version
      • Deleting a Model
      • Configuring Alerts
      • Batch Prediction
      • Model Schema
      • Model Observability
    • Routers
      • Creating a Router
        • Configure general settings
        • Configure routes
        • Configure traffic rules
        • Configure autoscaling
        • Configure experiment engine
        • Configure enricher
        • Configure ensembler
        • Configure logging
      • Viewing Routers
        • Configuration
        • History
        • Logs
        • More actions
      • Edit Routers
      • Monitoring router
        • Monitor Router Performance
        • Configure Alerts
      • Undeploying Router
      • Redeploying Router
        • Redeploy undeployed router
        • Redeploy version from history
        • Redeploy version from version details page
      • Deleting Router
        • Deleting router versions
        • Deleting router versions from details page
        • Deleting routers
      • Deleting Emsemblers
        • Delete an Ensembler without related entity
        • Delete an Ensembler with active entities
        • Delete an Ensembler with inactive entities
    • Experiments
      • View Experiment Settings
      • Modify Experiment Settings
      • Creating Experiments
      • Viewing Experiments
      • Modifying Experiments
      • Running Experiments
      • Monitoring Experiments
      • Creating Treatments
      • Viewing Treatments
      • Modifying Treatments
      • Creating Segments
      • Viewing Segments
      • Modifying Segments
      • Creating Custom Segmenters
      • Viewing Custom Segmenters
      • Modifying Custom Segmenters
    • Pipelines
  • Tutorial and Examples
    • Model Sample Notebooks
      • Deploy Standard Models
      • Deploy PyFunc Model
      • Using Transformers
      • Run Batch Prediction Job
      • Others examples on Models
    • Router Examples
    • Feature Store Examples
    • Pipeline Examples
    • Performing load test in CaraML
    • Best practice for CaraML
  • CaraML SDK
    • Feature Store SDK
    • Models SDK
    • Routers SDK
    • Pipeline SDK
  • Troubleshooting and FAQs
    • CaraML System FAQ
    • Models FAQ
      • System Limitations
      • Troubleshooting Deployment Errors
      • E2E Test
    • Routers FAQ
    • Experiments FAQ
    • Feature Store FAQ
    • Pipelines FAQ
    • CaraML Error Messages
  • Deployment Guide
    • Deploying CaraML
      • Local Development
    • Monitoring and alerting
      • Configure a monitoring backend
      • Configure an alerting backend
    • Prerequisites and Dependencies
    • System Benchmark results
    • Experiment Treatment Service
  • Release Notes
    • CaraML Release Notes
Powered by GitBook
On this page
  1. User guides

Experiments

PreviousDelete an Ensembler with inactive entitiesNextView Experiment Settings

Last updated 2 years ago

Onboarding Process

For access to XP, users can self-onboard via the MLP UI.

  1. Visit MLP Landing Page, open the sidebar and click Experiments.

  2. You should see the following Landing page, if you have yet to setup the project for Experiments.

  3. Upon clicking 'here' in the previous page, you should see a form to input the necessary settings.

  4. Enter a name for the Randomization Key and select the Segmenters.

    • The order of the segmenters determines the priority of the segmenters when optional segmenters are used. For example, if the chosen segmenters are s2_ids, and days_of_week (in that order) and a given request matches 2 experiments - one where the s2_ids is optional and another one where the days_of_week is optional, the s2_ids experiment (where there is an exact match of the s2_ids) will be chosen. For more information and examples, please refer to the section in the Introduction page.

    • Where the segmenter may be computed from several different (groups of) variables at runtime, also select the desired variable mapping. For example, s2_ids may be supplied as s2_id or computed from latitude,longitude. This must be specified in the settings.

  5. Click on Save. And voila! The onboarding is complete and you should see the configured settings. The project credentials (in particular, the passkey) would be required for running experiments ( takes care of this if you are running the experiments through its routers).

Turing
MLP Landing Turing Experiments
Experiments Landing
Experiments Settings Create Form
Experiments Settings Details
Experiment Hierarchy