Main concepts in Langtail
This section explains the main concepts in Langtail. If you are new to LLMs or prompt development, start from this glossary to familiarize yourself with the terminology.
API keys
API Keys used to authenticate to Langtail. Can be generated here or from Deployments tab.
Assertion
To validate the outputs of your language models and prompts, Langtail provides three powerful assertion types: Text, Javascript and LLMs.
Config
A set of different prompt parameters that will be used in the test.
Deploy
Creates a deployment of the selected prompt version.
Deployment
A prompt version that is available on the Langtail API.
Environment
An alias to a deployment. For example, the production API URL stays the same but is served by different deployments over time.
Log
A single execution of a deployment. This allows you to see some metadata, the request to Langtail, the request to the provider, and the response from the provider.
Member
A user in Langtail.
Message
A specific type of template that is only used in the playground and not deployed with the prompt version.
Metric
Aggregated data about activity in the prompt or project.
Model
A LLM model that will be used to run the prompt.
Output
The result of running a single test case. Either Success or Fail.
Parameter
A single setting for the prompt. For example, model or temperature.
Playground
An interface to easily edit and run a prompt. You can add templates, messages, variables, tools, and modify parameters.
Preview deployment
A specific environment called preview.
Production deployment
A specific environment called production.
Project
A collection of prompts. Also contains project-level API keys (shared across prompts) and an aggregated view of metrics and logs (from all prompts).
Prompt
A collection of parameters, templates, messages, variables, and tools. Sent as a single request to the model.
Prompt version
A single version of a prompt which includes everything except for the messages entered in the playground. A user can revert back to a version at any time.
Provider
Company or organization that develops, trains, and offers access to the underlying language model, such as OpenAI (for GPT models), Google (for LaMDA), or Anthropic (for Claude).
Provider key
API key used to authenticate to the provider .
Response
The response from the provider.
Staging
deployment A specific environment called staging.
Template
A text string that is part of a prompt. Valid types are system, assistant, user, function, and tool.
Test
A collection of configs, assertions and test cases. When run, each individual case is compared against every config and assertion and shows an output.
Test case
A user message and/or variable values which are executed with the prompt version that is being tested. When run, it returns an output.
Tool
A single custom function definition. Based on the user message, the provider can invoke this function to get external data or provide extra functionality.
Variable
Text that can be inserted into a template and changed dynamically when run.
Workspace
A collection of projects.
Workspace settings
Settings for a workspace where you can manage members and provider keys.
Was this page helpful?