Launchpad
After identifying the most suitable model through experiments in the Lab, use the Launchpad to prepare your model for integration.
The Launchpad combines settings from Params and Repositories to bring you one last step to tweak your models before integrating them. You can always come back and launch any updates you make to your model at any time, allowing for easy model switching in your application.
The Launchpad allows you to easily launch and integrate your customized models into your projects using the SDKs. It provides a streamlined and intuitive interface for selecting and deploying models, making it simple to incorporate powerful AI capabilities into your applications.
Launching a Model
You can also access the Launchpad for a specific model you were testing in the Lab by clicking the more options icon next to the model of your choice. Your Params and Repositories will follow.
Model Selection
In the Launchpad, you will see a list of available models. Browse through the models and select the one that best suits your requirements.
Model Configuration
Specify any required parameters or options specific to the chosen model.
Customize the model’s behavior according to your needs with the following settings:
-
TemperatureThis parameter in language models affects the creativity or diversity of the generated text. You can set the randomness level (0 to 1). Higher values increase randomness, and the results will be more creative, with the model generating more diverse output. Lower values result in more focused and deterministic output (great for working with repositories). -
Max TokensLimit for generated tokens in a chat, constrained by the model’s context length (value 0 means no limit). -
System PromptThe system prompt sets the initial context and direction for the model’s responses. It should be carefully selected to align with the specific topic and desired style of the conversation. -
LimitSets the maximum number of top-matching documents to retrieve based on similarity. -
SimilarityMeasures how closely a query matches document embeddings. Higher values indicate greater similarity, ranging from 0 to 1.
Launching the Model
Once you have configured the model, click on the “Launch” button. The Launchpad will initiate the model launching process, which may take a few moments depending on the model’s size and complexity.
Integrate with the SDK
Now that your model is launched with its latest changes, you can easily integrate it into your application with the SDK.
Check out the SDK Guide here.