Introduction

Download this manual as a PDF file

This section describes how to collect and analyze metrics from vector Language Learning Model (vLLM ) deployments in Skylar One using the Dynamic Applications in the "vLLM Monitoring" PowerPack.

What Does the vLLM Monitoring PowerPack Monitor?

To monitor vLLM deployments using Skylar One, you can install the "vLLM Monitoring" PowerPack. This PowerPack enables you to align Dynamic Applications to vLLM deployments to collect data.

The "vLLM Monitoring" PowerPack includes:

  • Dynamic Applications that discover and collect data from vLLM.

Installing the vLLM Monitoring PowerPack

Before completing the steps in this section, you must import and install the latest version of the "vLLM Monitoring" PowerPack.

By default, installing a new version of a PowerPack overwrites all content from a previous version of that PowerPack that has already been installed on the target system. You can use the Enable Selective PowerPack Field Protection setting in the Behavior Settings page (System > Settings > Behavior) to prevent new PowerPacks from overwriting local changes for some commonly customized fields. For more information, see the section on Global Settings.

For details on upgrading Skylar One, see the relevant Skylar One Platform Release Notes.

To download and install the PowerPack:

  1. Search for and download the PowerPack from the PowerPacks page at the ScienceLogic Support Center (Skylar One > PowerPacks, login required).
  2. In Skylar One, go to the PowerPacks page (System > Manage > PowerPacks).
  3. Click the Actions button and choose Import PowerPack. The Import PowerPack dialog box appears.
  4. Click [Browse] and navigate to the PowerPack file from step 1.
  5. Select the PowerPack file and click Import. The PowerPack Installer modal displays a list of the PowerPack contents.
  6. Click Install. The PowerPack is added to the PowerPacks page.

If you exit the PowerPack Installer modal without installing the imported PowerPack, the imported PowerPack will not appear in the PowerPacks page. However, the imported PowerPack will appear in the Imported PowerPacks modal. This page appears when you click the Actions menu and select Install PowerPack.