Introduction

Download this manual as a PDF file

This section describes how to collect and analyze metrics from vector Language Learning Model (vLLM ) deployments in Skylar One using the Dynamic Applications in the "vLLM Monitoring" PowerPack.

What Does the vLLM Monitoring PowerPack Monitor?

To monitor vLLM deployments using Skylar One, you can install the "vLLM Monitoring" PowerPack. This PowerPack enables you to align Dynamic Applications to vLLM deployments to collect data.

The "vLLM Monitoring" PowerPack includes:

  • Dynamic Applications that discover and collect data from vLLM.

Installing the vLLM Monitoring PowerPack

Before completing the steps in this section, you must import and install the latest version of the "vLLM Monitoring" PowerPack.

By default, when you install a new version of a PowerPack, it overwrites all content from that PowerPack that is already installed on the target system. You can use the Enable Selective PowerPack Field Protection setting on the Behavior Settings page (System > Settings > Behavior) to prevent the new version of the PowerPack from overwriting local changes for some commonly customized fields.

For details on upgrading Skylar One, see the relevant Skylar One Platform Release Notes.

To download and install the PowerPack:

  1. Search for and download the PowerPack from the PowerPacks page at the ScienceLogic Support Center (Skylar One > PowerPacks, login required).
  2. In Skylar One, go to the PowerPacks page (System > Manage > PowerPacks).
  3. Click the Actions menu and select Import PowerPack. The Import PowerPack modal appears.
  4. Click Browse and go to the PowerPack file from step 1.
  5. Select the PowerPack file and click Import. The PowerPack Installer modal displays a list of the PowerPack contents.
  6. Click Install. The PowerPack appears on the PowerPacks page.

If you exit the PowerPack Installer modal without installing the imported PowerPack, the imported PowerPack does not appear on the PowerPacks page. However, the imported PowerPack appears in the Imported PowerPacks modal. This modal appears when you click the Actions menu and select Install PowerPack.