Introduction

Download this manual as a PDF file

This section describes how to collect and analyze metrics from vector Language Learning Model (vLLM ) deployments in SL1 using the Dynamic Applications in the "vLLM Monitoring" PowerPack.

The following sections provide an overview of vLLM and the "vLLM Monitoring" PowerPack:

What Does the vLLM Monitoring PowerPack Monitor?

To monitor vLLM deployments using SL1, you can install the vLLM MonitoringPowerPack. This PowerPack enables you to align Dynamic Applications to vLLM deployments to collect data.

The vLLM MonitoringPowerPack includes:

  • Dynamic Applications that discover and collect data from vLLM.

Installing the vLLM Monitoring PowerPack

Before completing the steps in this section, you must import and install the latest version of the vLLM Monitoring PowerPack.

By default, installing a new version of a PowerPack overwrites all content from a previous version of that PowerPack that has already been installed on the target system. You can use the Enable Selective PowerPack Field Protection setting in the Behavior Settings page (System > Settings > Behavior) to prevent new PowerPacks from overwriting local changes for some commonly customized fields. For more information, see the section on Global Settings.

For details on upgrading SL1, see the relevant SL1 Platform Release Notes.

To download and install the PowerPack:

  1. Search for and download the PowerPack from the PowerPacks page (Product Downloads > PowerPacksSyncPacks) at the ScienceLogic Support Site.
  2. In SL1, go to the PowerPacks page (System > Manage > PowerPacks).
  3. Click the Actions button and choose Import PowerPack. The Import PowerPack dialog box appears.
  4. Click [Browse] and navigate to the PowerPack file from step 1.
  5. Select the PowerPack file and click Import. The PowerPack Installer modal displays a list of the PowerPack contents.
  6. Click Install. The PowerPack is added to the PowerPacks page.

If you exit the PowerPack Installer modal without installing the imported PowerPack, the imported PowerPack will not appear in the PowerPacks page. However, the imported PowerPack will appear in the Imported PowerPacks modal. This page appears when you click the Actions menu and select Install PowerPack.