Concurrent PowerShell Collection

Download this manual as a PDF file

The following sections describe how to configure and use concurrent PowerShell collection. Concurrent PowerShell collection allows multiple collection tasks to run at the same time with a reduced load on Data Collectors. Concurrent PowerShell collection also prevents missed polls and data gaps because collection will execute more quickly. As a result, Data Collectors can collect more data using fewer system resources. The PowerShell Collector is an independent service running as a container on a Data Collector.

Use the following menu options to navigate the Skylar One user interface:

  • To view a pop-out list of menu options, click the menu icon ().
  • To view a page containing all of the menu options, click the Advanced menu icon ().

Prerequisites

The following prerequisites are required to use concurrent PowerShell collection:

  • Skylar One version 10.1.4 or greater
  • "Microsoft: Windows Server" PowerPack version 110 or greater
  • " Skylar One: Concurrent PowerShell Monitoring" PowerPack version 100 or greater (for Skylar One versions prior to 11.3.0).

As of Skylar One (SL1) version 11.3.0, the "Skylar One: Concurrent PowerShell Monitoring" PowerPack is no longer a requirement for concurrent PowerShell monitoring.

Scope

When the concurrent PowerShell collection service is enabled, PowerShell Configuration and PowerShell Performance Dynamic Applications are sent to the service.

The following PowerPacks can use the concurrent PowerShell collection service:

  • Microsoft: Active Directory Server
  • Microsoft: DHCP Server
  • Microsoft: DNS Server
  • Microsoft: Exchange Server
  • Microsoft: IIS Server
  • Microsoft: Lync Server 2013
  • Microsoft: SharePoint Server
  • Microsoft: SQL Server
  • Microsoft: Hyper-V Server (partially)
  • Microsoft: Windows Server (partially)

Enabling and Disabling Concurrent PowerShell for Collector Groups

To improve the process of collecting data via PowerShell and to collect metrics, you can enable concurrent PowerShell collection. You can enable one or more collector groups to use concurrent PowerShell collection.

If you have enabled concurrent collection and you have used it to discover a very large number of devices or interfaces, disabling concurrent collection could have unintended consequences. After disabling concurrent collection, your Data Collector might become overburdened when it attempts to collect data for the same number of devices or interfaces but without the added processing capacity of concurrent collection.

By default, a loopback to 127.0.0.1 is configured on the collector with the line localhost localhost.localdomain localhost4 localhost4.localdomain4 in the /etc/hosts file. If this line is removed, concurrent PowerShell collection will not function properly.

NOTE: Concurrent PowerShell collection is for PowerShell Performance and Performance Configuration Dynamic Application types and does not include Snippet Dynamic Applications which happen to run PowerShell commands.

Enabling and Disabling Concurrent PowerShell on All Collector Groups

Enabling and Disabling Concurrent PowerShell on a Specific Collector Group

The Skylar One: Concurrent PowerShell Monitoring PowerPack

The "Skylar One: Concurrent PowerShell Monitoring" PowerPack includes a device template, two Dynamic Applications that use SSH to monitor collectors with concurrent PowerShell enabled, and a number of event policies.

  • The "ScienceLogic: PowerShell Collector Performance" Dynamic Application is an optional Dynamic Application used for troubleshooting.
  • The "ScienceLogic: PowerShell Service Log Parser" Dynamic Application parses the log file from the PowerShell servers and converts errors into events aligned to the related device.
  • The "Skylar One: Concurrent PowerShell Monitoring" device template can be used to align multiple Data Collectors to the "ScienceLogic: PowerShell Service Log Parser" Dynamic Application.
  • Event policies and corresponding alerts that are triggered when devices meet certain status criteria.

Aligning the "ScienceLogic: PowerShell Service Log Parser" Dynamic Application

To align the "ScienceLogic: PowerShell Service Log Parser" Dynamic Application, first you must create an SSH/Key credential:

  1. Go to the Credential Management page (System > Manage > Credentials).
  2. In the Credential Management page, click the Actions menu. Select Create SSH/Key Credential.
  3. The Credential Editor modal page appears. In this page, define the new SSH/Key credential using a valid username and password or SSH key for Skylar One collectors:
  • Credential Name. Name of the credential. Can be any combination of alphanumeric characters.
  • Hostname/IP. Hostname or IP address of the device from which you want to retrieve data.
  • You can include the variable %D in this field. Skylar One will replace the variable with the IP address of the current device (device that is currently using the credential).

  • You can include the variable %N in this field. Skylar One will replace the variable with hostname of the current device (device that is currently using the credential). If Skylar One cannot determine the hostname, Skylar One will replace the variable with the primary, management IP address for the current device.

  • Port. Port number associated with the data you want to retrieve.

The default TCP port for SSH servers is 22.

  • Timeout (ms). Time, in milliseconds, after which Skylar One will stop trying to communicate with the authenticating server.
  • Username. Username for the Data Collector to be monitored.
  • Password. Password for the Data Collector to be monitored.
  • Private Key (PEM Format). Enter an SSH private key for the Skylar One Data Collector, in PEM format.
  • Click the Save button to save the new SSH/Key credential.

Next, you can align the Dynamic Application manually or configure the device template. Using the device template is recommended when you want to align the Dynamic Application to multiple Data Collectors.

Manually Aligning the Dynamic Application

After creating the SSH/Key credential, you will manually align the Dynamic Application.

  • Go to the Devices page and find the device you want to manually align the Dynamic Application to. Click on it to go to the Device Investigator.
  • In the Device Investigator, click the Collections tab. Click Edit and then click Align Dynamic App. The Align Dynamic Application window appears.
  • Click Choose Dynamic Application. The Choose Dynamic Application window appears.
  • Select the "ScienceLogic: PowerShell Service Log Parser" Dynamic Application and click Select. The "ScienceLogic: PowerShell Service Log Parser" Dynamic Application appears in the Align Dynamic Application window.
  • If a default credential is listed below the Dynamic Application and you want to use that credential, skip ahead to step 8. Otherwise, uncheck the box next to the credential name.
  • Click Choose Credential. The Choose Credential window appears.
  • Select the credential for the Dynamic Application and click the Select button. The name of the selected credential appears in the Align Dynamic Application window.
  • Click the Align Dynamic App button. When the Dynamic Application is successfully aligned, it is added to the Collections tab, and a confirmation message appears at the bottom of the tab.

To manually align the Dynamic Application using the Skylar One classic user interface:

  • Go to the Device Manager page (Devices > Classic Devices, or Registry > Devices > Device Manager in the classic user interface)
  • In the Device Manager page, find the device for which you want to view Dynamic Applications. Select its wrench icon ()
  • In the Device Administration panel, select the Collections tab.
  • Click the Actions button and then select Add Dynamic Application. The Dynamic Application Alignment page appears
  • In the Dynamic Applications field, select the "ScienceLogic: PowerShell Service Log Parser" Dynamic Application.
  • In the Credentials field, select the proper credential.
  • Click the Save button.

Configuring the Device Template

After creating the SSH/Key credential, you will need to configure the device template included in the PowerPack.

NOTE: If you have already manually aligned the Dynamic Application, you do not need to perform the steps in this section.

To configure the device template:

  1. Go to the Configuration Templates page (Devices > Templates, or Registry > Devices > Templates in the classic user interface).
  2. Locate the "Skylar One: Concurrent PowerShell Monitoring" sample template and click its wrench icon (). The Device Template Editor modal page appears.
  3. Type a new name for the device template in the Template Name field so the sample template is not overwritten.
  4. Click the Dyn Apps tab. The Editing Dynamic Application Subtemplates page appears.
  1. In the Subtemplate Selection pane, select the "ScienceLogic: PowerShell Service Log Parser" Dynamic Application.
  2. In the Credentials drop-down list, select the SSH/Key credential that you created.
  3. Click Save As.

Applying the Device Template

If your Data Collector devices already exist on your Skylar One system, perform the following steps to apply the device template:

  1. Go to the Device Manager page (Devices > Classic Devices, or Registry > Devices > Device Manager in the classic user interface) and select the checkbox for each of your Data Collector devices.
  2. In the Select Action menu, select MODIFY By Template and then click Go.
  3. In the Device Template Editor, select the template you created in the Template field.
  4. Click Apply.

If your devices have not yet been discovered, perform the following steps to discover the devices and apply the device template:

  1. Go to the Discovery Control Panel page (System > Manage > Classic Discovery) and click Create.
  2. Supply values in the following fields:
  • Name. Type a name for the discovery session.
  • Description. Optionally, type a description of the discovery session.
  • IP Address/Hostname Discovery List. Provide a list of IP addresses for your Data Collectors.
  • SNMP Credentials. Select EM7 Default V2.
  • Model Devices. Select this checkbox.
  • Apply Device Template. Select the device template that you created.
  • Log All. Select this checkbox.
  1. Click the Save button to save the discovery session. Close the Discovery Session Editor page.
  2. In the Discovery Control Panel page, click the Reset button. The new discovery session will appear in the Session Register pane.
  3. To launch the new discovery session, click its Queue this Session icon ().
  4. If no other discovery sessions are currently running, the session will be executed immediately. If another discovery session is currently running, your discovery session will be queued for execution.

Aligning the "ScienceLogic: PowerShell Collector Performance" Dynamic Application

If you want to monitor your Data Collectors with the "ScienceLogic: PowerShell Collector Performance" Dynamic Application, you must manually align it to your Data Collectors using the SSH/Key credential. To do this:

  • Go to the Devices page and find the device you want to manually align the Dynamic Application to and click on it to go to the Device Investigator.
  • In the Device Investigator, click the Collections tab. Click Edit and then click Align Dynamic App. The Align Dynamic Application window appears.
  • Click Choose Dynamic Application. The Choose Dynamic Application window appears.
  • Select the "ScienceLogic: PowerShell Collector Performance" Dynamic Application and click Select. The "ScienceLogic: PowerShell Collector Performance" Dynamic Application appears in the Align Dynamic Application window.
  • If a default credential is listed below the Dynamic Application and you want to use that credential, skip ahead to step 8. Otherwise, uncheck the box next to the credential name.
  • Click Choose Credential. The Choose Credential window appears.
  • Select the credential for the Dynamic Application and click the Select button. The name of the selected credential appears in the Align Dynamic Application window.
  • Click the Align Dynamic App button. When the Dynamic Application is successfully aligned, it is added to the Collections tab, and a confirmation message appears at the bottom of the tab.

To manually align the Dynamic Application using the Skylar One classic user interface:

  • Go to the Device Manager page (Devices > Classic Devices, or Registry > Devices > Device Manager in the classic user interface)
  • In the Device Manager page, find the device for which you want to view Dynamic Applications. Select its wrench icon ()
  • In the Device Administration panel, select the Collections tab.
  • Click the Actions button and then select Add Dynamic Application. The Dynamic Application Alignment page appears
  • In the Dynamic Applications field, select the "ScienceLogic: PowerShell Collector Performance" Dynamic Application.
  • In the Credentials field, select the proper credential.
  • Click the Save button.

Enabling HTTPS Between Skylar One and the PowerShell Data Collector

Enabling and Disabling the Python PowerShell Remoting Protocol Client

If you have concurrent PowerShell enabled in Skylar One, the default Python module used for transport to monitor Windows Devices is "pyWinRm". However, the "pypsrp" Python module can provide more efficient processing of PowerShell commands, particularly when virus detection software is enabled. To use the "pypsrp" module instead, run the following SQL query on the Database Tool page (System > Tools > DB Tool):

  1. Select your database from the Select Database list.
  2. Enter the following in the SQL Query field.

INSERT master.system_custom_config (field, field_value) VALUES ('enable_pypsrp_lib', 1)

 

A value of 1 will enable the "pypsrp" module. A value of 0 (or not having any setting for 'enable_pypsrp_lib') will revert to using "pyWinRM".

  1. Click Go.

To disable "pypsrp", use the following SQL query:

UPDATE master.system_custom_config set field_value = 0 WHERE field = 'enable_pypsrp_lib'

Currently, you can only use the "pypsrp" module with concurrent PowerShell. Classic PowerShell monitoring will continue to use the "pyWinRM" module regardless of this database setting.

Optional PowerShell CLI Parameters

Users with Windows 2008 R2 Servers

Concurrent PowerShell collection will not work for Windows 2008 R2 servers when the Encyrpted field is set to Yes in the PowerShell credential. Windows 2008 R2 servers are no longer covered by Microsoft's Extended Support, but if you are still using those servers you have the following options:

  • Use PowerShell credentials the have Encryption set to No.
  • Disable the Concurrent PowerShell service on the Data Collector groups that include Windows 2008 R2 servers. This will reduce the number of servers that Data Collector group can support.
  • Use the Microsoft Base Pack (WMI-based) PowerPack for the Windows 2008 R2 servers.
  • Use SNMP for the Windows 2008 R2 servers.

Scale Recommendations

The following recommendations increase the number of Windows Servers the concurrent PowerShell collector can support:

  • In the Device Properties page for all Windows Server devices (Devices > Classic Devices > wrench icon), unselect the Dynamic Discovery checkbox. Alternatively, this can be set in bulk using a device template and device group. This prevents nightly discovery from attempting to align Dynamic Applications with a discovery object to all the devices on the collector, which does not use the concurrent PowerShell collector and will dramatically limit the number of Windows Server devices that can be monitored.
  • Do not select any credentials in the discovery session used to discover new Windows Servers. Instead, use a template that includes unselecting the Dynamic Discovery checkbox and includes the desired Dynamic Applications with the appropriate credential aligned. When a credential is selected in the Discovery Session, it will attempt to align Dynamic Applications that include a discovery object, which does not use the concurrent PowerShell collector and will dramatically limit the number of Windows Server devices that can be monitored. The Microsoft: Windows Server PowerPack includes the "Microsoft: Windows Server Discovery Template" that you can use be used to create your template.

For information on creating and using device templates, see the Device Groups and Device Templates section.

Additional Scale Tips

  • Limit the use of the "Microsoft: Windows Server Services" PowerPack, as using this Dynamic Application can reduce the number of servers a collector can support by 40%. If you do use this PowerPack, consider slowing down the Poll Frequency of the "Microsoft: Windows Server Services" Dynamic Application.
  • Limit the use of the "Microsoft: Windows Server Event Logs" PowerPack as it does not work with the concurrent PowerShell collector.
  • Use the Microsoft: SQL Server PowerPack instead of the Microsoft: SQL Server Enhanced PowerPack. The Microsoft: SQL Server Enhanced PowerPack does not work with the concurrent PowerShell collector.
  • Disable Dynamic Applications that are not providing information required to meet your Service Level Agreements. There is an enhancement in caching included with concurrent PowerShell collection that will not send a PowerShell request from a cache-producing Dynamic Application unless at least one Dynamic Application is asking for that data. Disabling a cache-consuming Dynamic Application will also disable the cache producer from collecting that data. For example, the following Dynamic Applications are now disabled by default, as they are more diagnostic in nature and may not be required for routine monitoring:
  • Microsoft: Windows Server IPStats Performance
  • Microsoft: Windows Server TCPStats Performance
  • Microsoft: Windows Server UDPStats Performance
  • Slow down the Poll Frequency for Dynamic Applications that do not include events. For example, the Microsoft: Windows Server PowerPack's Configuration Dynamic Applications used to be set to run every two hours and are now set to run every 12 hours.