Data Collector Log Files
Before resorting to examining Data Collector logs, use the following System Administration reports to check collection status:
• Collection Message Summary
• Data Collection Schedule Summary
• Data Collector Status Summary
• File Analytics Collection Status
The data collection process logs activity to provide additional processing details that support troubleshooting. Use the Admin > Advanced > Support Tools feature to request a support package that contains Data Collector Server files. To identify specific files, it may be helpful to have some knowledge of the logging structure and naming conventions.
Beginning with APTARE StorageConsole 10, the data collection logging structure has been reorganized to make it easier for support and developers to find relevant information. Refer to the following sections to understand this structure.
Data Collector Log File Organization
Data Collector logs are organized into two directory hierarchies:
Checkinstall and Validation Probes
• /opt/aptare/mbs/logs/validation/
• C:\Program Files\Aptare\mbs\logs\validation\
Schedule Probes (such as running as a service)
• /opt/aptare/mbs/logs/scheduled/
• C:\Program Files\Aptare\mbs\logs\scheduled\
Within this directory structure, there is a
framework sub-directory. The
framework sub-directory is used in the beginning of the collection process, before the Data Collector type has been identified. Once StorageConsole knows the type of collector (for example, EMC Isilon), logging is recorded in the main
scheduled directory using the naming convention described in
Data Collector Log File Naming Convention.
Data Collector Log File Naming Convention
Within the directory structure described in
Data Collector Log File Organization, log files have the following naming convention:
<vendor.product>/<subsystem>#META_ID/Probe.log
For example, an EMC Isilon probe from checkinstall would result in a file name similar to:
/opt/aptare/mbs/logs/validation/emc.isilon/alphpeifr023#META_EA1BA380E95F73C72A72B3B0792111E5/IsilonClusterDetailProbe.log
Some collectors may have a period of time when they are not processing a specific subsystem. For those periods, logging will occur in an aggregate log file similar to:
/opt/aptare/mbs/logs/validation/emc.isilon/#META_EA1BA380E95F73C72A72B3B0792111E5/IsilonClusterDetailProbe.log
Sample Vendor.Product Naming Convention
Examples of vendor.product folder names within this directory structure include:
cisco.cisco
commvault.simpana
dell_compellent
emc.avamar
emc.clariion
generic.host (Valid for a host resources discovery policy)
hp.3par
symantec.bue
Additionally, each Java Virtual Machine (JVM) creates its own logging file(s) when starting up. This is necessary because multiple processes logging to the same file could overwrite each other’s log messages. These log files can be found in the framework sub-directory, as described in
Data Collector Log File Organization. See also,
Checkinstall Log.
Log File Names Based on Data Collector Generation
Throughout the APTARE StorageConsole life cycle, some collectors have been upgraded to include new functionality and new Data Collectors have been designed with an improved architecture. The log file naming convention depends on the generation of the Data Collector that you are using. You do not need to know the generation of the Data Collector to find relevant log files.
When running a scheduled Data Collector the following log files are created, depending on the generation of the Data Collector. For technical reasons, older-generation collectors use framework/#META or EVENT_ID and newer-generation collectors share a single file named with the main collector ID, for example, framework/#<policyID>.
Several log file names include a specific ID. This ID can be found in a System Administration report,
Data Collection Schedule Summary. See also,
Find the Event/Meta Collector ID.
• /opt/aptare/mbs/logs/scheduled/framework/#META_EA1BA380E95F73C72A72B3B0792111E5/META_EA1BA380E95F73C72A72B3B0792111E5.log
• /opt/aptare/mbs/logs/scheduled/framework/#HQBackupCollector/HQBackupCollector.log
Checkinstall Log
The checkinstall process produces its own log file, but in most cases, there is very little to report in this log.
For example, the checkinstall creates:
/opt/aptare/mbs/logs/validation/framework/#checkinstall/checkinstall.log
General Data Collector Log Files
Locations in this table represent the default locations, but these may have been modified for your environment.
Table 1 General Data Collector Logs
Log File Name | Default Location | Description | Component |
start_watchdog.log | /opt/aptare/mbs/logs | Logging for the high-level management of the Watchdog component. Management includes startup, shutdown, and initialization. | Watchdog |
wrapper.log | C:\Program Files\Aptare\mbs\logs |
watchdog.log | C:\Program Files\Aptare\mbs\logs /opt/aptare/mbs/logs | Detailed logging for the Watchdog component. Logs all the functions Watchdog performs including downloading new configuration files. |
upgradeMgr.log upgrade_<version>.log | C:\Program Files\Aptare\upgrade\upgradeManager\logs /opt/aptare/upgrade/upgradeManager/logs | Detailed logging for the Data Collector Upgrade Manager. <version> refers to the version of the aptare.jar to which the Data Collector is being upgraded. Note: The logs directory will not exist for a new installation of the Data Collector. The logs directory will only be created once the collector goes through an aptare.jar upgrade cycle. | Upgrade Manager |
Find the Event/Meta Collector ID
This ID is displayed in the Data Collection Schedule Summary, but you can also use the following script to list the IDs.
1. List the Data Collectors to get the Event/Metadata Collector ID.
Windows:
C:\Program Files\APTARE\mbs\bin\listcollectors.bat
Linux:
/opt/aptare/mbs/bin/listcollectors.sh
In the output, look for the Event Collectors section associated with the Software Home—the path that was specified when the Data Collector Policy was created.
==== Event Collectors ===
Event Collector Id: EF14CEE486DF781F312E5D40411C11E5
Active: true
Active: true
Software Home: C:\Program Files\EMC NetWorker\nsr\bin
Server Address: networker3
Domain: 100000
Sub-system/Server Instance/Device Manager Id: 110050
Schedule: 10