Skip to main content
Version: 6.0.0

Monitoring

Introduction​

This document provides a comprehensive guide for using the monitoring features of the platform. The monitoring section offers various tools to track platform performance, user activity, and system health through intuitive dashboards and detailed reports.

Table of Contents​

Accessing the Monitoring Section​

To access the monitoring features:

  1. Navigate to the left navigation panel
  2. Select "Monitoring"
  3. Choose from the available options: Dashboard, Request, Audit Trail, User Analytics, or Monitoring

Dashboard​

The Dashboard provides graphical representations of platform activity and usage metrics.

Features​

  • Visual representation of request volumes
  • Cost analysis of top models used
  • Comprehensive platform usage statistics

Filtering Options​

Filter data by time periods using the following options:

  • 7D (7 days)
  • 1M (1 month)
  • 3M (3 months)
  • All (entire history)

Request Tracking​

The Request section allows you to view and analyze individual requests made on the platform.

Accessing Request Data​

  1. Click on "Request" in the monitoring navigation menu
  2. The Request UI will appear showing a list of requests
  3. Click on any request to view detailed information

Available Request Details​

Super admin users can view comprehensive request information including:

  • Token usage
  • Model information (including embedding models used)
  • User identification
  • Request status
  • Latency metrics
  • Average performance details
  • Cost analysis
  • User feedback
  • Additional request metadata

Audit Trail​

The Audit Trail maintains a record of all changes and activities occurring on the platform.

Accessing the Audit Trail​

  1. Click on "Audit Trail" in the monitoring navigation menu
  2. The Audit Trail UI will display all recorded platform changes

Audit Information​

When clicking on any audit entry, you can view:

  • User who made the change
  • Creation/modification datetime
  • IP address of the user
  • Message describing the change
  • Detailed data about what was changed

Info Levels​

Audit entries are categorized by severity/action:

  • Informative: Creation of new items or general information (labeled as "info")
  • Moderate: Edit operations
  • Critical: Deletion operations

User Analytics​

User Analytics provides token usage and cost metrics at the user level.

Features​

  • Token usage per user
  • Cost analysis by user
  • Detailed user activity metrics

Filtering Options​

Similar to the Dashboard, data can be filtered by:

  • 7D (7 days)
  • 1M (1 month)
  • 3M (3 months)
  • All (entire history)

Platform Monitoring​

The Platform Monitoring section provides detailed technical monitoring of the system infrastructure.

Accessing Platform Monitoring​

  1. Click on "Monitoring" in the monitoring navigation menu
  2. The Platform Monitoring UI will appear with multiple monitoring options

Monitoring Categories​

The following monitoring categories are available:

  • Cluster Monitoring
  • Node Monitoring
  • Network Monitoring
  • Workload Monitoring
  • Volume Monitoring
  • Platform Component Monitoring
  • User Activity Monitoring
  • GPU Monitoring

Monitoring Data​

Selecting any monitoring category will display relevant backend performance metrics and usage statistics for that specific area of the platform.

Next Steps​

After familiarizing yourself with the monitoring tools, consider:

  • Setting up regular monitoring checks as part of your operational procedures
  • Analyzing trends in usage data to optimize platform performance
  • Reviewing audit trails periodically for security oversight