Summary of S4-260278: Performance and Metrics Evaluation for FS_QStream_MED
Document Overview
This change request proposes a framework for performance and metrics evaluation as part of the FS_QStream_MED study item, which is commencing at SA4 Meeting #135.
Background and Context
Existing 3GPP Metrics Infrastructure
- 3GPP has defined metrics collection mechanisms for 5G Media Streaming through:
- DASH metrics
- CMCD (Common Media Client Data) client data
- These metrics are currently being extended within the 3GPP framework
Current Implementation Status
- DASH Players: dash.js and Exo-Player have implemented these metrics
- 5G-MAG Reference Tools: Include CMCD and DASH metrics collection implementations
- Visualization: DASHboards and other tools exist for metrics analysis
- Data Correlation: Metrics can be logged and correlated with emulator information
Technical Proposal
Proposed Metrics Collection Framework
The document proposes leveraging the existing metrics collection infrastructure with the following approach:
- Utilize Existing Metrics: Use established metrics collection mechanisms already defined for 5G Media Streaming
- Event Framework Integration: Log data in an event framework that maintains compatibility with existing 5G Media Streaming specifications
- Dual Purpose Approach:
- Evaluate streaming session performance
- Implement and validate the metrics themselves
Key Principles
- Consistency with 3GPP Standards: Rely on QoE metrics as defined in 3GPP specifications
- Standardized Reporting: Use existing reporting frameworks for information collection
- Meaningful Performance Data: Create data suitable for comprehensive performance evaluation
Benefits
- Avoids duplication of effort by reusing existing metrics infrastructure
- Ensures compatibility with established 5G Media Streaming frameworks
- Enables both performance evaluation and metrics validation in a unified approach