The team met to review and discuss a QoE (Quality of Experience) survey framework that was being developed for the streaming industry in order to prioritize the next project the Workstream focuses on. The group examined various survey sections including demographics, workflow monitoring, CDN performance, QoE analytics, AI and automation, ad insertion, and success metrics. Key additions discussed included questions about cost reduction priorities, hardware and operating system deprecation policies, sampling methods for QoE data collection, video/audio quality metrics, and low-latency streaming challenges. The team also discussed the need to address multi-CDN strategies and caching efficiency in the survey framework. Updates were shared about the MQA document being published and error codes pending review, with plans to move forward with ratification for the error codes document.
- Tony: Proceed with submitting the Error Codes document to JT, Flor, and Hali for ratification.
- All participants: Review the QoE survey questions in the shared Google Doc and provide any comments or suggested amendments before the next relevant step.
- Antitrust Statement and WG Discussion
QoE Survey Development Discussion
- The team discussed a QoE survey that was being developed, with work on questions taking place in last week’s 30-minute call.
- Tony explained that the survey was intended to identify the most important concerns for streaming providers based on Will Law’s previous comments about new projects.
- The team agreed to review the Google Doc containing the survey questions to provide comments and amendments.
MQA and Error Codes Updates
- Hali provided an update that the MQA document was published on the website.
- Regarding error codes, Daniel was unable to find an official reviewer but offered to review it after vacation in late April.
- Tony decided to proceed with submitting the error codes document as is, and Hali confirmed they would start the process.
Survey Quality Metrics Discussion
- The team then began reviewing a framework covering topics such as demographics, workflow monitoring difficulty, operational challenges, CDN monitoring, QoE analysis, AI and automation, and ad insertion quality.
- Joan and Tony discussed potential additions to their survey, focusing on quality metrics and cost considerations which are front and centre to most streaming organizations.
- They identified gaps in questions about picture and audio quality, objective testing methods, and cost reduction strategies.
- They considered including questions about operational costs, particularly regarding cloud and CDN expenses, though acknowledged that network costs might be minimized for telcos using managed networks.
- The discussion remained exploratory, with Joan noting the need to carefully formulate questions around these topics.
Hardware Compatibility Testing Challenges
- Casey and Tony discussed player quality and testing challenges, particularly around hardware compatibility issues.
- Casey explained that their team conducts end-to-end testing, including hardware testing in a device lab, to identify playback problems across different devices.
- They discussed the difficulty of supporting older devices, with Casey noting that the decision to support specific devices is based on user base size and cost-effectiveness rather than specific time or model cutoffs.
Hardware and OS Deprecation Policies
- The discussion focused on developing questions for an upcoming meeting, particularly around hardware and operating system deprecation policies.
- Tony and Slavik discussed potential questions about hardware deprecation criteria, including factors like user volume, performance, and age, as well as operating system support policies.
- They also considered questions about quality of experience (QoE) measurement approaches, including whether full census or sampling methods are used for monitoring playback events.
- The conversation ended with Joan being asked to contribute questions related to cost considerations.
Cost Priorities Question Framework
- The team discussed how to frame questions about cost priorities in their organization.
- They explored different ways to ask about the balance between growth and cost reduction, with Joan suggesting a boolean question about whether cost control is a priority.
- The group decided to scrap a question about recent price hikes due to potential sensitivity around revenue-related topics.
- They also considered adding a question about adopting new features or standards based on cost reduction potential, specifically mentioning H265 as an example.
Video Streaming Quality Measurement Survey
- The team discussed survey questions related to video streaming and quality measurement.
- They refined questions about encoding costs, data sampling, hardware limitations, and operating system support.
- Tony and Joan worked on framing questions about cost reduction measures like data retention and archival storage.
- Rob contributed insights about multi-CDN strategies and low-latency streaming challenges, leading to the addition of questions about caching efficiency and HTTP protocol measurements.
- The group agreed to include specific questions about measuring cache hits and origin versus edge performance, particularly in the context of low-latency streaming.
Next Meeting: Wednesday, May 6, 2026 8am PDT