SVTA_LOGO_FINAL_revised_2022

Measurement/QoE Meeting Minutes
March 25th, 2026 8:00am to 9:00am PT</p

Attendees

Tony Stott (Streaming Video Technology Alliance (SME))
Sean McCarthy (Streaming Video Technology Alliance (SME))
Rob Walch (Apple)
David Gunnell (Netskrt)
Andrey Brakhno (Elecard)
Mohammad Saud Syed (Interra Systems)
Yasser Syed (Streaming Video Technology Alliance (SME))
Brenton Ough (Touchstream)
Bill Redmann (Interdigital)
Slavik Lozben ()
Joan Treveset (Castlabs)
Nedimar Turatti (Globo)
Casey Occhialini (Paramount)
Will Law (Akamai)

Minutes

  • Summary

The QoE WG Call focused on reviewing and updating error codes for media players, with Tony Stott leading the discussion. The group discussed the need for a technical reviewer and the importance of standardizing error codes. They also addressed the CDN quality measurement project, proposing to shift focus from test objects to using CMCD and CMSD data for performance metrics. The team debated the challenges of device fragmentation and the need for normalized metrics to compare CDN performance. They agreed to scrap the current RUM based proposal and work on a new problem statement to better address industry needs.

 

 

  • Action Items
  • Coordinate with the Player Working Group and then the wider SVTA to identify a technical reviewer for the player error codes specification and ensure it has been reviewed before submission for ratification.
  • Draft a refined problem statement and proposed scope for the CDN performance/CMCD metric work (replacing the test-object-based approach) and share it with the group for review and voting.
  • Post the link to the NAB booth demo meeting in the call chat so attendees can sign up for demo slots –
  • Inform Pedro about the agreed change to use the org.svta-mqa custom key name in the MQA implementation so his code aligns with the latest spec.

 

 

  • Antitrust Statement and WG Discussion

Error Proposal Review and Initial Discussions

  • Tony Stott initiates the meeting by suggesting a quick review of the error proposal, emphasizing the need for a technical reviewer before sending it to the SVTA or management board.
  • Tony shares the updated document, mentioning changes based on feedback from Joan and Castlabs, including moving from string representation to full integer for error codes.
  • Will Law requests the document link to be shared in the chat, and Tony pastes it in the chat for everyone to access.

Detailed Review of Error Codes and Feedback

  • Tony explains the updated Table of Contents and examples, highlighting changes based on feedback from Tata and Apple.
  • Tony discusses the categorization of error codes, including primary and secondary manifest load errors, and the rationale behind these changes.
  • Yasser Syed asks about the origin of the error codes, and Tony clarifies that they come from the player.
  • Casey Occhialini explains the failure scenarios for manifests and the different types of errors, including load and parse errors.

Technical Review and Document Updates

  • Tony confirms the team accepts all the proposals in the last few sessions and that no one had any further amends to make. The error code proposal is now ready for technical review. Tony thanked the entire team for their massive contribution with this project.
  • Will Law mentions an improved abstract for the document, which Tony accepts and updates.
  • Tony discusses the possibility of putting out a wider message to the General SVTA for a technical review.
  • Yasser Syed suggests focusing the technical review on certain working groups, particularly the player team, and Tony agrees to do so.

NQA Review Process and Timeline

  • Will Law inquires about the state of the NQA review process and the expected publication date.
  • Hali Morek provides an update on the MQA document, mentioning the first ballot period ending on April 7 and the potential timeline for publication.
  • Will Law and Yasser Syed discuss the importance of releasing the document before NAB, considering their booth presence and potential demos.
  • Brenton Ough and Yasser Syed discuss the logistics of demonstrating the document at the NAB booth, including the use of pre-recorded videos and the involvement of JT.

CDN Quality Measurement and Proposal

  • Tony Stott introduces the CDN quality piece, mentioning Sean’s experience at Paramount and the duality of measuring CDN performance and the definitions of measurement.
  • Will Law expresses concerns about the current proposal, preferring real-time metrics from real users in real environments over static test files.
  • Sean suggests focusing on creating performance metrics based on CDN logs and CMCD data, aligning with the group’s discussion on the scope of the project.
  • The group discusses the challenges of measuring CDN performance, including the complexity of dealing with different types of content and the need for standardized metrics.

Data Management and CMCD Metrics

  • Tony recognizes a major friction point limiting CMCD’s uptake is the volume of QoE data needed to process (i) to measure audience size & (ii) to identify QoE issues. One potential project for our workstream is to recommend metrics & sample sizes for each of these use cases in order to maximize visibility while minimizing operational cost.
  • Sean and Brenton Ough discuss the importance of composite metrics and the potential impact of conditional sampling on CMCD data.
  • Will Law explains the triggers and events defined in CMCD v2, which can be configured to send data based on specific conditions.
  • The group considers the feasibility of addressing the data volume problem and the potential value of creating a list of composite metrics for CMCD.

Survey and Industry Feedback

  • Brenton Ough suggests conducting a survey to gather feedback from video engineers and identify pressing QoE problems.
  • Will Law mentions the Bitmovin developer report, which lists common problems in the industry, as a potential source of insights.
  • Sean highlights the recurring theme of device fragmentation and the challenges of addressing issues on old and low-end devices.
  • The group agrees to scrap the current run-based proposal and focus on honing a problem statement that can have a significant impact on the industry.

Next Steps and Action Items

  • Sean proposes working on a new problem statement and presenting it to the group for feedback and voting.
  • The group acknowledges the need for a clear and impactful project that addresses a significant industry problem.
  • Tony Stott and other participants express their support for the new direction and the importance of addressing device fragmentation and data management challenges.
  • The meeting concludes with a plan to reconvene and finalize the problem statement and project scope.

 

 

Next Meeting:  Wednesday, April 8, 2026 8am PDT

 

Have A Question ABout Membership?

Schedule A Meeting

[hfcm id="18"]

Send An Email

Don’t want to schedule a face-to-face meeting just now? No problem. Simply send your membership question to info@streamingvideoalliance.org or fill out the form below and someone will get back to you as soon as possible.