The meeting focused on reviewing and finalizing the QoE industry survey that will help guide future projects. The team discussed Andy’s work in consolidating feedback from previous versions into Version 4 of the survey, which reduced the total questions from 45 to a more manageable number through restructuring and consolidation. Key topics covered included workflow monitoring, CDN usage evolution, QoE metrics, AI adoption in operations, ad insertion technologies, and low-latency streaming. The group provided feedback on specific questions, particularly around AI automation levels, beaconing for ad verification, and the need to capture additional responses through “other” options. The team agreed to use MailChimp for survey distribution.
- Andy – update the survey (version 4) based on team feedback from the meeting (e.g., add beaconing/auditing questions, add synchronized latency, add technology licensing costs, adjust KPI/investment question to top 3/priorities, add more “other” fields where relevant, consider marking trend/continuum questions, and clarify survey evolution at the top).
- Andy – Implement agreed changes and produce the survey in MailChimp (or similar tool) by end of Friday.
- Andy – Send out the MailChimp survey template/export to Brenton and Tony for review and further distribution.
- Brenton – Review the final MailChimp survey template/export when received from Andy, and coordinate distribution to SVTA and Touchstream contacts (and potentially others), including handling of contact lists and survey logistics.
- Brenton – Determine and communicate the survey response period and any incentives (e.g., Amazon gift card) based on previous survey experience.
- Everyone review and send any additional comments or feedback on the survey to Andy before the final version is locked.
- Antitrust Statement and WG Discussion
Survey Background Update
- Brenton explained the origins of a previous survey conducted in 2023, which was well-received and led to the decision to update and redo the survey.
- The group discussed combining feedback from recent calls and documents into a new version, which Andy had synthesized into what is currently called “Final V3.”
Survey Version 4 Presentation
- Andy presented version 4 of a survey, which was created by consolidating 44-45 questions into a more focused format to reduce respondent fatigue.
- The survey structure was reorganized with recommendations implemented and a cleaner view of what respondents would see.
- Tony emphasized the need to finalize the document quickly, as it will shape the team’s direction going forward.
- The team also discussed that MQA documents and error code proposals had been submitted to SVTA leadership for ratification.
MailChimp Survey Planning Discussion
- The team discussed using MailChimp survey for a new survey, finding it more effective and easier to use than Google Forms.
- Andy presented the survey structure, which includes context gathering questions about organization type and role, as well as workflow monitoring sections focusing on component difficulty ratings and operational challenges.
- The survey also addresses CDN evolution since the 2023 survey, particularly examining multi-CDN provider adoption and monitoring technologies for managing multi-CDN environments.
Design Discussion
- The team discussed the design of a survey focused on tracking trends in streaming quality and CMCD adoption over time.
- They aligned on maintaining consistency with previous survey questions to show growth or changes in importance, while also incorporating new elements like CMCD V2 and cost management considerations.
- The discussion highlighted different approaches to quality of experience (QoE) monitoring based on organizational type, with premium services requiring more comprehensive data collection for customer support purposes, while lower-end platforms can be more tolerant of issues with less investment in monitoring.
AI Survey Planning Discussion
- The team discussed including AI topics in an upcoming survey, with Andy highlighting AI’s transformative impact on operations teams.
- Tony suggested rephrasing questions about AI control in streaming operations to make them more objective rather than subjective.
- Yasser proposed adding questions about blast radius analysis, which Andy noted might already be covered.
- The discussion then shifted to ad insertion and monetization, with Andy explaining plans to track the evolution of fast channels and their impact on business models, including ad insertion technologies and quality monitoring.
Beaconing and Advertising Auditing
- The discussion focused on beaconing and auditing aspects in advertising, particularly regarding revenue models and quality of experience (QoE).
- Yasser explained that beaconing helps track ad viewership across platforms and provides valuable aggregated metrics for ad networks, though it requires trust between multiple parties and can increase player load.
- The group acknowledged that while beaconing is important for both ad networks and content platforms, it presents technical challenges and potential commercial issues if not implemented properly.
Synchronization and Performance Metrics Discussion
- The team discussed synchronized latency, focusing on ensuring consistent display across multiple screens and devices.
- Yasser explained two aspects: regional synchronization and device pathway synchronization.
- Andy raised questions about cost control and strategic priorities, requesting organizations to rank cost areas and identify key metrics.
- Tony suggested adding technology licensing costs to a specific item, and the team agreed to allow organizations to select up to 5 key performance indicators for analysis.
Survey Question Refinement Discussion
- The team discussed refining survey questions, focusing on narrowing down the number of important items from five to three and using priority rankings instead.
- Bill suggested marking questions that reflect previous surveys to help respondents identify which questions they’ve been asked before and encourage continuity in responses.
- The discussion also touched on rephrasing questions to better focus on the most important topics and potentially pre-selecting key items to ensure relevant responses.
Questionnaire Improvement Discussion
- The team discussed improvements to a questionnaire, focusing on how to indicate it’s an evolution survey building on previous versions while incorporating new topics like AI.
- They agreed to add more “other” fields throughout the questionnaire to capture responses that might not be covered in the specific questions, particularly for question 5 about component problems.
- Bill suggested using checkboxes with text entry options rather than additional free-form fields to make the process less intimidating for respondents.
Survey Implementation Planning
- Andy will consolidate the survey questions and create a MailChimp template to distribute it to respondents.
- Brenton suggested basing the survey on previous data, including a 25-question format and offering an Amazon gift card incentive.
- The team agreed to aim for launching the survey before their next meeting, with Andy committing to have the MailChimp template ready by the end of Friday.
Next Meeting: Wednesday, May 20, 2026 8am PDT
Meeting Chat Record:
V4 Respondent Facing
https://docs.google.com/document/d/1_221msjpynUpAi_nxVdXsZDfMUAb-tLj/edit?usp=sharing&ouid=116612876780785907137&rtpof=true&sd=true
V3. With Recommendations Implemented
https://docs.google.com/document/d/1nzb4dwRKcV_uF_HEh0RQYNgUhKAxjGKd/edit?usp=sharing&ouid=116612876780785907137&rtpof=true&sd=true
V2.1. Consolidated Questions
https://docs.google.com/document/d/1mBOvZbkLAEOVuWP7ys57x0Jvaz11VNSn/edit?usp=sharing&ouid=116612876780785907137&rtpof=true&sd=true