Best Practices for End-to-End Workflow Monitoring

Working Group:

Measurement/QoE

In Collaboration With:

Project Status:

Completed

The project has been completed.

Start:

October 1, 2019

Target End:

July 1, 2020
  • Home
  • Best Practices for End-to-End Workflow Monitoring

Problem Statement

The streaming video workflow is a complex system of multiple technologies and components. Up until now, much of the emphasis on understanding the performance of streaming video has centered around the quality-of-experience of the viewer. But that does not paint a clear picture of where delivery and other issues may occur within the workflow. It’s critical to understand all of the performance data throughout the different systems and components in order to have a holistic picture of performance.

Project Description

There has been an increasing consensus in the streaming video industry that the design and operation of the entire video workflow needs to be driven by quality assurance and quality controls at points throughout the delivery chain. In this document, we propose best practices for end-to-end workflow monitoring to provide a clear picture to stakeholders (network operation center agents, operation engineers, video delivery architects, managing executives, content owners, and content providers) about potential factors that impact a consumer’s streaming experience. The document will then offer recommendations for a framework which provides end-to-end monitoring and improved failure detection in order to enhance overall quality as well as increase customer retention and resulting market share.

Project Type

Document

Project Leads

Brenton Ough

Christopher Kulbakas

Advisors

There are no SMEs associated with this project.

Published Documents

Version: 1.1

Date Plublished: 09/28/2020

More Details

Add to Basket

SVTA5017: Best Practices for End-to-End Workflow Monitoring

As the video streaming industry continues to mature, QoE expectations continue to rise in importance both as a value proposition to the consumer as well as a differentiator between competing video streaming services. Yet, consistent, systematic, standardized, objectively measured, and business-rules-driven QoE assurance continues to be an elusive goal. This document outlines factors that impact consumer QoE, sheds light on some of the underlying challenges to diagnosing QoE impact and provides a set of best practices for end-to-end QoE monitoring in video streaming workflows.

Goals and Objectives

The goals and objectives of this project include:
  • Creating a re-usable framework for measuring and assessing the end-to-end performance of a streaming video workflow
  • Providing recommendations regarding the measurement of individual components or technologies within the framework

Project Scope

The document produced by this project WILL PROVIDE:
  • An end-to-end workflow monitoring framework which addresses live content workflows, Internet Protocol television (IPTV), and over-the-top (OTT) systems from video streaming sources to device output for a variety of operational use cases
  • Recommendations of measurement thresholds for each component included in the framework
  • Recommendations for improving performance of each component included in the framework
The document produced by this project WILL NOT PROVIDE:
  • Recommendations of specific vendor solutions or technologies for measuring component within the framework
  • Recommendations or discussions for any component not identified as part of the framework

Contributors

The following members have contributed to this project. Click on their name to visit their profile. If they have not published their profile, the link will redirect to their LinkedIn profile.

Christian Schmidmer

Dan Murray

Diane Strutner

Florence Agboma

James Sherry

Roman Bediner

Thomas Edwards

Additional References

There are no additional references or other required readings need to participate in this project.

Presentations

The following presentations delivered during Measurement/QoE working group sessions may provide additional information about this project.

Get Notified!

Want to get notified when we publish a new blog post, technical document, webinar, or other piece of content? Just enter your email address below. Don’t worry, we won’t share your email with anyone and will only use it to notify you of new content.

Close

Have A Question ABout Membership?

Schedule A Meeting

Send An Email

Don’t want to schedule a face-to-face meeting just now? No problem. Simply send your membership question to info@streamingvideoalliance.org or fill out the form below and someone will get back to you as soon as possible.

"*" indicates required fields

Name*
Email*
This field is hidden when viewing the form