msRealTime flag corrupts the H264 live video stream in UWP application on Windows mobile

Site Outreach Issue #10088711

Details

Author
Goran B.
Created
Dec 6, 2016
Privacy
This issue is public.
Reports
Reported by 1 person

Sign in to watch or report this issue.

Steps to reproduce

Our application uses UWP as a wrapper around javascript web application.

In it we are attempting to decode live H264 stream using Windows media pipeline.
Application behaves as expected on PC, but when run on mobile device, video gets corrupted after small period of time.

Most likely cause in my opinion is that some samples are discarded before being decoded, which in case of H264 corrupts the stream until next keyframe.

Attachments

0 attachments

    Comments and activity

    • Linked archive contains a Visual Studio solution which is a barebone UWP js application, that uses MediaStreamSource to provide samples to media pipeline.
      Flag used is msRealTime, which reduces latency while decoding and rendering frames (no smoothing of video).

      Main application file is bundle.je that is built using browserify with main.js as target.
      Simulated sample data is contained in frame.js with timestamps as recorded in real life use-case.
      Ignore video size and initial jittering as it is unrelated to the issue and is only related to minimizing application size method in which embedded sample data was captured.

      While this sample works on PC, on mobile devices video gets corrupted after some time.
      Most likely cause in my opinion is that some samples are discarded before being decoded, which in case of H264 corrupts the stream until next keyframe.

    • Microsoft Edge Team

      Changed Assigned To to “Brad E.”

      Changed Assigned To to “Venkat K.”

      Changed Assigned To from “Venkat K.” to “Alexey K.”

      Changed Status to “Needs root cause”

      Changed Status from “Needs root cause” to “Site Outreach”

    You need to sign in to your Microsoft account to add a comment.

    Sign in