Microsoft Call Quality Methodology Scorecard for Skype for Business Server V1.5


Last week we released the new version of Call Quality Methodology (CQM). It is available here. Please give it a try!

We have updated both the Call Quality Methodology and the Scorecard. The updated methodology and the documentation for the Scorecard have been combined into a single Word document (Microsoft Call Quality Methodology.docx in the Documentation folder) and the complete package of PS scripts, SQL queries, Microsoft Excel Macro-Enabled Workbook and Documentation is shipping as single ZIP file.

The methodology has been updated:

  • New poor stream condition
  • New suggested targets

In the CQM Scorecard we have fixed a few bugs and added a number of new features including:

  • Added support for Skype for Business Server 2015
    • We support the Skype for Business Server LcsCDR and QoEMetrics schemas
  • Added dial-tone and completed session Reliability charts and Scorecard elements
    • This enables customers not only to look at audio quality, but also to see how reliable their Lync/Skype for Business deployment is
    • The data is coming from call detail records in LcsCDR
  • Changed the default poor stream condition to be ClassifiedPoorCall
    • This is the same definition used by Lync 2013/Skype for Business 2015 and Call Quality Dashboard
    • Using the same default definition allows for better comparison between the different tools and limits potential confusion over different results
    • We continue to offer the option to use the CQM V1.4 poor stream definition and to use a complete custom definition
  • Displaying the Rate My Call chart for a given scenario next to the poor stream ratio chart
    • This allows the administrator to correlate the poor stream ratio numbers to the subjective user feedback
    • It enables the administrator to take the user feedback into consideration, when deciding on which areas to focus on for troubleshooting
  • Decreased the Scorecard suggested targets to reflect what Microsoft has been able to achieve via the MSIT Get 2 Green project
  • Added the possibility to filter out streams generated by Synthetic Transaction
  • Added a number of Reliability and Audio diagnostics SQL queries for common scenarios & questions
    • This provide the administrator an additional level of detail for a given scenario
    • We have added a diagnostic query to surface the new detailed Wifi information being sent by Skype for Business 2015 clients

Samples of the new Rate My Call charts and Reliability info in the Scorecard are shown below. 

Please download the ZIP file above and open the Microsoft Call Quality Methodology Word document. It has more details about the changes and new features and detailed information about how to use the PS scripts and the CQM Scorecard itself.

Comments (5)

  1. Natan1 says:

    Hi Jena, the sample images don't show up..

    Jens>Thanks, yes, working on fixing it.

  2. Natan1 says:

    Hi Jens. What is the scale of CallerAudioMicGlitchRate or how the value should be interpreted? If lets say caller has MicGlitchRate of 1 comparing to another caller who has MicGlitchRate of 10 or 50. Does the value represents the actual number of seconds with glitches or it is a kind of ratio? We should have as less systems with glitches as possible and I am trying to understand the “size” of overall impact we have per device/platform.. Thanks !!

    Jens> It is defined as the average number of glitches per five minutes for the microphone capture http://technet.microsoft.com/en-us/library/gg398064.aspx. In the new version of CQM we set the target to 150. That is 1 glitch every 2 second. You could argue that 150 is even too high.

  3. Dave says:

    Hi Jens…I just downloaded the CQM script. Unfortunately Im coming up with the warning: 'Not able to find PoorStreamCondition file' when I run the script. Its looking for a file under queriesPoorStreamCondition_ClassifiedPoorCall.txt

    I chose to not specify the -PoorStreamCondition attribute
    When I look in the parameters file the PoorStreamCondition = DefClassifiedPoorCall

    Jens>Hi, do you have the directory with the CQM.ps1 script as the current directory in PowerShell?

    Thanks for your help

  4. Dave says:

    Yes…I copied the CQM.ps1 file to F:Program FilesSkype for Business Server 2015.
    (I run all of my Lync/S4B cmdlets from that directory.

    Jens>Ok. I can't repro it on my side. Could you try copying everything from the ZIP file (Queries folder, CQM.sp1) to a new directory outside program files? Check that the Queries folder has 64 items including 4 text files starting with PoorStreamCondition and then run the CQM.ps1 from that new directory like .cqm.ps1. If it still doesn't work please attach a screenshot showing how you run CQM.ps1 and the error message.

  5. Dave says:

    I figured out my issue based on your last comments above…I didnt have all the files copied from the downloaded zip file. I did a new copy/paste in the target directory and the cqm script successfully ran. Thanks for taking time for my issue.

Skip to main content