Wählen Sie die deutsche Sprachversion New HEAD acoustics UK subsidiary Sélectionnez votre langue! Choose the Japanese version New HEAD acoustics Korea subsidiary Choose the Chinese version
     HEAD Milestones
     HEAD Corporate Brand Video
  News, Events & Publications     HEAD Press Releases - Overview    3PASS: 3GPP round robin test demonstrates extended accuracy and consistency of background noise reproduction
HEAD News Herzogenrath (Germany), December 07, 2015
3PASS: 3GPP round robin test demonstrates extended accuracy and consistency of background noise reproduction
Using 3QUEST for subjective quality assessment is the de facto standard in the field of telecommunication measurement technology. A crucial role in this context plays the simulation of background noise: Until now HAE-BGN - the HEAD acoustics implementation of ETSI ES 202 396-1 - is the standard system and widely in use at almost all labs. With 3PASS a new system was developed which takes multi-microphone arrangements in modern smartphones into account. The 3PASS system has been approved as ETSI standard TS 103 224 in August 2014. Now, a 3GPP work item put research on how the situation improved. They conducted a round robin test and focused on two crucial questions:
How good is the reproducibility of the ETSI ES 202 396-1 and ETSI TS 103 224 background noise (BGN) simulation methods?
Do the different BGN simulation technologies lead to different 3QUEST results when measuring the same device under test?
Seven devices, four labs, HEAD acoustics equipment
Four labs, seven devices, two bandwidth-modes, six background noise scenarios, two setups - every combination measured with HAE-BGN and with 3PASS: from April to August 2015, the round robin test was conducted by four labs all around the world. Each lab was testing seven different devices in narrowband and wideband mode with six background noise scenarios (e.g. cafeteria, train station) with the above mentioned background noise simulation techniques in handheld hands-free and desktop hands-free setups. All labs used HEAD acoustics´ communication quality analysis system ACQUA with the background noise simulation systems HAE-BGN and 3PASS. The database used for the measurements was provided by HEAD acoustics to every participant.
3PASS equalization leads to highly accurate reproducibility
HAE-BGN requires a manual equalization based on tolerance guidelines. As a consequence, larger variations between labs may occur. However, for 3PASS equalization is conducted fully automated and always by impulse responses. This leads to a highly accurate reproducibility of background noise scenarios across different labs - an essential advantage of 3PASS.
Revealing insights through the round robin test
In addition to the conclusion that the inter-lab consistency of the results is more accurate, the round robin test provides other interesting insights regarding reproducibility of the two BGN simulation methods
HAE-BGN (ES 202 396-1) and 3PASS (TS 103 224).
Accuracy and consistency: When using TS 103 224 the reproduction of the background noises at the terminal are much more accurate and consistent - especially in the low frequency domain below 2 kHz. With the 3PASS simulation method the spectral differences measured at the reference microphone drop to 1-5 dB when measuring in 1/3 octaves (5-15 dB for HAE-BGN simulation method).
MOS-values: When comparing the two BGN simulation methods regarding the MOS-values the differences are small (about 0.1 to 0.2 MOS). For the tests binaurally recorded background noises from TS 103 224 were used. The tests have shown that the offset is not constant but depending on the type of terminal. Another important finding is that the inter-lab correlation when using 3PASS simulation method is higher than with HAE-BGN (cf. diagrams below).
Handheld hands-free and desktop: Comparison of the two simulation methods regarding the analysis in handheld hands-free mode according to the current version of TS 26.131 and TS 26.132 and averaging S-, N- and G-MOS over all background noises are small with background noises from TS 103 224 (in the range of 0.1-0.2 MOS; terminal dependent). When testing in desktop position the differences are slightly bigger (about 0.2 MOS) compared to HHHF mode.
As a consequence of the 3GPP round robin test, the standardization institute is discussing to adopt 3PASS technology (TS 103 224) as the recommended method for background noise reproduction. For 3GPP members the results of the round robin test can be downloaded from the 3GPP website.
  Correlation of N-MOS-Values between two different rooms for different DUTs and different background noises

  Download high-resolution image
     (right click - save as)
  Spectra of cafeteria noise recorded at location of DUT in two different rooms and different DUTs

  Download high-resolution image
     (right click - save as)
  3PASS logo
  Download high-resolution image
     (right click - save as)
For immediate release. In case of publication please notify and/or provide printed copy!
Steffen Scholz
HEAD acoustics GmbH
Ebertstr. 30a,
D-52134 Herzogenrath
Phone: +49 (0) 2407 577 0
Fax: +49 (0) 2407 577 99
About HEAD acoustics GmbH – Telecom Division:
HEAD acoustics was founded in 1986 and has been involved in noise and vibration, electroacoustic and voice quality testing since its inception. HEAD acoustics is based in Herzogenrath, Germany, with affiliates in USA, Japan, France and Great Britain as well as a world-wide network of representatives. The Telecom Division of HEAD acoustics manufactures telecom test equipment and provides consulting services in the field of speech and audio quality. Moreover, HEAD acoustics closely co-operates with DECT Forum, ETSI,  ITU-T, 3GPPP, TIA CTIA, GSMA and other standardization bodies with regard to the development of quality standards for voice transmission and speech communication. In many partnership projects, HEAD acoustics has proven its competence and capabilities in conducting tests and optimizing communication products with respect to speech and audio quality under end-to-end as well as mouth-to-ear scenarios.
HEAD acoustics GmbH

Ebertstraße 30a
52134 Herzogenrath

Find your local contact

© 2017 HEAD acoustics GmbH. All rights reserved.
Download Information Material
Related Product Information
 Fact Sheet
NVH Division
Telecom Devision