webrtc/modules/audio_processing/test/conversational_speech
Niels Möller a12c42a6b2 Delete root header file typedef.h.
Usage replaced with stdint.h, rtc_base/system/arch.h and
rtc_base/system/unused.h, as appropriate.

Bug: webrtc:6854
Change-Id: I97225465d14b969903d92979e2df3c3c05d35f18
Reviewed-on: https://webrtc-review.googlesource.com/90249
Reviewed-by: Niklas Enbom <niklas.enbom@webrtc.org>
Reviewed-by: Fredrik Solenberg <solenberg@webrtc.org>
Commit-Queue: Niels Moller <nisse@webrtc.org>
Cr-Commit-Position: refs/heads/master@{#24100}
2018-07-25 14:59:26 +00:00
..
BUILD.gn Delete root header file typedef.h. 2018-07-25 14:59:26 +00:00
config.cc Fixing WebRTC after moving from src/webrtc to src/ 2017-09-15 05:02:56 +00:00
config.h Fixing WebRTC after moving from src/webrtc to src/ 2017-09-15 05:02:56 +00:00
generator.cc Use absl::make_unique and absl::WrapUnique directly 2018-07-05 10:59:49 +00:00
generator_unittest.cc Replace rtc::Optional with absl::optional in modules/audio processing 2018-06-19 10:38:56 +00:00
mock_wavreader.cc Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
mock_wavreader.h Delete root header file typedef.h. 2018-07-25 14:59:26 +00:00
mock_wavreader_factory.cc Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
mock_wavreader_factory.h Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
multiend_call.cc Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
multiend_call.h Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
OWNERS Moving src/webrtc into src/. 2017-09-15 04:25:06 +00:00
README.md Change levels of different speech signal in tool. 2018-01-22 14:19:28 +00:00
simulator.cc Use absl::make_unique and absl::WrapUnique directly 2018-07-05 10:59:49 +00:00
simulator.h Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
timing.cc Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
timing.h Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
wavreader_abstract_factory.h Fixing WebRTC after moving from src/webrtc to src/ 2017-09-15 05:02:56 +00:00
wavreader_factory.cc Delete root header file typedef.h. 2018-07-25 14:59:26 +00:00
wavreader_factory.h Reformat the WebRTC code base 2018-06-19 14:00:39 +00:00
wavreader_interface.h Delete root header file typedef.h. 2018-07-25 14:59:26 +00:00

Conversational Speech generator tool

Tool to generate multiple-end audio tracks to simulate conversational speech with two or more participants.

The input to the tool is a directory containing a number of audio tracks and a text file indicating how to time the sequence of speech turns (see the Example section).

Since the timing of the speaking turns is specified by the user, the generated tracks may not be suitable for testing scenarios in which there is unpredictable network delay (e.g., end-to-end RTC assessment).

Instead, the generated pairs can be used when the delay is constant (obviously including the case in which there is no delay). For instance, echo cancellation in the APM module can be evaluated using two-end audio tracks as input and reverse input.

By indicating negative and positive time offsets, one can reproduce cross-talk (aka double-talk) and silence in the conversation.

Example

For each end, there is a set of audio tracks, e.g., a1, a2 and a3 (speaker A) and b1, b2 (speaker B). The text file with the timing information may look like this:

A a1 0
B b1 0
A a2 100
B b2 -200
A a3 0
A a4 0

The first column indicates the speaker name, the second contains the audio track file names, and the third the offsets (in milliseconds) used to concatenate the chunks. An optional fourth column contains positive or negative integral gains in dB that will be applied to the tracks. It's possible to specify the gain for some turns but not for others. If the gain is left out, no gain is applied.

Assume that all the audio tracks in the example above are 1000 ms long. The tool will then generate two tracks (A and B) that look like this:

Track A

  a1 (1000 ms)
  silence (1100 ms)
  a2 (1000 ms)
  silence (800 ms)
  a3 (1000 ms)
  a4 (1000 ms)

Track B

  silence (1000 ms)
  b1 (1000 ms)
  silence (900 ms)
  b2 (1000 ms)
  silence (2000 ms)

The two tracks can be also visualized as follows (one characheter represents 100 ms, "." is silence and "*" is speech).

t: 0         1        2        3        4        5        6 (s)
A: **********...........**********........********************
B: ..........**********.........**********....................
                                ^ 200 ms cross-talk
        100 ms silence ^