Week 13 – Workaround for complex real time telephony system

0. So far, we’ve been having a hard time finding a proper way to real time TTS call for mute people. It seemed too complicated to implement the system because telephony system needs many types of software package to be inter-connected to send information back and forth.  One day, we watched a YouTube video and it was about sending the call output through a Google Voice Phone call using Linux and Pulse audio. While watching the video, we found that the system introduced on the video could catch and send the internal sound of the window PC. We then came up with an idea and searched a software that can route the sound for MacOS whose name is Soundflower.

1. Soundflower is an open source kernel extension for MacOS, and it is designed to create a virtual audio output device that can also act as an input. In other words, it is possible for us to route external sound into an internal sound and vice versa using Soundflower. After installing Soundflower, we set the sound input from Internal Microphone to Soundflower both in Mac book and Google hangout in order to see if a sample mp3 file is playing through internal sound so that the other side of calling person can listen to the sound from the mp3 file. As a result, it worked well.

Screen Shot 2018-11-23 at 12.23.15 PM

Screen Shot 2018-11-23 at 1.20.26 PM.png

2. A prototype for PC call using gTTS

We then implemented a prototype that generate TTS sound and create mp3 file at the same time using tkinter(for GUI) and gTTS(google TTS engine).

Screen Shot 2018-11-23 at 12.43.14 PM          Screen Shot 2018-11-23 at 1.23.56 PM.png

 

3. TTS for android

We developed TTS application for Android that has speed and pitch features to modify voice tone. Also we’re trying to add gender voice option (Female and Male voice); however, we had difficult time to switch from the default female voice on the android TTS to male, so we realized that we need to use another engine such as iSpeech or Nuance. These engines are really good in supporting male and female voices. Also, we are working now to add another feature to the voice such as emotions. Android studio was really nice program that gave an accurate and beautiful designs without additional fees.

Currently, we are in the process of getting familiar with iSpeech and Nuance to find out which one is the most applicable to our project.

 

Screen Shot 2018-11-23 at 3.05.42 PM

 

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s