1 changed files with 2 additions and 1 deletions
Split View
Diff Options
+ 2
- 1
content/topic/against-the-coming-world-of-listening-machines.md
View File
| @@ -8,7 +8,7 @@ has_lessons: [] | |||
| "Machine listening" is one common term for a fast-growing interdisciplinary field of science and engineering which uses audio signal processing and machine learning to "make sense" of sound and speech [Cella, Serizel, Ellis]. Machine listening is what enables you to be "understood" by Siri and Alexa, to Shazam a song, and to interact with many audio-assistive technologies if you are blind or vision impaired [Alper]. As early as the 90s, the term was already being used in computer music to describe the analytic dimension of 'interactive music systems', whose behavior changes in response to live musical input [Rowe, Maier]. It was also, of course, a cornerstone of the mass surveillance programs revealed by Edward Snowden in 2013: SPIRITFIRE's "speech-to-text keyword search and paired dialogue transcription"; EViTAP's "automated news monitoring"; VoiceRT's "ingestion", according to one NSA slide, of Iraqi voice data into voiceprints. Domestically, machine listening technologies underpin the vast databases of vocal biometrics now held by many prison providers [ref] and, for instance, the Australian Tax Office [ref]. And they are quickly being integrated into infrastructures of development, security and policing. | |||
| , transcription and translation - targeted key word detection - vocal biometrics [[1](https://www.nice.com/engage/real-time-technology/voice-biometrics/ "NICE leverages voice biometrics for safer and more secure customer authentication")] and audio fingerprinting - speaker verification, differentiation, enumeration and location [[1](https://www.trillbit.com/trillbit-home-page.html "Contactless ultrasonic authentication protocol")] - personality and emotion recognition [[1](https://www.youtube.com/watch?v=86I3-VYIvAM "callAIser in action: Call Center agent gets desperate over angry customer")] - accent identification [[1](https://www.youtube.com/watch?v=gJCVla9xYUs "Command Lines: Power, Affect and Identity in Networked Interactions")] - sound recognition - audio object recognition - audio scene analysis - intelligent audio analysis [] - audio event analysis - audio context awareness - music mood analysis - music identification - music playlist generation - audio synthesis - speech synthesis - musical synthesis - adversarial music [[1](https://arxiv.org/abs/1911.00126 "Real World Audio Adversary Against Wake-word Detection System")] - audio brand recognition - aggression detection [[1](https://www.audeering.com/what-we-do/automotive/ "Cars take care of their passengers")] - depression detection - laughter detection - stress detection - distress detection - intoxication detection[[1](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3872081/ "Intoxicated Speech Detection: A Fusion Framework with Speaker-Normalized Hierarchical Functionals and GMM Supervectors")] - scream detection - lie detection - hoax detection[[1](https://amp.abc.net.au/article/12568084 "University of Southern Queensland gets $300k for hoax emergency call detection technology")] - gunshot detection - autism diagnosis - parkinson's diagnosis [[1](http://www.canaryspeech.com/ "Using voice to identify human conditions sooner.")] - covid diagnosis [[1](https://app.surveylex.com/surveys/5384d6d0-6499-11ea-bc3a-b32c3ca92036 "We are launching an initiative to collect your voices with a goal to be able to triage, screen and monitor COVID-19 virus.")] - machine fault diagnosis - psychosis diagnosis [[1](https://www.sciencedaily.com/releases/2019/06/190613104552.htm "The whisper of schizophrenia: Machine learning finds 'sound' words predict psychosis")] - bird sound identification [[1](https://voicebot.ai/2020/06/26/voice-match-is-for-the-birds-new-google-competition-seeks-avian-audio-ai/ "Voice Match is for the Birds")] - gender identification - ethnicity detection - age determination - voice likeability determination - risk assessment [[1](https://www.clearspeed.com/ "Clearspeed: Using the Power of Voice for Good")]... | |||
| [^kathy_audio_1], transcription and translation - targeted key word detection - vocal biometrics [[1](https://www.nice.com/engage/real-time-technology/voice-biometrics/ "NICE leverages voice biometrics for safer and more secure customer authentication")] and audio fingerprinting - speaker verification, differentiation, enumeration and location [[1](https://www.trillbit.com/trillbit-home-page.html "Contactless ultrasonic authentication protocol")] - personality and emotion recognition [[1](https://www.youtube.com/watch?v=86I3-VYIvAM "callAIser in action: Call Center agent gets desperate over angry customer")] - accent identification [[1](https://www.youtube.com/watch?v=gJCVla9xYUs "Command Lines: Power, Affect and Identity in Networked Interactions")] - sound recognition - audio object recognition - audio scene analysis - intelligent audio analysis [] - audio event analysis - audio context awareness - music mood analysis - music identification - music playlist generation - audio synthesis - speech synthesis - musical synthesis - adversarial music [[1](https://arxiv.org/abs/1911.00126 "Real World Audio Adversary Against Wake-word Detection System")] - audio brand recognition - aggression detection [[1](https://www.audeering.com/what-we-do/automotive/ "Cars take care of their passengers")] - depression detection - laughter detection - stress detection - distress detection - intoxication detection[[1](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3872081/ "Intoxicated Speech Detection: A Fusion Framework with Speaker-Normalized Hierarchical Functionals and GMM Supervectors")] - scream detection - lie detection - hoax detection[[1](https://amp.abc.net.au/article/12568084 "University of Southern Queensland gets $300k for hoax emergency call detection technology")] - gunshot detection - autism diagnosis - parkinson's diagnosis [[1](http://www.canaryspeech.com/ "Using voice to identify human conditions sooner.")] - covid diagnosis [[1](https://app.surveylex.com/surveys/5384d6d0-6499-11ea-bc3a-b32c3ca92036 "We are launching an initiative to collect your voices with a goal to be able to triage, screen and monitor COVID-19 virus.")] - machine fault diagnosis - psychosis diagnosis [[1](https://www.sciencedaily.com/releases/2019/06/190613104552.htm "The whisper of schizophrenia: Machine learning finds 'sound' words predict psychosis")] - bird sound identification [[1](https://voicebot.ai/2020/06/26/voice-match-is-for-the-birds-new-google-competition-seeks-avian-audio-ai/ "Voice Match is for the Birds")] - gender identification - ethnicity detection - age determination - voice likeability determination - risk assessment [[1](https://www.clearspeed.com/ "Clearspeed: Using the Power of Voice for Good")]... | |||
| These applications are all either currently in use by states, corporations and other entities around the world, or under development. The list is obviously not exhaustive. Nor does it convey the real diversity of markets, cyberphysical and political contexts into which these applications are quickly embedding themselves: | |||
| @@ -45,5 +45,6 @@ Another response would be to say that when or if machines listen, they listen "o | |||
| # Footnotes | |||
| [^airplanes]:  | |||
| [^kathy_audio_1]: Interview with [Kathy Reid] (https://blog.kathyreid.id.au) on August 11,2020 | |||
| [^andre_audio_1]: Interview with [André Dao](https://andredao.com/) on September 4, 2020 | |||
| [^halcyon_audio_1]: Interview with [Halcyon Lawrence](http://www.halcyonlawrence.com/) on August 31, 2020. | |||