StethoSpeech: Turning non-audible murmurs into clear intelligible speech

Health By Sumit Jha Oct 23, 2024 Read the article

Imagine if you could talk without making any sound and a special device helps others hear you!

[{"selector":"#anim-1a451e4a-aaed-46ac-8fe9-f8d201a4d728","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-74f698e9-f7b8-459e-b7f6-6602b54e499f","keyframes":{"transform":["translate3d(0px, 42.39646%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-95929dc4-858b-4a58-a627-792fcce98f7d","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-59f63f35-7739-47de-9319-832f22329f9e","keyframes":{"transform":["translate3d(0px, 191.71377%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-695542f0-9f29-4241-9689-cd6ca7f1ede7 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-28.910081615896406%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] Read the article Health

That’s what some smart researchers from International Institute of Information Technology (IIIT) Hyderabad have created.

[{"selector":"#anim-c2571f47-80bd-466c-b4c1-09835606bf35","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-9e4997df-561f-46fd-a26d-ed2bca7b9fc8","keyframes":{"transform":["translate3d(0px, 42.39646%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e5b7b305-0657-4822-8a05-f0a2889b5eae","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a1befe98-c3c3-4d5f-8e0e-640be5c15442","keyframes":{"transform":["translate3d(0px, 153.89266%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-04b3c2f4-c7ff-4a59-8a30-941814a56afd [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] Read the article Health

A team of researchers from IIIT, Hyderabad has developed a Silent Speech Interface (SSI) capable of converting non-audible murmurs into vocalised speech.

[{"selector":"#anim-eb218d86-da2a-4eb6-93ef-34ac10ac4b78","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c127f50b-f22c-405c-864b-9f8a54f1be5b","keyframes":{"transform":["translate3d(0px, 42.39646%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ba607d80-837d-40e7-b2ca-64ea302546a0","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-9e1d6a6b-fe16-41b8-93cc-422f6496f97a","keyframes":{"transform":["translate3d(0px, 97.09108%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-00d86ba4-2603-46d4-8fa7-a906ca53e82f [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(7.812499744007886%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] Read the article Health

This technology, known as “StethoSpeech,” uses a wireless stethoscope to translate behind-the-ear vibrations into intelligible speech, even in challenging environments.

[{"selector":"#anim-f7fa044d-5394-4095-bbd8-32c7982580fd","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4079bb38-9d79-4797-848b-4641021a0b2a","keyframes":{"transform":["translate3d(0px, 42.39646%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-6f90996e-2d94-44d0-a972-65c804f98210","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d867d2ca-644f-4ad2-8e0f-50686398c02b","keyframes":{"transform":["translate3d(0px, 99.66617%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a0c1c2e2-e907-42f8-be32-cf50c3533e68 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-31.249999886225726%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] Read the article Health

The research was led by Neil Shah, a PhD student and researcher at the Centre for Visual Information Technology (CVIT) at IIITH.

[{"selector":"#anim-c6af7df0-b538-486c-9365-432447b6659e","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f0205045-fd0f-49d4-b2d2-0a50dbee8100","keyframes":{"transform":["translate3d(0px, 42.39646%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-8e601628-e853-4c92-b0c5-541dc7f90816","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e3cf12d5-922b-4fee-b3c2-be2f1c0bf675","keyframes":{"transform":["translate3d(0px, 126.67920%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-66ca685c-818b-4a47-8d70-0067b75abbf7 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-31.133462704608483%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] Read the article Health

With Neha Sahipjohn and Vishal Tambrahalli as team members, the research was guided by Dr. Ramanathan Subramanian and Prof. Vineet Gandhi.

[{"selector":"#anim-5ed526fe-1151-49bb-b138-9f4da557f9bf","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f9d28a32-5d23-44b2-bc46-5397512bf6dc","keyframes":{"transform":["translate3d(0px, 42.39646%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f2d3ae7e-21a8-4131-99e2-d4682c0ae70b","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7505db6c-8f26-4c71-bca6-f1318b1f4bf0","keyframes":{"transform":["translate3d(0px, 126.67920%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-8df09879-d1b5-4a09-aa58-e28179176559 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-41.10753652456564%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] Read the article Health

Their findings were published in a paper titled “StethoSpeech: Speech Generation Through a Clinical Stethoscope Attached to the Skin.”

[{"selector":"#anim-b2ff8a88-9cf6-47e0-a951-717c347bf6c1","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-eac39cab-9cfa-486b-b0cc-7d2da309fd7f","keyframes":{"transform":["translate3d(0px, 42.39646%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-acd340da-affa-460c-9ff4-f377564e5276","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d24113ab-fbd1-4367-9228-d84cbe95b5de","keyframes":{"transform":["translate3d(0px, 152.53210%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a7853002-5066-482d-bf67-23d34ce75f0b [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-39.283841207571875%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] Read the article Health