Decoding the Brain for Communication: A Review of Brain-to-Text, Brain-to-Speech, and Brain-to-Image Interfaces

Open Access

Issue		BIO Web Conf. Volume 237, 2026 2026 8^th International Conference on Biotechnology and Biomedicine (ICBB 2026)


Article Number		03002
Number of page(s)		5
Section		Biomaterials, Medical Devices and Biomedical Engineering
DOI		https://doi.org/10.1051/bioconf/202623703002
Published online		10 June 2026

Laureys S, Pellas F, Van Eeckhout P, et al. Progress in Brain Research. Elsevier, pp.495–611. (2005) [Google Scholar]
Smith, E. and Delargy, M. Locked-in syndrome. BMJ. 330(7488), pp.406–409. (2005) [Google Scholar]
Kübler, A. and Birbaumer, N. Brain-computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients? Clinical Neurophysiology: Official Journal of the International Federation of Clinical Neurophysiology. 119(11), pp.2658–2666. (2008) [Google Scholar]
Shen, G., Dwivedi, K., Majima, K., Horikawa, T. and Kamitani, Y. End-to-End Deep Image Reconstruction From Human Brain Activity. Frontiers in Computational Neuroscience. 13.(2019) [Google Scholar]
Willett, F.R., Avansino, D.T., Hochberg, L.R., Henderson, J.M. and Shenoy, K.V. High- performance brain-to-text communication via handwriting. Nature. 593(7858), pp.249–254.(2021) [Google Scholar]
Angrick M, Luo S, Rabbani Q, et al. Online speech synthesis using a chronically implanted brain– computer interface in an individual with ALS. Scientific Reports. 14(1), p.9617. (2024) [Google Scholar]
Daly, J.J. and Wolpaw, J.R. Brain–computer interfaces in neurological rehabilitation. The Lancet Neurology. 7(11), pp.1032–1043. (2008) [Google Scholar]
Wang, Yang, Yang, X., Zhang, X., Wang, Yijun and Pei, W. Implantable intracortical microelectrodes: reviewing the present with a focus on the future. Microsystems & Nanoengineering. 9(1), p.7. (2023) [Google Scholar]
Zhang, X., Song, Z., Li, S., Zhang, Y., Fang, T., Wang, S., Li, H., Lin, Y., Jia, J., Zhang, L., Kang, X. and Wang, H. 2021. Brain Computer Interface for the Hand Function Restoration. 9th International Winter Conference on Brain-Computer Interface (BCI), pp.1–6.(2021) [Google Scholar]
Xu, S., Liu, Y., Lee, H. and Li, W. Neural interfaces: Bridging the brain to the world beyond healthcare. Exploration. 4(5), p.20230146. (2024) [Google Scholar]
Tang, J., LeBel, A., Jain, S. and Huth, A.G. Semantic reconstruction of continuous language from non- invasive brain recordings. Nature Neuroscience. 26(5), pp.858–866. (2023) [Google Scholar]
Silva, A.B., Littlejohn, K.T., Liu, J.R., Moses, D.A. and Chang, E.F. The speech neuroprosthesis. Nature Reviews Neuroscience. 25(7), pp.473–492. (2024) [Google Scholar]
Chandler, J.A., Van der Loos, K.I., Boehnke, S., Beaudry, J.S., Buchman, D.Z. and Illes, J. Brain Computer Interfaces and Communication Disabilities: Ethical, Legal, and Social Aspects of Decoding Speech From the Brain. Frontiers in Human Neuroscience. 16.(2022) [Google Scholar]
Pandarinath, C., Nuyujukian, P., Blabe, C.H., Sorice, B.L., Saab, J., Willett, F.R., Hochberg, L.R., Shenoy, K.V. and Henderson, J.M. High performance communication by people with paralysis using an intracortical brain-computer interface. eLife. 6, p.e18554.(2017) [Google Scholar]
Herff, C., Diener, L., Angrick, M., Mugler, E., Tate, M.C., Goldrick, M.A., Krusienski, D.J., Slutzky, K.W. and Schultz, T. Intelligible Speech From Brain Activity in Motor, Premotor, and Inferior Frontal Cortices. Frontiers in Neuroscience. 13, p.1267. (2019) [Google Scholar]
Metzger S L, Littlejohn K T, Silva A B, et al. A high- performance neuroprosthesis for speech decoding and avatar control. Nature. 620(7976), pp.1037–1046.(2023) [Google Scholar]
Luo, S., Rabbani, Q. and Crone, N.E. Brain- Computer Interface: Applications to Speech Decoding and Synthesis to Augment Communication. Neurotherapeutics. 19(1), p.263. (2022) [Google Scholar]
Chen, Z., Qing, J., Xiang, T., Yue, W.L. and Zhou, J.H. Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.22710– 22720.(2023) [Google Scholar]
Vanutelli, M.E., Salvadore, M. and Lucchiari, C. BCI Applications to Creativity: Review and Future Directions, from little-c to C2. Brain Sciences. 13(4), p.665. (2023) [Google Scholar]
Zhang, H., Jiao, L., Yang, S., Li, H., Jiang, X., Feng, J., Zou, S., Xu, Q., Gu, J., Wang, X. and Wei, B. Brain–computer interfaces: the innovative key to unlocking neurological conditions. International Journal of Surgery. 110(9), pp.5745–5762.(2024) [Google Scholar]
Fan, C., Hahn, N., Kamdar, F., Avansino, D., Wilson, G.H., Hochberg, L., Shenoy, K.V., Henderson, J.M. and Willett, F.R. Plug-and-Play Stability for Intracortical Brain-Computer Interfaces: A One-Year Demonstration of Seamless Brain-to-Text Communication. Advances in neural information processing systems. (2023) [Google Scholar]
Herff, C., Heger, D., de Pesters, A., Telaar, D., Brunner, P., Schalk, G. and Schultz, T. Brain-to-text: decoding spoken phrases from phone representations in the brain. Frontiers in Neuroscience. 8. (2015) [Google Scholar]
Makin, J.G., Moses, D.A. and Chang, E.F. Machine translation of cortical activity to text with an encoder–decoder framework. Nature Neuroscience. 23(4), pp.575–582.(2020) [Google Scholar]
Sun, P., Anumanchipalli, G.K. and Chang, E.F. Brain2Char: a deep architecture for decoding text from brain recordings. Journal of Neural Engineering. 17(6), p.066015.(2020) [Google Scholar]
Wandelt, S.K., Bjånes, D.A., Pejsa, K., Lee, B., Liu, C. and Andersen, R.A. Online internal speech decoding from single neurons in a human participant. MedRxiv,11.02.22281775. (2022) [Google Scholar]
Willett F R, Kunz E M, Fan C, et al. A high- performance speech neuroprosthesis. Nature. 620(7976), pp.1031–1036.(2023) [Google Scholar]
Card N S, Wairagkar M, Iacobacci C, et al. An Accurate and Rapidly Calibrating Speech Neuroprosthesis. New England Journal of Medicine. 391(7), pp.609–618.(2024) [Google Scholar]
Mugler, E.M., Patton, J.L., Flint, R.D., Wright, Z.A., Schuele, S.U., Rosenow, J., Shih, J.J., Krusienski, D.J. and Slutzky, M.W. Direct classification of all American English phonemes using signals from functional speech motor cortex. Journal of Neural Engineering. 11(3), p.035015. (2014) [Google Scholar]
Tang, X., Shen, H., Zhao, S., Li, N. and Liu, J. Flexible brain–computer interfaces. Nature Electronics. 6(2), pp.109–118. (2023) [Google Scholar]
Ajani, T.S., Imoize, A.L. and Atayero, A.A. An Overview of Machine Learning within Embedded and Mobile Devices–Optimizations and Applications. Sensors. 21(13), p.4412. (2021) [Google Scholar]
Mridha, M.F., Das, S.C., Kabir, M.M., Lima, A.A., Islam, M.R. and Watanobe, Y. Brain-Computer Interface: Advancement and Challenges. Sensors. 21(17), p.5746. (2021) [Google Scholar]
Kohler, J., Ottenhoff, M.C., Goulis, S., Angrick, M., Colon, A.J., Wagner, L., Tousseyn, S., Kubben, P.L. and Herff, C. Synthesizing Speech from Intracranial Depth Electrodes using an Encoder-Decoder Framework. Neurons, Behavior, Data analysis, and Theory. 6(1). (2022) [Google Scholar]
Moses D A, Metzger S L, Liu J R, et al. Neuroprosthesis for Decoding Speech in a Paralyzed Person with Anarthria. New England Journal of Medicine. 385(3), pp.217–227. (2021) [Google Scholar]
Luo S, Angrick M, Coogan C, et al. Stable Decoding from a Speech BCI Enables Control for an Individual with ALS without Recalibration for 3 Months. Advanced Science. 10(35), p.2304853. (2023) [Google Scholar]
Anumanchipalli, G.K., Chartier, J. and Chang, E.F. Speech synthesis from neural decoding of spoken sentences. Nature. 568(7753), pp.493–498. (2019) [Google Scholar]
Ozcelik, F. and VanRullen, R. Natural scene reconstruction from fMRI signals using generative latent diffusion. Scientific Reports. 13(1), p.15666. (2023) [Google Scholar]
Lu, Y., Du, C., Zhou, Q., Wang, D. and He, H. MindDiffuser: Controlled Image Reconstruction from Human Brain Activity with Semantic and Structural Diffusion. Proceedings of the 31st ACM International Conference on Multimedia. pp.5899– 5908. (2023) [Google Scholar]
Ozcelik, F., Choksi, B., Mozafari, M., Reddy, L. and VanRullen, R. Reconstruction of Perceived Images from fMRI Patterns and Semantic Brain Exploration using Instance-Conditioned GANs. 2022 International Joint Conference on Neural Networks (IJCNN), pp.1–8. (2022) [Google Scholar]
Shen, G., Horikawa, T., Majima, K. and Kamitani, Y. Deep image reconstruction from human brain activity. PLOS Computational Biology. 15(1), p.e1006633. (2019) [Google Scholar]
Shimizu, H. and Srinivasan, R. Improving classification and reconstruction of imagined images from EEG signals. PLOS ONE. 17(9), p.e0274847. (2022) [Google Scholar]
Lorach H, Galvez A, Spagnolo V, Martel F, Karakas S, Intering N, et al. Walking naturally after spinal cord injury using a brain–spine interface. Nature. 618(7963), pp.126–133. (2023) [CrossRef] [PubMed] [Google Scholar]

Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.

Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.

Initial download of the metrics may take a while.