{"id":33999,"date":"2022-08-03T07:27:47","date_gmt":"2022-08-03T07:27:47","guid":{"rendered":"https:\/\/harchi90.com\/mit-researchers-create-artificial-synapses-10000x-faster-than-biological-ones\/"},"modified":"2022-08-03T07:27:47","modified_gmt":"2022-08-03T07:27:47","slug":"mit-researchers-create-artificial-synapses-10000x-faster-than-biological-ones","status":"publish","type":"post","link":"https:\/\/harchi90.com\/mit-researchers-create-artificial-synapses-10000x-faster-than-biological-ones\/","title":{"rendered":"MIT Researchers Create Artificial Synapses 10,000x Faster Than Biological Ones"},"content":{"rendered":"
\n

Researchers have been trying to build artificial synapses for years in the hope of getting close to the unrivaled computational performance of the human brain. A new approach has now managed to design ones that are 1,000 times smaller and 10,000 times faster than their biological counterparts.<\/span><\/p>\n

Despite the runaway success of deep learning over the past decade, this brain-inspired approach to AI faces the challenge that it is running on hardware that bears little resemblance to real brains. This is a big part of the reason why a human brain weighing just three pounds can pick up new tasks in seconds using the same amount of power as a light bulb, while training the largest neural networks takes weeks, megawatt hours of electricity, and racks of specialized processors.<\/span><\/p>\n

That’s prompting growing interest in efforts to redesign the underlying hardware AI runs on. The idea is that by building computer chips whose components act more like natural neurons and synapses, we might be able to approach the extreme space and energy efficiency of the human brain. The hope is that these so-called \u201cneuromorphic\u201d processors could be much better suited to running AI than today’s computer chips.<\/span><\/p>\n

Now researchers from MIT have shown that an unusual artificial synapse design that mimics the brain’s reliance on shuttling ions around could actually significantly outperform biological ones. The key breakthrough was finding a material that tolerates extreme electric fields, which dramatically improved the speed with which ions could move.<\/span><\/p>\n

\u201cThe speed was certainly surprising,\u201d Murat Onen, who led the research, <\/span>said in a press release<\/span><\/span>. \u201cNormally, we would not apply such extreme fields across devices, in order to not turn them into ash. But instead, protons [which are equivalent to hydrogen ions] ended up shuttling at immense speeds across the device stack, specifically a million times faster compared to what we had before.\u201d<\/span><\/p>\n

While there are <\/span>a <\/span>variety of approaches to neuromorphic engineering, one of the most promising is analogue computing. This seeks to design components that can exploit their internal physics to process information, which is much more efficient and direct than carrying out complex logic operations like conventional chips do.<\/span><\/p>\n

So far, a lot of research has focused on designing \u201cmemristors\u201d\u2014electronic components that control the flow of current based on how much charge has previously flow<\/span>ed<\/span> through the device. This mimics the way that connections between biological neurons increase or decrease in strength depending on the frequency with which they communicate, which means these devices could in principle be used to create networks with similar properties to biological neural networks.<\/span><\/p>\n

Perhaps unsurprisingly, these devices are often built using memory technologies. But in a new<\/span> paper in<\/span><\/span> Science<\/span><\/span><\/em>,<\/span><\/em> the MIT argues that components optimized for long-term information storage are actually ill-suited to carrying out the regular state transitions required to continually tune connection strengths in an artificial neural network. That’s because physical properties that ensure long retention times are typically not complimentary to those that allow high-speed switching.<\/span><\/p>\n

This is why the researchers have instead designed a component whose conductivity is regulated by the insertion or removal of protons into a channel made of phosphosilicate glass (PSG). To a certain extent, this mimics the behavior of biological synapses, which use ions to transmit signals across the gap between two neurons.<\/span><\/p>\n

However, that’s where the similarit<\/span>ies<\/span> end. The device features two terminals that are essentially the input and the output of the synapse. A third terminal is used to apply an electric field, which stimulates protons to move from a reservoir into the PSG channel or vice versa depending on the direction of the electric field. More protons in the channel increase its resistance.<\/span><\/p>\n

the researchers <\/span>came<\/span> up with this <\/span>general design back in 2020<\/span><\/span>, but their earlier device used materials that were not compatible with chip design processes. But more importantly, the switch to PSG has dramatically increased the switching speed of their device. That’s because nano-sized pores in its structure enable the protons to move very quickly through the material, and also because it can withstand very strong electric field pulses without degrading.<\/span><\/p>\n

More powerful electrical fields give the protons a massive speed boost and are key to the device’s ability to outperform biological synapses. In the brain, electric fields have to be kept relatively weak because anything over 1.23 volts (V) causes the water that make<\/span>s<\/span> up the bulk of cells to split into hydrogen and oxygen gas. This is largely why processes occur on the scale of milliseconds.<\/span><\/p>\n

In contrast, the MIT team’s device is capable of operating at up to 10 volts in pulses as short as 5 nanoseconds. This allows the artificial synapse to operate 10,000 times faster than its biological counterpart<\/span>s<\/span>. On top of that, the devices are only nanometers across, making them 1,000 times smaller than biological synapses.<\/span><\/p>\n

experts <\/span>told <\/span><\/span>New Scientist<\/span><\/span><\/em> that the device’s three-terminal setup, as opposed to the two found in most neuron models, might make it difficult to run certain kinds of neural networks. The fact that the protons have to be introduced using hydrogen gas also presents challenges when scaling the technology up.<\/span><\/p>\n

There’s a long way to go from an individual artificial synapse to large networks that are capable of carrying out serious information processing. But the exceptional speed and tiny size of the components suggest that this is a promising direction in the search for new hardware that can match or even exceed the power of the human brain.<\/span><\/p>\n

Image Credit: Ella Maru Studio\/Murat Onen<\/em><\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

Researchers have been trying to build artificial synapses for years in the hope of getting close to the unrivaled computational performance of the human brain. A new approach has now managed to design ones that are 1,000 times smaller and 10,000 times faster than their biological counterparts. Despite the runaway success of deep learning over …<\/p>\n

MIT Researchers Create Artificial Synapses 10,000x Faster Than Biological Ones<\/span> Read More »<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-global-header-display":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true},"categories":[4],"tags":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":29210,"url":"https:\/\/harchi90.com\/new-hardware-offers-faster-computation-for-artificial-intelligence-with-much-less-energy\/","url_meta":{"origin":33999,"position":0},"title":"New hardware offers faster computation for artificial intelligence, with much less energy","date":"July 29, 2022","format":false,"excerpt":"An analog deep learning processor powered by ultrafast protonics. Credit: Ella Maru Studio, Murat Onen As scientists push the boundaries of machine learning, the amount of time, energy, and money required to train increasingly complex neural network models is skyrocketing. A new area of \u200b\u200bartificial intelligence called analog deep learning\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"New hardware offers faster computation for artificial intelligence, with much less energy","src":"https:\/\/i0.wp.com\/scx1.b-cdn.net\/csz\/news\/800a\/2022\/new-hardware-offers-fa.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":1065,"url":"https:\/\/harchi90.com\/anti-anxiety-drugs-can-interfere-with-a-persons-neurons-and-increase-risk-of-cognitive-decline\/","url_meta":{"origin":33999,"position":1},"title":"Anti-anxiety drugs can interfere with a person’s neurons and increase risk of cognitive decline","date":"July 1, 2022","format":false,"excerpt":"Anti-anxiety drugs can interfere with a person's neurons and increase their risk of cognitive decline later in life, study findsResearchers have discovered the reason why anti-anxiety medications put users at risk of dementia down the lineThe medications can cause damage to the brain's microglial cells - which in turn damage\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"Researchers discovered why anxiety medication can lead to brain issues later in a person's life, and hope they have opened the door for a new class of medication that does not put users at risk of suffering from cognitive decline (file photo)","src":"https:\/\/i0.wp.com\/i.dailymail.co.uk\/1s\/2022\/06\/30\/21\/59729861-10970837-image-a-26_1656620616952.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":15854,"url":"https:\/\/harchi90.com\/all-that-video-gaming-could-be-boosting-an-unexpected-life-skill-new-study-finds\/","url_meta":{"origin":33999,"position":2},"title":"All That Video Gaming Could Be Boosting an Unexpected Life Skill, New Study Finds","date":"July 16, 2022","format":false,"excerpt":"As a hobby, video gaming can get some bad press when it comes to its effects on our physical and mental health \u2013 and it has been well established that sitting still all day isn't especially good for us. However, done in moderation, there are upsides to video gaming.A new\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":19854,"url":"https:\/\/harchi90.com\/powerful-ai-can-finish-your-sentences-but-struggle-most-times-to-find-solutions-to-basic-tasks\/","url_meta":{"origin":33999,"position":3},"title":"Powerful AI can finish your sentences, but struggle most times to find solutions to basic tasks","date":"July 20, 2022","format":false,"excerpt":"The tech industry's latest artificial intelligence constructs can be pretty convincing if you ask them what it feels like to be a sentient computer, or maybe just a dinosaur or squirrel. But they're not so good - and sometimes dangerously bad - at handling other seemingly straightforward tasks. Take, for\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":29550,"url":"https:\/\/harchi90.com\/free-ai-tool-restores-old-photos-by-creating-slightly-new-loved-ones\/","url_meta":{"origin":33999,"position":4},"title":"Free AI tool restores old photos by creating slightly new loved ones","date":"July 29, 2022","format":false,"excerpt":"You can find AI that creates new images, but what if you want to fix an old family photo? You might have a no-charge option. Louis Bouchard and PetaPixel have drawn attention to a free tool recently developed by Tencent researchers, GFP-GAN (Generative Facial Prior-Generative Adversarial Network), that can restore\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"fifu_image_url":"https:\/\/singularityhub.com\/wp-content\/uploads\/2022\/08\/MIT-PhotonicResistors-01-press_0.jpg","_links":{"self":[{"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/posts\/33999"}],"collection":[{"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/comments?post=33999"}],"version-history":[{"count":0,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/posts\/33999\/revisions"}],"wp:attachment":[{"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/media?parent=33999"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/categories?post=33999"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/harchi90.com\/wp-json\/wp\/v2\/tags?post=33999"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}