![\"\"](\"https:\/\/images.newscientist.com\/wp-content\/uploads\/2024\/12\/06211329\/SEI_232166506.jpg\")
<\/div>The prototype of an IBM optics module for connecting chips with fibre optics<\/p>\n
Ryan Lavine for IBM<\/p>\n<\/div>\n<\/figcaption><\/figure>\n<\/p>\n
An optical fibre technology can help chips communicate with each other at the speed of light, enabling them to transmit 80 times as much information as they could using traditional electrical connections. That could significantly speed up the training times required for large artificial intelligence models \u2013 from months to weeks \u2013 while also reducing the energy and emissions costs for data centres.<\/p>\n
Most advanced computer chips still communicate using electrical signals carried over copper wires. But as the tech industry races to train large AI models \u2013 a process that requires networks of AI superchips<\/a> to transfer huge amounts of data \u2013 companies are eager to link chips using the light-speed communication of fibre optics.<\/p>\n This technology isn\u2019t new: the internet already relies on undersea fibre-optic cables stretching thousands of kilometres between continents. In order to transmit data between fingernail-size chips, however, companies must connect as many hair-thin optical fibres as possible to the edge of each chip.<\/p>\n \u201cAs we all know, the best communication technology is fibre optics, and that\u2019s why fibre optics is used everywhere else for long-distance communication,\u201d said Mukesh Khare<\/a> at IBM Research during a press briefing previewing the technology. \u201cThis co-packaged optics innovation is basically bringing the power of fibre optics on the chip itself.\u201d<\/p>\n <\/p>\n Khare and his colleagues have developed an optics module that would enable chipmakers to add six times as many optical fibres to the edge of a chip, compared to current technologies. The module uses a structure called an optical waveguide to connect as many as 51 optical fibres per millimetre. It also prevents light signals from one fibre from interfering with its neighbours.<\/p>\n \u201cWhat IBM has really done here is use all of its materials and packaging technology \u2013 the history of leadership in that \u2013 to really break through how you do high-density fibre optics by using waveguides,\u201d says Dan Hutcheson<\/a> at TechInsights, a semiconductor tech research firm headquartered in Canada. \u201cTo me, that was the big breakthrough when I saw it.\u201d<\/p>\n The resulting boost in communication between chips could enable AI developers to train a large language model within three weeks instead of three months. Switching from electrical wires to optical fibres for chip communication could also mean a fivefold reduction in the energy cost of training such AI models.<\/p>\n IBM has already put the optical module through stress tests that included high humidity and temperatures ranging from -40\u00b0C (-40\u00b0F) to 125\u00b0C (257\u00b0F). Hutcheson expects that major semiconductor manufacturing<\/a> companies may be interested in licensing the technology.<\/p>\n \u201cWe\u2019re really in the early days of all this, but it\u2019s the hottest area in semiconductor technology right now in terms of high-performance computing and AI technology,\u201d he says.<\/p>\n Topics:<\/p>\n