Smarter training of neural networks

These days, nearly all the artificial intelligence-based products in our lives rely on “deep neural networks” that automatically learn to process labeled data. For most organizations and individuals, though, deep learning is tough to break into. To learn well, neural networks normally have to be quite large and need massive datasets. This training process usually requires multiple days of training and expensive graphics processing units (GPUs) — and sometimes even custom-designed hardware. But what if they don’t actually have to be all that big, after all? In a new paper, researchers from MIT’s Computer Science and Artificial Intelligence Lab (CSAIL) have shown that neural networks contain subnetworks that are up to one-tenth the size yet capable of being trained to make equally accurate predictions — and sometimes can learn to do so even faster than the originals. The team’s approach isn’t particularly efficient now — they must train and “prune” Continue reading Smarter training of neural networks

IEEE Spectrum Introduces Drones and 360 Video to Its Reporting

To produce 360 videos, reporters navigated technical challenges and red tape Reporters used to head out into the field with nothing but a notebook. But when IEEE Spectrum associate editor Michael Koziol [left] and contributing editor Evan Ackerman [right] traveled to East Africa last October, they had plenty more gear to schlep. In addition to their laptops and digital recorders, they brought two DJI drones and an assortment of 360-degree video cameras.  The trip was part of an experiment in immersive storytelling. Koziol and Ackerman journeyed through Rwanda and Tanzania to report on pioneering companies that are using small consumer drones for such tasks as delivering medical supplies and surveying roads. The two gathered material for several articles, including a feature story about a company called Zipline that’s delivering blood to Rwanda’s rural hospitals. They also sent their own drones aloft bearing their cameras, capturing footage for two videos included Continue reading IEEE Spectrum Introduces Drones and 360 Video to Its Reporting