Scaling Distributed Machine Learning with In-Network Aggregation
KAUST: King Abdullah University of Science and Technology –
Training complex machine learning models in parallel is an increasingly important workload. We accelerate distributed parallel training by designing a communication primitive that uses a programmable switch dataplane to execute a key step of the training process. Our approach reduces the volume of exchanged data by aggregating the model updates from multiple workers in the network. We co-design the switch processing with the end-host protocols and ML frameworks to provide a robust, efficient solution that speeds up training by up to 310%, and at least by 20% in most cases for a number of real-world benchmark models.
Marco does not know what the next big thing will be. But he’s sure that our next-gen computing and networking infrastructure must be a viable platform for it and avoid stifling innovation. Marco’s research area is cloud computing, distributed systems and networking. His current interest is in designing better systems support for AI/ML and provide practical implementations deployable in the real-world.
Marco is an associate professor in Computer Science at KAUST. Marco obtained his Ph.D. in computer science and engineering from the University of Genoa in 2009 after spending the last year as a visiting student at the University of Cambridge, Computer Laboratory. He was a postdoctoral researcher at EPFL from 2009 to 2012 and after that a senior research scientist for one year at Deutsche Telekom Innovation Labs & TU Berlin. Before joining KAUST, he was an assistant professor at the UCLouvain. He also held positions at Intel, Microsoft and Google.
Date: 2019-Nov-15 Time: 15:00:00 Room: 020
For more information:
IEEE International Conference on Software Testing, Verification and Validation (ICST) 2020
IEEE International Conference on Software Testing, Verification and Validation (ICST) 2020 will take place between the 24th and 28th of October at Alfândega Porto Congress Centre, in Porto.
ICST 2020 aims to supply a common forum for researchers, scientists, engineers and practitioners all over the world to present their latest research findings, ideas, developments and applications in the area of Software Testing, Verification and Validation.
Energy Virtual Experience – EVEx 2020
The event “Energy Virtual Experience” ( EVEx 2020) will take place online, from 23rd to 27th November 2020.
“Energy Virtual Experience” will provide 4 different interactive experiences: EVEx Talks, EVEx MasterClass, EVEx Academy, and EVEx Expo/Busines. These four experiences will be centered on “Ibero-American post-pandemic energy transition”.
Looking to stimulate interdisciplinary studies and innovative solutions in energy area, call for papers and projects will be launched soon.
INESC-ID researcher and IST Professor, Rui Castro, is member of the scientific committee of EVEx 2020.
|More information will be coming soon|