Skip to main content
Browse by:

Effective March 10, 2020, all Duke-sponsored events over 50 people have been cancelled, rescheduled, postponed or virtualized.
Please check with the event contact regarding event status. For more information, please see

Learning Two-Layer Neural Networks with Symmetric Inputs

Event Image
Icon calendar
Wednesday, February 27, 2019
Icon time
12:00 pm - 1:00 pm
Icon speaker
Rong Ge (Duke University, Computer Science)
Icon series
Applied Math And Analysis Seminar

Deep learning has been extremely successful in practice. However, existing guarantees for learning neural networks are limited even when the network has only two layers - they require strong assumptions either on the input distribution or on the norm of the weight vectors. In this talk we give a new algorithm that is guaranteed to learn a two-layer neural network under much milder assumptions on the input distribution. Our algorithms works whenever the input distribution is symmetric - which means two inputs x and ¿x have the same probability.

Based on joint work with Rohith Kuditipudi, Zhize Li and Xiang Wang