Skip to main content
Browse by:

Effective March 10, 2020, all Duke-sponsored events over 50 people have been cancelled, rescheduled, postponed or virtualized.
Please check with the event contact regarding event status. For more information, please see

+DS IPLE: Attention Networks for Natural Language Processing

Event Image
Icon calendar
Thursday, March 26, 2020
Icon time
4:30 pm - 6:30 pm
Icon location
Icon speaker
Lawrence Carin
Icon series
+DS In-Person Learning Experiences

Neural-network-based methods for natural language processing (NLP) constitute an area of significant recent technical progress, with many interesting real-world applications. The Transformer Network is one of the newest and most powerful approaches of this type. This algorithm is based on repeated application of attention networks, in an encoder-decoder framework. In this presentation the basics of all-attention models (the Transformer) for NLP will be described, with application in areas like text synthesis (e.g., suggesting email text) and language translation. This session is part of the Duke+Data Science (+DS) program in-person learning experiences (IPLEs). To learn more, please visit