Tech News
← Home  ·  All topics

Dzmitry Bahdanau

1 GoKawiil brief on this topic

Google researchers trace modern AI's roots to 2014 'attention' breakthrough by intern Dzmitry Bahdanau

A feature recounts how in 2014, University of Montreal intern Dzmitry Bahdanau, working under Yoshua Bengio and Kyunghyun Cho, developed an 'attention' mechanism for neural networks tackling English-to-French translation. That innovation, which let models weigh which parts of input mattered most, is described as a foundational step leading toward today's large language models like ChatGPT.