The dawn of large neural networks and their transformative impact on AI

The last two years have seen a dramatic growth of neural networks. Models such as Bert Large with its 345 million parameters which were considered huge just three years ago are being dwarfed by modern DNNs which are frequently more than 1000 times bigger. This growth is not driven by accademic vanity of the AI comunity but by their exceptional few shot learning capability. In contrast to their smaller counterparts that require thousands/tens of thousands of training samples to adapt to new tasks large models achieve state of the art performance with just a handful of samples fundamentally transforming the way we do AI. This revolution started in Natural Language Processing but is already transforming countless other disciplines like computer vision, automatic speach recognition, chmical compount modeling or protein modeling where very large unsupervised models are becoming a common practice. In this talk we will dive deeper into the properties of large DNNs and discuss the process of creating them, from data prepartion through distributed training to production deployment.

Adam Grzywaczewski

Adam Grzywaczewski

Senior Deep Learning Data Scientist at NVIDIA

Other sessions from: Learn with the AI Community around the world

Building a SmartMirror with 15+ Azure AI Cognitive Services

Building a SmartMirror with 15+ Azure AI Cognitive Services

Speech Technologies, ComputerVision, Internet of Things, ... a picture for ...

Jean-Philippe Encausse Jean-Philippe Encausse
AI for the better

AI for the better

Do you want to be inspired what AI can do for the better (life of people of...

Dennie Declercq Dennie Declercq
Spoken or written speech insights with AI and Azure Cognitive Services.

Spoken or written speech insights with AI and Azure Cognitive Services.

Join this session to learn how valuable data insights from text or audio ca...

Catalin Popa Catalin Popa
Machine Learning Frameworks Interoperability

Machine Learning Frameworks Interoperability

To develop mature data science, machine learning, and deep learning applica...

Miguel Martínez Miguel Martínez
Christian Hundt Christian Hundt
The price is right! - Machine Learning thinking of costs

The price is right! - Machine Learning thinking of costs

From an academic point of view, Machine Learning models generally try to mi...

Pau Sempere Pau Sempere
Building a Responsible AI strategy

Building a Responsible AI strategy

FATE AI ( Fair, Accountable, Transparent, Ethical) What is Responsible AI?...

Sammy Deprez Sammy Deprez