The dawn of large neural networks and their transformative impact on AI

The last two years have seen a dramatic growth of neural networks. Models such as Bert Large with its 345 million parameters which were considered huge just three years ago are being dwarfed by modern DNNs which are frequently more than 1000 times bigger. This growth is not driven by accademic vanity of the AI comunity but by their exceptional few shot learning capability. In contrast to their smaller counterparts that require thousands/tens of thousands of training samples to adapt to new tasks large models achieve state of the art performance with just a handful of samples fundamentally transforming the way we do AI. This revolution started in Natural Language Processing but is already transforming countless other disciplines like computer vision, automatic speach recognition, chmical compount modeling or protein modeling where very large unsupervised models are becoming a common practice. In this talk we will dive deeper into the properties of large DNNs and discuss the process of creating them, from data prepartion through distributed training to production deployment.

Adam Grzywaczewski

Adam Grzywaczewski

Senior Deep Learning Data Scientist at NVIDIA

Other sessions from: Learn with the AI Community around the world

Panel: Start to AI journey with Microsoft Azure

Panel: Start to AI journey with Microsoft Azure

Discussion around to begin the AI journey with Microsoft Azure. Learning Pa...

Kasam Shaikh Kasam Shaikh
Priyanka Shah Priyanka Shah
Abdul Rasheed Feroz Khan Abdul Rasheed Feroz Khan
Hatim Nagarwala Hatim Nagarwala
Finding Dory using MS Custom Vision API

Finding Dory using MS Custom Vision API

Dory (my fish) is lost in the deep ocean. Let's go on mission to find Dory...

Vedant Bahel Vedant Bahel
Speak to your Power App

Speak to your Power App

Use Azure Cognitive Services to speak to your Power App and convert your...

Roberto Corella Roberto Corella
Building a SmartMirror with 15+ Azure AI Cognitive Services

Building a SmartMirror with 15+ Azure AI Cognitive Services

Speech Technologies, ComputerVision, Internet of Things, ... a picture for ...

Jean-Philippe Encausse Jean-Philippe Encausse
Spoken or written speech insights with AI and Azure Cognitive Services.

Spoken or written speech insights with AI and Azure Cognitive Services.

Join this session to learn how valuable data insights from text or audio ca...

Catalin Popa Catalin Popa
Let's talk GANs

Let's talk GANs

In this session we would be talking about what Generative Adversarial Ne...

Rohan Raj Rohan Raj