The dawn of large neural networks and their transformative impact on AI

The last two years have seen a dramatic growth of neural networks. Models such as Bert Large with its 345 million parameters which were considered huge just three years ago are being dwarfed by modern DNNs which are frequently more than 1000 times bigger. This growth is not driven by accademic vanity of the AI comunity but by their exceptional few shot learning capability. In contrast to their smaller counterparts that require thousands/tens of thousands of training samples to adapt to new tasks large models achieve state of the art performance with just a handful of samples fundamentally transforming the way we do AI. This revolution started in Natural Language Processing but is already transforming countless other disciplines like computer vision, automatic speach recognition, chmical compount modeling or protein modeling where very large unsupervised models are becoming a common practice. In this talk we will dive deeper into the properties of large DNNs and discuss the process of creating them, from data prepartion through distributed training to production deployment.

Adam Grzywaczewski

Adam Grzywaczewski

Senior Deep Learning Data Scientist at NVIDIA

Other sessions from: Learn with the AI Community around the world

Troubleshooting real-time business metrics with StarTree ThirdEye

Troubleshooting real-time business metrics with StarTree ThirdEye

StarTree ThirdEye is a source available anomaly detection platform that...

Madhumita Mantri Madhumita Mantri
Suvodeep Pyne Suvodeep Pyne
Airplane buddy matching using Azure Form Recognizer

Airplane buddy matching using Azure Form Recognizer

Let's dive into the computer vision world by designing a system that can a...

Radu Vunvulea Radu Vunvulea
Building a Responsible AI strategy

Building a Responsible AI strategy

FATE AI ( Fair, Accountable, Transparent, Ethical) What is Responsible AI?...

Sammy Deprez Sammy Deprez
Machine Learning Frameworks Interoperability

Machine Learning Frameworks Interoperability

To develop mature data science, machine learning, and deep learning applica...

Miguel Martínez Miguel Martínez
Christian Hundt Christian Hundt
AWS vs Azure vs Google AI

AWS vs Azure vs Google AI

In this presentation, awarded Google Developer Expert and Microsoft Most...

Chander Dhall Chander Dhall
Panel: Start to AI journey with Microsoft Azure

Panel: Start to AI journey with Microsoft Azure

Discussion around to begin the AI journey with Microsoft Azure. Learning Pa...

Kasam Shaikh Kasam Shaikh
Priyanka Shah Priyanka Shah
Abdul Rasheed Feroz Khan Abdul Rasheed Feroz Khan
Hatim Nagarwala Hatim Nagarwala