Download video

ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed

66 views

Microsoft Research

2 days ago

ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed

ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed

How to solve 2by2 Rubik’s cube in 5 minutes
9:07
How to solve 2by2 Rubik’s cube in 5 minutes
by King of cubers18
Spyro 2 NG+ Any% 5:57.900
12:29
Spyro 2 NG+ Any% 5:57.900
by Brad
Super Expert No Skips: You Can Grab This? (Mario Maker 2)
33:15
Super Expert No Skips: You Can Grab This? (Mario Maker 2)
by xeroplanes
🚨 YOU STILL THINK COKE ZERO IS HEALTHIER? WATCH THIS BEFORE YOUR NEXT SIP
5:11
🚨 YOU STILL THINK COKE ZERO IS HEALTHIER? WATCH THIS BEFORE YOUR NEXT SIP
by Make Tips
5 SCIENTIFIC SECRETS TO BEAT BELLY FAT (AND AVOID DIABETES)
20:24
5 SCIENTIFIC SECRETS TO BEAT BELLY FAT (AND AVOID DIABETES)
by Easy Health
Quick Breakfast Ready in 5 Minutes Using Only 3 Ingredients? UNBELIEVABLE!
3:52
Quick Breakfast Ready in 5 Minutes Using Only 3 Ingredients? UNBELIEVABLE!
by Be Strong Recipe
The Crucial Factor In Enhancing Productivity
13:40
The Crucial Factor In Enhancing Productivity
by Be Strong
BLENDER QUICK TIP: SCALE ALONG NORMALS
1:46
BLENDER QUICK TIP: SCALE ALONG NORMALS
by zerobio
Zero to Ironman: EP 11 - Learning To Swim Like A Pro ft. Effortless Swimming
11:58
Zero to Ironman: EP 11 - Learning To Swim Like A Pro ft. Effortless Swimming
by Brody Searle
ZERO CARB BREAD with ONLY 2 Ingredients! CHEAP, No Flour, High Fiber, High Protein And Healthy
14:12
ZERO CARB BREAD with ONLY 2 Ingredients! CHEAP, No Flour, High Fiber, High Protein And Healthy
by Prolong Your Life
Lets suffer in kingdom hearts II (learning no hit bosses)
1:19:03
Lets suffer in kingdom hearts II (learning no hit bosses)
by kamenridersolo
Only 2 Ingredients! No Sugar, No Cream in 1 minute! 🍓🍨
3:38
Only 2 Ingredients! No Sugar, No Cream in 1 minute! 🍓🍨
by Express Kitchen - DIY
Super Mario Galaxy 2 Any% Speedrun in 3:03:11 (PB on 6\/12\/2025)
3:10:41
Super Mario Galaxy 2 Any% Speedrun in 3:03:11 (PB on 6\/12\/2025)
by BaronBrrrrett
Super Expert No Skips: Jank So Good I Had to Like (Mario Maker 2)
24:56
Super Expert No Skips: Jank So Good I Had to Like (Mario Maker 2)
by xeroplanes
There’s no such thing as safe and healthy “rapid weight loss”
3:24
There’s no such thing as safe and healthy “rapid weight loss”
by Practical Growth with E.B. Johnson
Simple And Delicious Breakfast in 5minutes (Easy Recipe)
4:48
Simple And Delicious Breakfast in 5minutes (Easy Recipe)
by Be Strong Recipe
How to improve your life under 59 seconds. (no bs)
0:47
How to improve your life under 59 seconds. (no bs)
by job.
Super Expert No Skips: Climb or 1-ups? (Mario Maker 2)
36:22
Super Expert No Skips: Climb or 1-ups? (Mario Maker 2)
by xeroplanes
Super Expert No Skips: They Want What Now? (Mario Maker 2)
29:18
Super Expert No Skips: They Want What Now? (Mario Maker 2)
by xeroplanes
How to make healthy dessert at home? Coconut 🥥 barfi so yummy.Ghar ke besik saman se banaye barfi.
4:53
How to make healthy dessert at home? Coconut 🥥 barfi so yummy.Ghar ke besik saman se banaye barfi.
by COOK IT EASY
Caramelized Banana Frozen Yogurt | No Added Sugar, Healthy Dessert Recipe 🍌🍦
23:41
Caramelized Banana Frozen Yogurt | No Added Sugar, Healthy Dessert Recipe 🍌🍦
by Morganic Essentials
3 ingredients dessert recipe | no sugar | no oven | no gelatin
2:28
3 ingredients dessert recipe | no sugar | no oven | no gelatin
by Quick \& Yummy Recipes