NVIDIA Puzzle 75B: A 120B Model Squeezed onto ONE GPU

NVIDIA Puzzle 75B: A 120B Model Squeezed onto ONE GPU

More

Descriptions:

This video locally installs and tests Nemotron-Labs-3-Puzzle-75B-A9B, a deployment-optimized model which is produced using Iterative Puzzle.

🔥 Buy Me a Coffee to support the channel: https://ko-fi.com/fahdmirza

🔥 Get 50% Discount on any A6000 or A5000 GPU rental, use following link and coupon:

https://bit.ly/fahd-mirza
Coupon code: FahdMirza

#nvidiapuzzle

PLEASE FOLLOW ME:
â–¶ LinkedIn: https://www.linkedin.com/in/fahdmirza/
â–¶ YouTube: https://www.youtube.com/@fahdmirza
â–¶ Blog: https://www.fahdmirza.com

RELATED VIDEOS:

â–¶ https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8

All rights reserved © Fahd Mirza

1 Item

Channels

1 Item

Companies