• Home
  • News
  • Apps
  • Guides
  • Tech
  • Gaming
  • Apple
  • Mobile
  • Windows
  • Hardware

Subscribe to Updates

Get the latest creative news from FooBar about art, design and business.

What's Hot

Apple Expands App Retailer Age Score System With Extra Granular Classes

Video-Sharing App Vine Is Returning ‘In AI Type’, Says Elon Musk

OTT Releases This Week (July 21 – July 27): Mandala Murders, Ronth, Rangeen, and Extra

Facebook Twitter Instagram
Tech Crowder
  • Home
  • News
  • Apps
  • Guides
  • Tech
  • Gaming
  • Apple
  • Mobile
  • Windows
  • Hardware
Facebook Twitter Instagram
Tech Crowder
Home»Latest Posts»Nvidia unveils H200, its latest high-end chip for coaching AI fashions
Latest Posts

Nvidia unveils H200, its latest high-end chip for coaching AI fashions

Rudra SharmaBy Rudra SharmaUpdated:No Comments3 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Nvidia unveils H200, its latest high-end chip for coaching AI fashions
Share
Facebook Twitter LinkedIn Pinterest Telegram Email

Jensen Huang, president of Nvidia, holding the Grace hopper superchip CPU used for generative AI on the Supermicro keynote presentation throughout Computex 2023.

Walid Berrazeg | Lightrocket | Getty Photographs

Advertisement

Nvidia on Monday unveiled the H200, a graphics processing unit designed for coaching and deploying the sorts of synthetic intelligence fashions which can be powering the generative AI increase.

The brand new GPU is an improve from the H100, the chip OpenAI used to coach its most superior massive language mannequin, GPT-4. Huge firms, startups and authorities companies are all vying for a restricted provide of the chips.

H100 chips value between $25,000 and $40,000, in accordance with an estimate from Raymond James, and 1000’s of them working collectively are wanted to create the most important fashions in a course of known as “coaching.”

Pleasure over Nvidia’s AI GPUs has supercharged the corporate’s inventory, which is up greater than 230% up to now in 2023. Nvidia expects round $16 billion of income for its fiscal third quarter, up 170% from a 12 months in the past.

The important thing enchancment with the H200 is that it contains 141GB of next-generation “HBM3” reminiscence that can assist the chip carry out “inference,” or utilizing a big mannequin after it is skilled to generate textual content, pictures or predictions.

Nvidia stated the H200 will generate output practically twice as quick because the H100. That is primarily based on a take a look at utilizing Meta’s Llama 2 LLM.

The H200, which is anticipated to ship within the second quarter of 2024, will compete with AMD’s MI300X GPU. AMD’s chip, much like the H200, has extra reminiscence over its predecessors, which helps match huge fashions on the {hardware} to run inference.

Nvidia H200 chips in an eight-GPU Nvidia HGX system.

Nvidia

Nvidia stated the H200 shall be appropriate with the H100, which means that AI firms who’re already coaching with the prior mannequin will not want to vary their server methods or software program to make use of the brand new model.

Nvidia says will probably be out there in four-GPU or eight-GPU server configurations on the corporate’s HGX full methods, in addition to in a chip known as GH200, which pairs the H200 GPU with an Arm-based processor.

Nevertheless, the H200 might not maintain the crown of the quickest Nvidia AI chip for lengthy.

Whereas firms like Nvidia supply many alternative configurations of their chips, new semiconductors typically take an enormous step ahead about each two years, when producers transfer to a special structure that unlocks extra vital efficiency beneficial properties than including reminiscence or different smaller optimizations. Each the H100 and H200 are primarily based on Nvidia’s Hopper structure.

In October, Nvidia informed traders that it will transfer from a two-year structure cadence to a one-year launch sample resulting from excessive demand for its GPUs. The corporate displayed a slide suggesting it is going to announce and launch its B100 chip, primarily based on the forthcoming Blackwell structure, in 2024.

WATCH: We’re an enormous believer within the AI development going into subsequent 12 months

We're a big believer in the A.I. trend going into next year, says Wolfe Research's Chris Caso

Do not miss these tales from CNBC PRO:

Advertisement
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Rudra Sharma
  • Website

Techcrowder is an imprint of Authority Media dedicated to consumer electronics and digital services. Beyond our expertise in mobile tech, our coverage has expanded to include everything from robot vacuums to streaming services to innovations in artificial intelligence.

Related Posts

Sundar Pichai hits $1.1 billion internet value as Alphabet’s AI-led surge provides over $1 trillion in worth

CoreWeave broadcasts $1.5 billion bond sale

Mark Zuckerberg’s Meta recruits two key Apple AI engineers after luring staff chief

Joby Aviation says it’s doubling manufacturing manufacturing

Amazon Prime Day Sale 2025: Greatest earphones and headphone offers with as much as 70% off

Perplexity launches AI-powered net browser for choose subscribers

Leave A Reply Cancel Reply

Advertisement
Recent Posts
  • Apple Expands App Retailer Age Score System With Extra Granular Classes
  • Video-Sharing App Vine Is Returning ‘In AI Type’, Says Elon Musk
  • OTT Releases This Week (July 21 – July 27): Mandala Murders, Ronth, Rangeen, and Extra
  • Sundar Pichai hits $1.1 billion internet value as Alphabet’s AI-led surge provides over $1 trillion in worth
  • WhatsApp for Android Stated to Be Testing Actual-Time Voice Chats With Meta AI
  • Facebook
  • Twitter
  • Pinterest
  • Instagram
  • YouTube
  • Vimeo
Don't Miss
Apps

Apple Expands App Retailer Age Score System With Extra Granular Classes

Apple’s App Retailer age ranking system is getting an overhaul, the corporate introduced on Thursday.…

Video-Sharing App Vine Is Returning ‘In AI Type’, Says Elon Musk

OTT Releases This Week (July 21 – July 27): Mandala Murders, Ronth, Rangeen, and Extra

Sundar Pichai hits $1.1 billion internet value as Alphabet’s AI-led surge provides over $1 trillion in worth

Advertisement
Latest Posts

Apple Expands App Retailer Age Score System With Extra Granular Classes

Video-Sharing App Vine Is Returning ‘In AI Type’, Says Elon Musk

OTT Releases This Week (July 21 – July 27): Mandala Murders, Ronth, Rangeen, and Extra

Sundar Pichai hits $1.1 billion internet value as Alphabet’s AI-led surge provides over $1 trillion in worth

WhatsApp for Android Stated to Be Testing Actual-Time Voice Chats With Meta AI

Google I/O Join India 2025: Eight Indian Startups Showcased Functions Constructed With Google’s AI Fashions

Child and Child Now Streaming on Aha Tamil: Know Every thing about Solid, Crew, Plot, and extra

Dude OTT Launch Reportedly Revealed On-line: What You Must Know About Pradeep Rangathan Starrer Film

Categories
  • Apps
  • Entertainment
  • Gadgets
  • Gaming
  • Latest Posts

Apple Expands App Retailer Age Score System With Extra Granular Classes

Video-Sharing App Vine Is Returning ‘In AI Type’, Says Elon Musk

OTT Releases This Week (July 21 – July 27): Mandala Murders, Ronth, Rangeen, and Extra

Sundar Pichai hits $1.1 billion internet value as Alphabet’s AI-led surge provides over $1 trillion in worth

Recent Posts
  • Apple Expands App Retailer Age Score System With Extra Granular Classes
  • Video-Sharing App Vine Is Returning ‘In AI Type’, Says Elon Musk
  • OTT Releases This Week (July 21 – July 27): Mandala Murders, Ronth, Rangeen, and Extra
  • Sundar Pichai hits $1.1 billion internet value as Alphabet’s AI-led surge provides over $1 trillion in worth
  • WhatsApp for Android Stated to Be Testing Actual-Time Voice Chats With Meta AI
Pages
  • About Us
  • Contact Us
  • Disclaimer
  • Homepage
  • Privacy Policy
© 2022 Techcrowder.com
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy

Type above and press Enter to search. Press Esc to cancel.

Like Us
Follow Us
Subscribe Us
Follow Us