Back to

Top5 Challenges in Large-Scale AI Inference Workloads

Quinn

InfiniBand Network Architect · Apr 24, 202613340AI Networking

Find the best fit for your network needs

Copy Link

800GBASE-2xSR4 OSFP PAM4 850nm 50m MMF Module

Learn More

Popular

1Optimizing AI Inference Workloads: Reducing Latency, Boosting Throughput, and Cutting Costs
2Analysis of Prefix Caching in Large Language Model Inference
3Training vs Inference: Why Your AI Network Architecture Needs to Be Different
4NVIDIA DGX Rubin NVL8 Technical Analysis: AI Training and Inference Accelerator

Let's Chat

First Name*

Last Name*

Email Address*

Company / Organization

Country/Region*

United States

United Kingdom

Canada

Australia

France

Germany (Deutschland)

Spain (España)

Italy (Italia)

Netherlands

India

Brazil

Switzerland

Afghanistan

Albania

Algeria

American Samoa

Andorra

Angola

Anguilla

Antigua and Barbuda

Argentina

Armenia

Aruba

Austria

Azerbaijan

Bahamas

Bahrain

Bangladesh

Barbados

Belgium

Belize

Benin

Bermuda

Bhutan

Bolivia

Bosnia and Herzegovina

Botswana

British Indian Ocean Territory

Brunei Darussalam

Bulgaria

Burkina Faso

Cambodia

Cameroon

Cape Verde

Cayman Islands

Chad

Chile

China

Christmas Island

Cocos (Keeling) Islands

Colombia

Comoros

Cook Islands

Costa Rica

Cote D'Ivoire

Croatia

Cyprus

Czech Republic

Denmark

Djibouti

Dominica

Dominican Republic

Timor-Leste

Ecuador

Egypt

El Salvador

Equatorial Guinea

Eritrea

Estonia

Ethiopia

Falkland Islands (Malvinas)

Faroe Islands

Fiji

Finland

French Guiana

French Polynesia

French Southern Territories

Gabon

Gambia

Georgia

Ghana

Gibraltar

Greece

Greenland

Grenada

Guadeloupe

Guam

Guatemala

Guinea

Guinea-bissau

Guyana

Haiti

Heard and Mc Donald Islands

Honduras

Hong Kong, China

Hungary

Iceland

Indonesia

Ireland

Israel

Jamaica

Japan

Jordan

Kazakhstan

Kenya

Kiribati

Republic of Korea

Kuwait

Kyrgyzstan

Lao,P.D.R.L

Latvia

Lesotho

Liberia

Liechtenstein

Lithuania

Luxembourg

Macao, China

The Republic of North Macedonia

Madagascar

Malawi

Malaysia

Maldives

Mali

Malta

Marshall Islands

Martinique

Mauritania

Mauritius

Mayotte

Mexico (México)

Micronesia,F.S.O.M

Moldova

Monaco

Mongolia

Montserrat

Morocco

Mozambique

Myanmar

Namibia

Nauru

Nepal

New Caledonia

New Zealand

Niger

Nigeria

Niue

Norfolk Island

Northern Mariana Islands

Norway

Oman

Pakistan

Palau

Panama

Papua New Guinea

Paraguay

Peru

Philippines

Pitcairn

Poland

Portugal

Puerto Rico

Qatar

Reunion

Romania

Russian Federation (Россия)

Rwanda

Saint Kitts and Nevis

Saint Lucia

Saint Vincent and the Grenadines

Samoa

San Marino

Sao Tome and Principe

Saudi Arabia

Senegal

Seychelles

Sierra Leone

Singapore

Slovakia (Slovak Republic)

Slovenia

Solomon Islands

South Africa

South Georgia & T.S.S.I

Sri Lanka

St. Helena

St. Pierre and Miquelon

Suriname

Svalbard & J.M.I

Swaziland

Sweden

Taiwan, China

Tajikistan

Tanzania,U.R.O.T

Thailand

Togo

Tokelau

Tonga

Trinidad and Tobago

Tunisia

Turkey

Turkmenistan

Turks & Caicos Islands

Tuvalu

Uganda

Ukraine

United Arab Emirates

Uruguay

Uzbekistan

Vanuatu

Vatican City State (Holy See)

Vietnam

Virgin Islands (British)

Virgin Islands (U.S.)

Wallis and Futuna Islands

Western Sahara

Serbia

Zambia

Aland Islands

Palestinian Territory

Montenegro

Guernsey

Isle of Man

Jersey

Canary Islands

The Republic of Congo

St. Barthelemy

St. Martin

Bonaire

Curaçao

Sint-Maarten

Saba

Sint Eustatius

Phone Number*

Your Inquiry*

I agree to NADDOD's Privacy Policy and Term of Use.

Submit

Related Products

NVIDIA/Mellanox MMA4Z00-NS Broadcom DSP & Broadcom VCSEL Compatible 800G 2xSR4/SR8 OSFP PAM4 850nm 50m DOM Two MPO-12/APC InfiniBand NDR Transceiver Module for MMF (Finned Top)

US$ 799.00

NVIDIA/Mellanox MMS4X50-NM Compatible 800G 2xFR4 OSFP PAM4 1310nm 2km DOM Two LC Duplex InfiniBand NDR Transceiver Module for SMF (Finned Top)

US$ 1,688.00

NVIDIA/Mellanox MMS4X00-NM Compatible 800G 2xDR4/DR8 OSFP PAM4 1310nm 500m DOM Two MPO-12/APC InfiniBand NDR Transceiver Module for SMF (Finned Top)

US$ 1,299.00

NVIDIA/Mellanox MMS4A00-XM/MMS4C10-XM (980-9IAH1-00XM00/980-9IAU0-00XM01) Compatible 1.6T 2xDR4/DR8 OSFP224 IHS/Closed Finned Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 500m SMF DOM Dual MPO-12/APC InfiniBand XDR Transceiver Module for Quantum-X800 Air-Cooled Switches

US$ 1,999.00

NVIDIA/Mellanox MMS4A50-XM (980-9IAS0-00XM00) Compatible 1.6T 2xFR4 OSFP224 IHS/Closed Finned Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 2km SMF DOM Dual LC Duplex InfiniBand XDR Silicon Photonics Transceiver Module for Quantum-X800 Air-Cooled Switches

US$ 2,299.00

NVIDIA/Mellanox MMS4A00-XM-FLT (980-9IAH0-00XM00) Compatible 1.6T 2xDR4/DR8 OSFP224 RHS/Flat Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 500m SMF DOM Dual MPO-12/APC InfiniBand XDR Transceiver Module

US$ 2,099.00

NVIDIA/Mellanox MMS4A50-XM-RHS (980-9IAS1-00XM00) Compatible 1.6T 2xFR4 OSFP224 RHS/Flat Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 2km SMF DOM Dual LC Duplex InfiniBand XDR Silicon Photonics Transceiver Module

US$ 2,415.00

NVIDIA/Mellanox MMS4C11-XM-RHS (980-9IAU1-00XM00) Compatible 1.6T 2xDR4/DR8 OSFP224 RHS/Flat Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 500m SMF DOM Dual MPO-12/APC Silicon Photonics Transceiver Module for Liquid-Cooled Spectrum-6 SN6600-LD Switch