Manual.ly Logo

NVIDIA Mellanox ConnectX-6 VPI Manual

0.0 · 0 Ratings

PDF manual · 64 Pages

English

M: OA-GPT-5-NAN
page

/ 64

Loading...
2ee11fca6b4cbc50f839a95a1376d8d4ec94 page 1
Exported onOct/23/2020 12:05 PM
https://docs.mellanox.com/x/TwvTAQ
NVIDIA Mellanox ConnectX-6 InfiniBand/VPI
Adapter Cards for OCP Spec 3.0 User Manual

Chat with your NVIDIA Mellanox ConnectX-6 VPI manual using AI

Get instant AI answers from your NVIDIA Mellanox ConnectX-6 VPI manual

Ask anything about the NVIDIA Mellanox ConnectX-6 VPI. Answers come from this manual, with the pages they are based on.

Ask a Question

0/1000

Do you recommend Mellanox ConnectX-6 VPI?

Yes No

Frequently Asked Questions

A

ConnectX-6 VPI supports up to 200Gb/s in both InfiniBand (HDR) and Ethernet (200GbE) modes, and is backward-compatible with 1/10/25/40/50/100 Gb/s Ethernet and InfiniBand SDR/DDR/QDR/FDR/EDR/HDR100 standards.

Is this answer helpful?

A

Supported platforms include major Linux distributions via Mellanox OFED, Windows Server via WinOF-2, VMware ESXi via the native Mellanox driver, FreeBSD, and related stacks. Use the vendor-provided packages (MLNX_OFED, WinOF-2, ESXi VIB) for installation and updates.

Is this answer helpful?

A

Firmware can be updated online using tools like mlxfwmanager and mlxup, manually by burning provided BIN images, or automatically upon boot via the mlx-fw-updater service. Use Mellanox tools from their support site and follow guidance for OEM cards and PSID-specific firmware.

Is this answer helpful?

A

Follow OCP 3.0 bracket instructions for your retention mechanism, ensure the host PCIe slot provides required power (35W–80W depending on model), maintain correct airflow direction, use ESD precautions, and verify compatibility with server BIOS and PCIe version (Gen3/Gen4).

Is this answer helpful?

A

MLNX_OFED modules for RHEL/SLES are signed with Mellanox x.509 keys. To load signed modules with Secure Boot enabled, enroll Mellanox’s public key into the system MOK/UEFI key database using mokutil and MokManager during a reboot.

Is this answer helpful?

A

Cards expose FRU EEPROM, SMBus/MCTP interfaces for BMC integration, and provide Mellanox management utilities (MFT, mlxstat, mlxup) for firmware queries, updates, and diagnostics. LED indicators show link speed and activity per port.

Is this answer helpful?

A

High-performance computing, large-scale clustering, NVMe-over-Fabrics storage, latency-sensitive AI/ML workloads, and environments requiring converged Ethernet/InfiniBand fabrics all benefit from ConnectX-6 VPI’s high throughput, low latency, and hardware offloads.

Is this answer helpful?

M: OA-GPT-5-NAN

Advantages and Disadvantages

Advantages

  • Unified VPI supports both 200Gb/s InfiniBand and 200GbE for flexible network deployment.
  • Advanced hardware offloads (RoCE, NVMe-oF, OVS) reduce CPU overhead and boost application performance.
  • Wide OS and driver support (MLNX_OFED, WinOF-2, VMware native) with firmware management tools.
  • OCP 3.0 compact form factor with multiple bracket options and robust management interfaces (SMBus/MCTP).
  • Comprehensive IEEE 802.3 and InfiniBand standard support with high interoperability using Mellanox LinkX cables.
VS

Disadvantages

  • Requires correct PCIe slot power and airflow; some models need slots capable of 80W.
  • Firmware and driver updates require vendor tools and careful coordination to avoid downtime.
  • Advanced features may need specific OS/kernel versions or DKMS/KMP support for module builds.
  • Optimal auto-negotiation and extended reach may depend on using Mellanox-compatible optics/cables.
  • Secure Boot integration requires enrolling Mellanox x.509 key or stripping/signing modules, adding admin steps.
M: OA-GPT-5-NAN

Product Specification

Type

LAN adapter, SAN adapter

Power supply

Power supply only via connection

Chipset

Mellanox ConnectX-6 (LAN adapter, QSFP56)

Special features

VLAN, LACP, VXLAN, NVGRE, GENEVE, RoCE (v1/v2), NFSoRDMA, SR-IOV, NVMe over Fabric (NVMe-oF), MPLS, iSCSI, iSER, NC-SI, PXE-Bootrom

Manufacturer's warranty

one year

M: OA-GPT-54-NAN

Product Description

NVIDIA Mellanox ConnectX-6 VPI — Powerful 200Gb/s InfiniBand and Ethernet Adapter

The NVIDIA Mellanox ConnectX-6 VPI is a high-performance network adapter family designed for modern data centers and high-performance computing. Offering up to 200Gb/s throughput in both InfiniBand and Ethernet modes, the ConnectX-6 VPI delivers low-latency, high-bandwidth connectivity for demanding workloads. Available in OCP 3.0 form factors with single- or dual-QSFP56 ports and PCIe Gen3/Gen4 x16 host interfaces, these adapters are tailored for enterprise, cloud, and HPC environments that require consolidated networking, storage acceleration, and virtualization capabilities.

Key product highlights

ConnectX-6 VPI supports HDR (200Gb/s) InfiniBand and 200GbE, HDR100 (100Gb/s) variants, and backward-compatible Ethernet speeds (1/10/25/40/50/100/200 Gb/s). The cards support SR-IOV, advanced RDMA (RoCE), NVMe over Fabrics offloads, overlay offloads (VXLAN/NVGRE), and Open vSwitch offload for better CPU efficiency. Hardware accelerations—PeerDirect, tag matching, and rendezvous offloads—help reduce host CPU overhead and improve application throughput across large clusters.

Software and management

The adapter family is supported across major OSes (RHEL/CentOS, Debian/Ubuntu, Windows Server, VMware ESXi, FreeBSD) with Mellanox OFED (Linux), WinOF-2 (Windows), and native VMware drivers. Firmware and driver management are provided via Mellanox tools (mlxup, mlx-fw-updater, MFT), with options for online, manual, or automatic-on-boot firmware updates. Secure Boot is supported via signed kernel modules and x.509 key enrollment procedures.

Installation and hardware details

OCP 3.0 retention mechanisms include internal lock, ejector latch, and thumbscrew brackets. Cards require attention to airflow direction and power delivery from the PCIe slot (models may require slots capable of supplying 35W–80W depending on the variant). LEDs per port indicate link speed and activity; FRU EEPROM and SMBus/MCTP interfaces support management through BMCs.

Performance and interoperability

ConnectX-6 VPI implements IBTA v1.3 compliance, advanced congestion control, Data Center Bridging features, jumbo frame support, and extensive IEEE 802.3 protocol support. The adapters interoperate with Mellanox LinkX optics and cables and are optimized for low bit error rates and long reach when paired with Mellanox products. Performance tuning and troubleshooting guidance are provided within the ecosystem documentation and tools.

Notes

  • Multiple SKUs exist: single- and dual-port QSFP56, HDR (200Gb/s) and HDR100/EDR (100Gb/s) variants, with PCIe Gen3/Gen4 compatibility.
  • Use the vendor-provided MLNX_OFED/WinOF/MFT tools for firmware upgrades and driver installs to ensure compatibility and feature availability.
  • Observe ESD, airflow, and power requirements during installation to avoid thermal or operational issues.
M: OA-GPT-5-NAN

© Copyright 2026 Manual.ly