How to tell vSMP do not use second IB card as failover?

Home Forums Using vSMP Foundation How to tell vSMP do not use second IB card as failover?

This topic contains 4 replies, has 4 voices, and was last updated by  Shai Fultheim 1 month, 2 weeks ago.

Viewing 5 posts - 1 through 5 (of 5 total)
  • Author
    Posts
  • #7247

    Arman
    Member

    Hi,
    I just installed vSMP-free on 6 nodes: 1host+5slaves.
    on host1 I have 1 IB onboard and 1 extra card.
    During the boot I can see the both cards are up.
    If I pull out one cable the system still running. It looks like both IB devices are used for vSMP fail-over.

    on host1 without vSMP my lspci is following:
    ==== BEGIN ====

    00:00.0 Host bridge: Advanced Micro Devices [AMD] nee ATI RD890 Northbridge only dual slot (2x8) PCI-e GFX Hydra part (rev 02)
    00:02.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (PCI express gpp port B)
    00:04.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (PCI express gpp port D)
    00:0b.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (NB-SB link)
    00:11.0 SATA controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode]
    00:12.0 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
    00:12.1 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0 USB OHCI1 Controller
    00:12.2 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller
    00:13.0 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
    00:13.1 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0 USB OHCI1 Controller
    00:13.2 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller
    00:14.0 SMBus: Advanced Micro Devices [AMD] nee ATI SBx00 SMBus Controller (rev 3d)
    00:14.1 IDE interface: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 IDE Controller
    00:14.3 ISA bridge: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 LPC host controller
    00:14.4 PCI bridge: Advanced Micro Devices [AMD] nee ATI SBx00 PCI to PCI Bridge
    00:14.5 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI2 Controller
    00:18.0 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor HyperTransport Configuration
    00:18.1 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Address Map
    00:18.2 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor DRAM Controller
    00:18.3 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Miscellaneous Control
    00:18.4 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Link Control
    00:19.0 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor HyperTransport Configuration
    00:19.1 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Address Map
    00:19.2 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor DRAM Controller
    00:19.3 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Miscellaneous Control
    00:19.4 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Link Control
    00:1a.0 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor HyperTransport Configuration
    00:1a.1 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Address Map
    00:1a.2 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor DRAM Controller
    00:1a.3 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Miscellaneous Control
    00:1a.4 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Link Control
    00:1b.0 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor HyperTransport Configuration
    00:1b.1 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Address Map
    00:1b.2 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor DRAM Controller
    00:1b.3 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Miscellaneous Control
    00:1b.4 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Link Control
    01:04.0 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200eW WPCM450 (rev 0a)
    02:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)
    03:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
    03:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
    04:00.0 InfiniBand: Mellanox Technologies MT25204 [InfiniHost III Lx HCA] (rev 20)
    

    ===== END ====

    But with vSMP I dont have any IB devices:
    === BEGIN lspci ===========

    00:00.0 Host bridge: Advanced Micro Devices [AMD] nee ATI RD890 Northbridge only dual slot (2x8) PCI-e GFX Hydra part (rev 02)
    00:01.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
    00:01.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
    00:11.0 SATA controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode]
    00:12.0 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller
    00:13.0 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller
    00:14.0 IDE interface: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 IDE Controller
    00:14.3 ISA bridge: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 LPC host controller
    00:14.4 PCI bridge: Advanced Micro Devices [AMD] nee ATI SBx00 PCI to PCI Bridge
    00:1f.0 Unassigned class [ff00]: ScaleMP vSMPowered system controller [vSMP CTL] (rev 0a)
    01:04.0 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200eW WPCM450 (rev 0a)
    

    === END ====

    What I should do to be able to see at-least one IB card from the host?

    Regards,
    Arman.

    #7650

    Shai Fultheim
    Keymaster

    Support for IB card at for the VM will be part of vSMP Foundation 5.5, that is due in the very next few weeks.

    #7465

    power
    Participant

    can you resolved this problem? and how?

    #7462

    power
    Participant

    [root@vsmp ~]# vsmpversion
    vSMP Foundation: 7.5.245.22 (Aug 18 2016 20:10:25)
    System configuration
    Boards: 2
    Processors: 4, Cores: 32, Threads: 64
    Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz Stepping 01
    Memory (MB): 469627 (of 524126), Cache: 40126, Private: 14373
    1 x 234624MB
    1 x 235003MB
    Link Rate: 32.0Gb/s
    Boot device: [HDD] DELL PERC H730 Mini
    Serial number: 29528786
    System key: JZVN8-TIH26-L6ZZG-WME2M-Q312Z-44N
    Supported until: Nov 30 2017

    #7460

    Erez
    Participant
Viewing 5 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic.