[Gluster-users] OT: possible to upgrade mellanox HBA firmware from ubuntu?

[Dan Cyr]

Glad to help! And, glad to have your modifications listed here for posterity!

I couldn't recall if I had used the mft rpm from OFED. I was literally floundering  around (ok not literally) trying to figure out how to upgrade the firmware and pissed off at the ridiculousness of what was required to do so. What I didn't bother to explain was how I did have the updated kernel installed, and had  to run through the OFED install script to create the kernel-mft rpm to match it. With various trials runs to pick which RPMS to build - because not all successfully compiled *which was far outside of what I was trying to accomplish* - all done on a test system because I wasn't about to install compilers on a production server.

Dan

From: Harry Mangalam [mailto:harry.mangalam at uci.edu]
Sent: Wednesday, November 09, 2011 12:19 PM
To: gluster-users at gluster.org
Cc: Dan Cyr
Subject: Re: [Gluster-users] OT: possible to upgrade mellanox HBA firmware from ubuntu?


I can verify that the CentOS approach works as Dan described it with the caveats prefixed by ##hjm, using a testbed machine running a fresh install of CentOS6.

Thanks to Dan for such a nice outline.

hjm

On Tuesday 08 November 2011 12:11:44 Dan Cyr wrote:

> Harry,

>

> I had these same problems when I upgraded my firmware.

>

> Here's what I ended up doing (Centos6 or RHEL6 *not 6.1*):

>

> If you use the default kernel: 2.6.32_71.el6 (don't run yum

> update), then you can use the kernel-mft RPM included with OFED

> (kernel-mft-2.7.0-2.6.32_71.el6.x86_64.x86_64.rpm)

>

> yum -y install mstflint

> wget "http://www.mellanox.com/downloads/ofed/MLNX_OFED_LINUX-1.5.3-1.0.

0-rhel6-x86_64.iso" mkdir -p /mnt/iso

> mount -o loop MLNX_OFED_LINUX-1.5.3-1.0.0-rhel6-x86_64.iso /mnt/iso/ > yum -y install /mnt/iso/RPMS/kernel-mft-2.7.0-2.6.32_71.el6.x86_64.x86_64.rpm --nogpgcheck

##hjm: you need to install the mst app from the mft rpm that is

##hjm: distributed in the above iso image

##hjm: sudo rpm -i /mnt/iso/RPMS/mft-2.7.0-20.x86_64.rpm

> mst start

> ls /dev/mst/ # Verify the proper device is there (*_pciconf?) - if

> there are none, this needs to be resolved before continuing.

##hjm: this worked fine:

ls /dev/mst/

mt25204_pciconf0 mt25204_pci_cr0

> mkdir -p /usr/src/firmware

> cd /usr/src/firmware

> # My cards are SuperMicro UIO - replace the below commands

> appropriately #wget

> "ftp://ftp.supermicro.com/Firmware/InfiniBand/AOC-UINF-m2/aocuinfm

> 2_20090609.zip" #unzip aocuinfm2_20090609.zip

> # -allow_psid_change might not be required - check with you

> hardware vendor - For me I found this link:

> http://64.174.237.178/support/faqs/faq.cfm?faq=9803 #flint -d

> /dev/mst/mt25418_pciconf0 -i aocuinfm2_20090609.bin -nofs

> -allow_psid_change burn #reboot

===========================================================

##hjm: found this latest firmware upgrade. <http://www.mellanox.com/content/pages.php?pg=custom_firmware_table>

And once you get the appro package and download and unpack it,

the VERY latest firmware needs to be created with mlxburn

like this:

$ cd ~hjm/fw-25204-rel-1_2_940

$ sudo mlxburn -fw ./fw-25204-rel.mlx -dev /dev/mst/mt25204_pci_cr0

-nofs

## and it seems to work:

$ flint -d /dev/mst/mt25204_pciconf0 q

Image type: Failsafe

FW Version: 1.2.940 <-------------------VERY latest fw.

I.S. Version: 1

Device ID: 25204

Description: Node Port1 Sys image

GUIDs: 00066a0098006e5f 00066a00a0006e5f 00066a0098006e5f

Board ID: j (MT_0230000002)

VSD: j

PSID: MT_0230000002

===========================================================

so with that, the

>

> Good Luck.

> Dan

>

> From: gluster-users-bounces at gluster.org

> [mailto:gluster-users-bounces at gluster.org] On Behalf Of Harry

> Mangalam Sent: Tuesday, November 08, 2011 11:45 AM

> To: gluster-users at gluster.org

> Subject: [Gluster-users] OT: possible to upgrade mellanox HBA

> firmware from ubuntu?

>

>

> Sorry for the OT, but this problem is preventing my further testing

> of gluster and this groups seems like they might know..

>

> I've been looking into this for a few days and have not run across

> any success stories in upgrading firmware using Ubuntu (Mellanox

> supports RH and Suse), but I've tried to install the MFT/MST

> packages and it keeps erroring out for various reasons.

>

> If it's not possible (or very painful), I'll upgrade the card

> firmware via a LiveCD/DVD of SciLinux or CentOS on another

> machine.

>

> Other suggestions for upgrading the IB card firmware gratefully

> accepted.

>

> Harry

>

> --

>

> Harry Mangalam - Research Computing, OIT, Rm 225 MSTB, UC Irvine

>

> [ZOT 2225] / 92697 Google Voice Multiplexer: (949) 478-4487

>

> MSTB Lat/Long: (33.642025,-117.844414) (paste into Google Maps)

>

> --

>

> This signature has been OCCUPIED!

--

Harry Mangalam - Research Computing, OIT, Rm 225 MSTB, UC Irvine

[ZOT 2225] / 92697 Google Voice Multiplexer: (949) 478-4487

MSTB Lat/Long: (33.642025,-117.844414) (paste into Google Maps)

--

This signature has been OCCUPIED!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20111109/5d030a85/attachment.html>