Hi Robert,

I tried what you suggested, but when I rebooted, the network services went into 
maintenance mode. Here’s the /usbkey/config file that I had in place before 
attempting nictagadm.
[root@68-05-ca-0a-2f-c5 ~]# cat /usbkey/config 
#
# This file was auto-generated and must be source-able by bash.
#

# admin_nic is the nic admin_ip will be connected to for headnode zones.
admin_nic=68:5:ca:a:2f:c5
admin_ip=dhcp
admin_netmask=
admin_network=...
admin_gateway=dhcp

myricom_nic=0:60:dd:45:73:22
myricom_ip=192.168.2.2
myricom_netmask=255.255.255.0

headnode_default_gateway=

dns_resolvers=8.8.8.8,8.8.4.4
dns_domain=

ntp_hosts=192.168.1.1
compute_node_ntp_hosts=dhcp

I issued the command “nictagadm update -p mtu=9000 myricom” which put the line 
“myricom_mtu=9000” into that file. Upon reboot is when it went into maintenance 
mode for network services. I had to remove that line from the console and 
reboot, at which point it booted up normally.

Regards,
John

On Jul 5, 2014, at 10:05 AM, Robert Mustacchi via smartos-discuss 
<[email protected]> wrote:

> On 7/4/14 23:03 , John Croix via smartos-discuss wrote:
>> I just installed a Myricom 10Gbe adapter into my SmartOS server, and I’m 
>> having an issue with the default MTU. According to Myricom documentation, 
>> the default MTU is supposed to be 9000. However, on my system, the default 
>> MTU is 1500. On a Solaris 11.2 (beta) box, it is properly set at 9000. It’s 
>> also 9000 on Linux by default. Attempting to increase it to 9000 yields an 
>> error:
>> [root@68-05-ca-0a-2f-c5 /var/svc/log]# ifconfig myri10ge0 unplumb
>> [root@68-05-ca-0a-2f-c5 /var/svc/log]# ifconfig myri10ge0 plumb
>> [root@68-05-ca-0a-2f-c5 /var/svc/log]# ifconfig myri10ge0 mtu 9000
>> ifconfig: setifmtu: SIOCSLIFMTU: myri10ge0: Invalid argument
>> [root@68-05-ca-0a-2f-c5 /var/svc/log]# ifconfig myri10ge0
>> myri10ge0: flags=1000842<BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 11
>>        inet 0.0.0.0 netmask 0 
>>        ether 0:60:dd:45:73:22 
>> 
>> I read a discussion thread at 
>> https://www.mail-archive.com/[email protected]/msg14160.html
>>  that talks about the Myricom configuration file and the fact that it’s 
>> missing from /kernel/drv/myri10ge.conf. That’s definitely the case on my 
>> system. So I guess I have 2 questions:
>> Is there a bug (aka "undocumented feature”) somewhere in the system that’s 
>> causing the MTU to be set to 1500 instead of 9000 and, if so, can it be 
>> corrected?
>> Is there any way to get a configuration file into /kernel/drv that can 
>> persist across reboots, before the Myricom device driver is loaded?
>> 
>> I’ve tried unloading the device driver, but it won’t work:
>> [root@68-05-ca-0a-2f-c5 /]# ifconfig myri10ge0 unplumb
>> [root@68-05-ca-0a-2f-c5 /]# modunload -i 224
>> can't unload the module: Device busy
>> So I can’t force it that way.
>> 
>> I thought about creating a SMF manifest that runs a script to create the 
>> configuration file prior to loading the device driver. However, I’m not sure 
>> what dependencies I’d set to ensure the order (so that the script does, in 
>> fact, run before the device driver is loaded) or whether such an approach 
>> would work.
>> 
>> Does anybody happen to have any ideas on the matter? I’m not getting nearly 
>> the speed that I should as a result of this setting, and I really need to 
>> get this resolved.
> 
> Hi John,
> 
> We'll have to dig into the driver default. In the interim, see this wiki
> page on configuring the MTU in a way that'll get around the boot time
> issues you were seeing:
> 
> http://wiki.smartos.org/display/DOC/Managing+NICs#ManagingNICs-ModifyingtheMTU
> 
> Let me know if you have additional questions.
> 
> Thanks,
> Robert
> 
> 
> -------------------------------------------
> smartos-discuss
> Archives: https://www.listbox.com/member/archive/184463/=now
> RSS Feed: https://www.listbox.com/member/archive/rss/184463/26313201-b436b91a
> Modify Your Subscription: https://www.listbox.com/member/?&;
> Powered by Listbox: http://www.listbox.com




-------------------------------------------
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Reply via email to