On Wed, Jul 8, 2009 at 3:42 PM, Erwin Tsaur<[email protected]> wrote:
> ok I severely underestimated how much 1000 lines are, but I got the info I
> needed, mostly.  Now I'm wondering if there is an errata in the Root Port
> causing this.
>
> /p...@0,0/pci8086,3...@1/pci15d9,10c9, I know it's a nic device.  Both notes
> are complaining of CE errors.
>
> The best way is to disable reporting those 2 CEs is to add the following
> line in the driver's .conf file.

This is the igb driver (SUNWigb package).  It doesn't have a conf file.

It's for the Intel 82576 Dual-Port GigE on-board NIC.  This driver
didn't work prior to the update.

So, I made a .conf file thusly and rebooted:

/usr/kernel/drv# cat >igb.conf
pcie_ce_mask=0x1040;

... no difference.  Still lots of errors reported (attached last 1000 lines).

Chris
> pcie_ce_mask=0x1040;
>
> It requires reboot.
>
> If you need to do it on a live system let me know, the instructions are a
> bit more complicated.
>
> Chris Worley wrote:
>>
>> On Wed, Jul 8, 2009 at 2:57 PM, Erwin Tsaur<[email protected]> wrote:
>>
>>>
>>> Chris Worley wrote:
>>>
>>>>
>>>> On Wed, Jul 8, 2009 at 2:42 PM, Erwin Tsaur<[email protected]> wrote:
>>>>
>>>>
>>>>>
>>>>> Chris Worley wrote:
>>>>>
>>>>>
>>>>>>
>>>>>> On Wed, Jul 8, 2009 at 1:10 PM, Erwin Tsaur<[email protected]>
>>>>>> wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Chris Worley wrote:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> (Sorry for the misleading "Subject" in the initial post.  would like
>>>>>>>> to know a more appropriate place to post, since fm is just the
>>>>>>>> messenger here.)
>>>>>>>>
>>>>>>>> More to add: fmadm faulty may be saying something about a bad PCIe
>>>>>>>> slot or device (is there an "lspci" in OpenSolaris?):
>>>>>>>>
>>>>>>>> # fmadm faulty
>>>>>>>> --------------- ------------------------------------  --------------
>>>>>>>> ---------
>>>>>>>> TIME            EVENT-ID                              MSG-ID
>>>>>>>> SEVERITY
>>>>>>>> --------------- ------------------------------------  --------------
>>>>>>>> ---------
>>>>>>>> Jul 07 07:55:42 016cf20c-d572-42c1-f217-9eb8d439b73c  PCIEX-8000-KP
>>>>>>>>  Major
>>>>>>>>
>>>>>>>> Fault class : fault.io.pciex.device-interr-corr max 29%
>>>>>>>>           fault.io.pciex.bus-linkerr-corr max 14%
>>>>>>>> Affects     : dev:////p...@0,0/pci8086,3...@1/pci15d9,1...@0
>>>>>>>>           dev:////p...@0,0/pci8086,3...@1/pci15d9,1...@0,1
>>>>>>>>           dev:////p...@0,0/pci8086,3...@1
>>>>>>>>               faulted but still in service
>>>>>>>> FRU         : "MB"
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> (hc://:product-id=X8DTH-i-6-iF-6F:chassis-id=1234567890:server-id=opensolaris/motherboard=0)
>>>>>>>>               faulty
>>>>>>>>
>>>>>>>> Description : Too many recovered bus errors have been detected,
>>>>>>>> which
>>>>>>>> indicates
>>>>>>>>           a problem with the specified bus or with the specified
>>>>>>>>           transmitting device. This may degrade into an
>>>>>>>> unrecoverable
>>>>>>>>           fault.
>>>>>>>>           Refer to http://sun.com/msg/PCIEX-8000-KP for more
>>>>>>>> information.
>>>>>>>>
>>>>>>>> Response    : One or more device instances may be disabled
>>>>>>>>
>>>>>>>> Impact      : Loss of services provided by the device instances
>>>>>>>> associated
>>>>>>>> with
>>>>>>>>           this fault
>>>>>>>>
>>>>>>>> Action      : If a plug-in card is involved check for badly-seated
>>>>>>>> cards
>>>>>>>> or
>>>>>>>>           bent pins. Otherwise schedule a repair procedure to
>>>>>>>> replace
>>>>>>>> the
>>>>>>>>           affected device.  Use fmadm faulty to identify the device
>>>>>>>> or
>>>>>>>>           contact Sun for support.
>>>>>>>>
>>>>>>>> How bad is this error?  I need to put some adapters in, but it
>>>>>>>> sounds
>>>>>>>> like the OS doesn't handle the NHM's IOH (or is it really detaining
>>>>>>>> a
>>>>>>>> HW issue?).
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> OS does handle these issues and unfortunately it is a HW issue.  This
>>>>>>> is
>>>>>>> likely to eventually cause your system to panic or fill up your hard
>>>>>>> drive.
>>>>>>>  Assuming you are seeing a lot of btlp and rto errors..  If anything
>>>>>>> these
>>>>>>> errors are performance killer.  Not only is the RTO/BTLP error
>>>>>>> telling
>>>>>>> you
>>>>>>> that many packets require retransmit, the OS also has to constantly
>>>>>>> go
>>>>>>> out
>>>>>>> and scan and clean up the fabric.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> This system is triple boot: RHEL5.3, W2008S, and OpenSolaris.
>>>>>>
>>>>>> The errors in OpenSolaris occur if no cards are installed in the bus.
>>>>>>
>>>>>> The other OSes don't report any errors w/ or w/o cards in the bus.
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> This doesn't happen when there are no cards installed, since the error
>>>>> is
>>>>> literally complaining about a packets received between 2 devices.  Are
>>>>> you
>>>>> sure it's you are correctly identifying the right slot?
>>>>>
>>>>> I believe only OpenSolaris even detects these errors, which is why the
>>>>> other
>>>>> OSes don't report any errors.  It doesn't mean that errors aren't
>>>>> occurring
>>>>> though.
>>>>>
>>>>>
>>>>>>
>>>>>>
>>>>>>>>
>>>>>>>> It would also be nice to throttle the errlog so it doesn't fill the
>>>>>>>> disk an hour after boot.  Is this possible?
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> no throttling possible, but you could turn it off, though highly not
>>>>>>> recommended, it's better to fix the issue.  It really could just be a
>>>>>>> badly
>>>>>>> seated card.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> How do I disable the errors?
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> We need to figure out exactly what your error is first, please provide
>>>>> the
>>>>> "fmdump -eV" log.  If it is huge, just tail the last 500-1000 lines
>>>>> should
>>>>> be enough.
>>>>>
>>>>>
>>>>
>>>> Would that produce the same as the incantation shown earlier?:
>>>>
>>>>
>>>
>>> I think all the CE's would produce the same message.  I also need to know
>>> the exact device.
>>>
>>
>> Last 1000 lines (of ~20 million) attached.
>>
>> There are some boards in the bus at this time, but the same error
>> occurs w/o them, and their drivers are not yet loaded.  Everything
>> else is built-in to the motherboard.
>>
>> Thanks,
>>
>> Chris
>>
>>
>>>>>
>>>>> <snip>
>>>>>
>
>
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x0
        pcie_ce_mask = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x693754e

Jul 08 2009 15:00:02.125819788 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x2485ee8ca602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x77fdb8c

Jul 08 2009 14:59:44.767590855 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x207b4cfd2902801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a5508c0 0x2dc081c7

Jul 08 2009 14:59:44.767590855 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x207b4cfd2902801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a5508c0 0x2dc081c7

Jul 08 2009 15:00:02.168774584 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24887dfac302801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0xa0f4bb8

Jul 08 2009 15:00:02.200148068 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x248a5cb29c02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0xbee0464

Jul 08 2009 14:59:44.785260354 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x207c5a9ccc02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a5508c0 0x2ece1f42

Jul 08 2009 14:59:44.785260354 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x207c5a9ccc02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a5508c0 0x2ece1f42

Jul 08 2009 15:00:02.417690833 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x249754230602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x18e574d1

Jul 08 2009 15:00:02.565991848 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24a02b087102801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x21bc59a8

Jul 08 2009 14:59:44.840257418 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x207fa1cc4402801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a5508c0 0x32154f8a

Jul 08 2009 14:59:44.840257418 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x207fa1cc4402801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a5508c0 0x32154f8a

Jul 08 2009 15:00:02.610127817 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24a2cc7fd602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x245dcfc9

Jul 08 2009 15:00:02.631584348 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24a413e77702801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x25a5365c

Jul 08 2009 14:59:44.954083709 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x20866aa4a602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a5508c0 0x38de297d

Jul 08 2009 14:59:44.954083709 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x20866aa4a602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a5508c0 0x38de297d

Jul 08 2009 15:00:02.650128858 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24a52edf7602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x26c02dda

Jul 08 2009 15:00:02.660110902 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24a5c72f2002801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x27587e36

Jul 08 2009 14:59:45.081650709 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x208e052b1802801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a5508c1 0x4dde415

Jul 08 2009 14:59:45.081650709 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x208e052b1802801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a5508c1 0x4dde415

Jul 08 2009 15:00:02.990204655 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24b97401a702801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d2 0x3b0552ef

Jul 08 2009 15:00:03.030263639 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24bbd7412b02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d3 0x1cdc957

Jul 08 2009 14:59:45.107509086 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x208f8fba2b02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a5508c1 0x668755e

Jul 08 2009 14:59:45.107509086 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x208f8fba2b02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a5508c1 0x668755e

Jul 08 2009 15:00:03.076492101 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24be98a7c002801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d3 0x48f2d45

Jul 08 2009 15:00:03.165481543 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24c3e6851a02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d3 0x9dd0c47

Jul 08 2009 14:59:45.329360890 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x209cc8ec2b02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        __ttl = 0x1
        __tod = 0x4a5508c1 0x13a1a5fa

Jul 08 2009 15:00:03.170209343 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24c42ea88702801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d3 0xa25303f

Jul 08 2009 15:00:03.175033395 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24c478455602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x0
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x0
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x0
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x3
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a5508d3 0xa6ecc33

Jul 08 2009 14:59:45.329387256 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x209cc9519802801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1/pci15d9,1...@0
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x11
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a5508c1 0x13a20cf8

Jul 08 2009 15:00:03.175057728 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x24c478a63002801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1/pci15d9,1...@0
        (end detector)

        bdf = 0x100
        device_id = 0x10c9
        vendor_id = 0x8086
        rev_id = 0x1
        dev_type = 0x0
        pcie_off = 0xa0
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pcie_status = 0x11
        pcie_command = 0x2037
        pcie_dev_cap = 0x10008cc2
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62011
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x40
        pcie_ce_mask = 0x0
        remainder = 0x2
        severity = 0x3
        __ttl = 0x1
        __tod = 0x4a5508d3 0xa6f2b40

_______________________________________________
fm-discuss mailing list
[email protected]

Reply via email to