Hi Arash,

It's awesome that you're doing this.

I only have experience bringing up the 10GbE core on SNAP, but a few things
you might try are:
- Make sure all the (many!) clocks are running at the correct speed -- easy
to misconfigure.
- Check and double check resets
- Setting the transceivers into loopback mode, and checking for sanity.
- Using a QSFP loopback module to similar effect. I believe one is supplied
with the VCU kit.

I'm pretty sure I have less expertise in this than you, but they're my
first thoughts.

I assume that the infiniband switch is dual-personality, and capable of
establishing a 100GbE link?

Anyway, it's great that you're working on this,

Jack



On Mon, 26 Feb 2018 at 12:13 Roshanineshat, Arash <
[email protected]> wrote:

> Hi
>
> I'm trying to implement a design using UltraScale+ 100G Ethernet on a
> VCU118 board. I use Vivado 2017.4 and UltraScale+ 100G Ethernet IP
> core subsystem version 2.4.
>
> I'll give you a quick background about what I have done so far, please
> let me know if I took a wrong step at any point.
>
> I want to implement OSI model which consists of following layers:
>
> 7-Application layer
> 6-Presentation layer
> 5-Session Layer
> 4-Transport
> 3-Network Layer
> 2-Data Link Layer
> 1-Physical layer
>
> According to what I learned from Xilinx's forum community, 100G IP
> core will take care of Ethernet protocol (Layers 1 and 2) and I have
> to implement Layers 3 and 4. However, Linux operating system will take
> care of Layers 3 and 4 for me. Therefore, I only need to generate the
> data and use GTY transceivers to transfer them to the network. Right?
>
> To customize GTY Transceivers to use QSFP1, and to test it I did the
> following:
>
> 1-As GTY documentation says, QSFP1 is located in left side quads and
> in quad 231.
> 2-I selected X1Y48~51 channels of CMACE4 X0Y7. I chose this value
> because I saw it will put the transceivers on quad bank 231.
> 3-I chose CAUI4 mode (4 lanes x 25.7812G) Simple TX.
> 4-I generated an IP core using the above settings.
> 5-I generated an Open IP Example design using the IP generated above
> to experiment with it.
> 6-I connected gt_refclks to QSFP_SI570_CLOCK_C_P/N for QSFP1
> 7-I initiated a IBUFS to convert a LVDS clock to single-ended clock
> and connected it to init_clk
> 8-Create a xdc file according to my VCU118 pinouts.
> 9-generated the bitcode
>
> I loaded the bitcode to the FPGA board and I noticed TX_gt_locked,
> TX_done, TX_busy LEDs are blinking correctly. So I *guess* the data is
> being generated too. the problem I have now is that I cannot bring up
> the QSFP interface and our 100G infiniband switch, reports that the
> QSFP port connected to the FPGA is "down".
>
> What I'm suspicious about is that I have selected a wrong GTY
> transceiver configuration, however, It seems to me, everything is
> according to the documentation and the other reason I can think of is
> the clock values.
>
> I would be grateful if you could advise me on possible solutions or
> debugging methods that I can try.
>
> Best Regards
> Arash Roshanineshat
>
> --
> You received this message because you are subscribed to the Google Groups "
> [email protected]" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To post to this group, send email to [email protected].
>

-- 
You received this message because you are subscribed to the Google Groups 
"[email protected]" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].

Reply via email to