Hi Arash, It's awesome that you're doing this.
I only have experience bringing up the 10GbE core on SNAP, but a few things you might try are: - Make sure all the (many!) clocks are running at the correct speed -- easy to misconfigure. - Check and double check resets - Setting the transceivers into loopback mode, and checking for sanity. - Using a QSFP loopback module to similar effect. I believe one is supplied with the VCU kit. I'm pretty sure I have less expertise in this than you, but they're my first thoughts. I assume that the infiniband switch is dual-personality, and capable of establishing a 100GbE link? Anyway, it's great that you're working on this, Jack On Mon, 26 Feb 2018 at 12:13 Roshanineshat, Arash < [email protected]> wrote: > Hi > > I'm trying to implement a design using UltraScale+ 100G Ethernet on a > VCU118 board. I use Vivado 2017.4 and UltraScale+ 100G Ethernet IP > core subsystem version 2.4. > > I'll give you a quick background about what I have done so far, please > let me know if I took a wrong step at any point. > > I want to implement OSI model which consists of following layers: > > 7-Application layer > 6-Presentation layer > 5-Session Layer > 4-Transport > 3-Network Layer > 2-Data Link Layer > 1-Physical layer > > According to what I learned from Xilinx's forum community, 100G IP > core will take care of Ethernet protocol (Layers 1 and 2) and I have > to implement Layers 3 and 4. However, Linux operating system will take > care of Layers 3 and 4 for me. Therefore, I only need to generate the > data and use GTY transceivers to transfer them to the network. Right? > > To customize GTY Transceivers to use QSFP1, and to test it I did the > following: > > 1-As GTY documentation says, QSFP1 is located in left side quads and > in quad 231. > 2-I selected X1Y48~51 channels of CMACE4 X0Y7. I chose this value > because I saw it will put the transceivers on quad bank 231. > 3-I chose CAUI4 mode (4 lanes x 25.7812G) Simple TX. > 4-I generated an IP core using the above settings. > 5-I generated an Open IP Example design using the IP generated above > to experiment with it. > 6-I connected gt_refclks to QSFP_SI570_CLOCK_C_P/N for QSFP1 > 7-I initiated a IBUFS to convert a LVDS clock to single-ended clock > and connected it to init_clk > 8-Create a xdc file according to my VCU118 pinouts. > 9-generated the bitcode > > I loaded the bitcode to the FPGA board and I noticed TX_gt_locked, > TX_done, TX_busy LEDs are blinking correctly. So I *guess* the data is > being generated too. the problem I have now is that I cannot bring up > the QSFP interface and our 100G infiniband switch, reports that the > QSFP port connected to the FPGA is "down". > > What I'm suspicious about is that I have selected a wrong GTY > transceiver configuration, however, It seems to me, everything is > according to the documentation and the other reason I can think of is > the clock values. > > I would be grateful if you could advise me on possible solutions or > debugging methods that I can try. > > Best Regards > Arash Roshanineshat > > -- > You received this message because you are subscribed to the Google Groups " > [email protected]" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > -- You received this message because you are subscribed to the Google Groups "[email protected]" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected].

