Наконец-то получил ответ от саппорта латтиса, оттранслирую здесь:
Цитата
When you use the FPGA reference clock (core_rxrefclk and core_txrefclk), you don't need to connect the refclkn and refclkp to ground. Just leave as is.
However, I would recommend as much as possible to use the refclkn and refclkp instead since it would have less jitter compared to reference clock from FPGA. But it is your choice.