Hi Magnus,
The pinmux you use shows an I/O set violation in the Pinmux tool. This means that this configuration has not been validated. However if SPI_CS1 is removed from the configuration it's valid. On which CS does this happen? Also, you need RXACTIVE in the pinmux only on SPI_CLK and SPI_MISO. The other signals should be output only.