You need to make sure you have the configs enabled that are listed on the LCDC driver page. Make sure you are aware of whether you would like to enable DRM or fbdev drivers.
You also need to make sure you have the right device tree entries. Look in the Porting section of the main LCDC page.