There are only few options,
1. Use USB controller Chip that support 10Gbit or more.
2. Use 10Bit or more ethernet, Optical or copper.
3. Use PCIe
4. Use onboard storage.
5. Use HDMI or something custom and have another receiver (They are called frame grabber and everybody hate them).
Right now there are not many controllers on market that can do more than 5Gbit
Most useable solution is to use Ethernet , I would say optical.
Soldering BGA is the easiest part, You just need good hotair.
While soldering connectors are hardest. They melt , do not self alging and many other problems
720p@240FPS would be little hard because of limitations on the USB controller side. because of 100Mhz and 32bit limit you have possibility of only 400Mbytepersecnd and with few % overhead you have may be get around 200 FPS of color UYV image. if you are ok without colors then you can get to 400FPS @ 720p
FPGA ISP i am using with this project is improved version of ISP that i made for lattice machxo3 FPGA , those FPGA like most FPGAs do not have any MIPI hard PHY.
If you want to port this ISP to Xilinx you would not find hard PHY in many FPGAs and you would need a byte aligner.
That is why Byte Aligner was implemented and left enabled in there for the sake of portability to other FPGA it does not hurt (except for may be very very small performance in very edge case or some FPGA resource consumption).
I had many issues with Crosslink NX part. I never specifically got/or noticed the issue you have mentioned.
I am the Developer behind this camera.
If you buy from mouser and try to make just 1 then Only part would be around 200 USD.
If you make hundred in bath of new improved hardware, You can look at BOM cost under 100 USD.
I am working on new version of this camera with totally new enclosure and PCBs as well.
You will be able to buy this soon enough.
I am the Developer behind this camera.
I have assembled cameras the exact way you have described. If you buy from mouser and try to make just 1 then Only part would be around 200 USD.
I am developer behind this camera.
Its a second revision of hardware and also second revision or firmware. I have been doing MIPI CSI FPGA stuff from quite sometime.
Current state of firmware is stable. Where work need to be done isimage quality in terms of color correction , Whitebalance, noise reduction other similar things.
Right now there are not many controllers on market that can do more than 5Gbit
Most useable solution is to use Ethernet , I would say optical.