As promised:
So I ended up recoding the led matrix code to offload some of the heavy lifting to another box and just use the portal matrix board for display functions. I need to sleep a bit but I will write up the building/coding up later.
once again, thanks for buying me a coffee.
Kentaro