So I spoke with the electrical inspector. He said he was fine with this approach and it didn't matter if patch panels and a backboard were above or below ceiling height as long as there are no devices above the ceiling.