Hacking the Interrupt vector table

Is there something horribly wrong with the following:

I have several ROMs on one Stellaris that only know where the vector table of the other resides.  All ROM symbols are invisible to the other ROMs and may change location with updates.  What I want to do is use some of the vector interrupt table entries that I am not using and have not enabled to store the location of certain functions inside the different ROMs so that another ROM has a location it can look to find the actual location of a function in another ROM.  This is what the StellarisWare bootloader does by storing the location of the entry function in the SVCall entry in the vector table.  Am I opening a can of worms with this?