UPDATE : I have measured my spacers(vernier calliper) and the thickness of the sidewalls(eyeballed it in light and no dents or warps), they are all 100% the same thickness. SO, Stainless and Nyloc damage was my problem. I have to use HT bolts and galvanized Nyloc nuts(I am not sure you get HT Nyloc nuts) for my tower.
Silicone, yes, good plan, but I do think that a good design should not really need that much "glue" on the navigation tower. Eventually any epoxy glue will fail if there is too much stress on the fix points.
I have studied the factory Honda and KTM Rallye bikes(photos and amageza, etc.) Normal bolts should suffice... I also suspect Yamaha used the exact KTM tower and brackets, see the pic :

Look very closely... zoom in! Then! I have built my own bike, nice, cool, Darth, you are the best, blah, but! Check Cyril's bike, it is a 100% garage build. I so want him to finish top 10 with this bike, because that would just prove you can build a low cost bike and win.
His tanks probably cost 1000ZAR in material

His exhaust is routed brilliantly ... and all the exhaust sections parts are sleeved, with springs! Super easy to fix at the bivouac. If Yamalube pulls this off, it will reset history.
I am going to test my bike in the next 2 mounts with it full rally party dress. Lets see if the girl holds up!