Brad, I don't think the internal damper will need to come out. It looks to me as if the Kaoko is short enough that it will fit into the handlebar without the internal damper coming out. Right now, I think DirtFlier's approach is my best "Hope!"
If that doesn't work, I will probably try Brad's idea:My suggestion is to remove the front brake master cylinder from the handlebar then you can loosen the two screws holding the throttle assy to the handlebar and push it further to the left. This should allow you to access one of the holes in the handlebar and you can secure that floating alum piece by jamming a punch or nail into that hole as you try to unscrew the bolt.
After that, I might have to buy a new handlebar.You maybe can hold the external weight with large pliers or pipe wrench to prevent it turning as you then loosen the allen bolt. They may be cross threaded but at least would have loctited threads.