I have not applied Spike It or JJ's Magic to any Hard Baits. I would agree with your results, would not stick well.
I do however use permanent markers on Hard Baits to add a little color, normally red or orange under the chin.
I also write the model and running depth on the Hard Bait as well .... this adds color at the same time.
I hope this helps.