Instant Track Disable Retrack

Is there a way to prevent the instant track from retracking? I added some buttons that are tracked with the object, but when tapped, it just places the initial object elsewhere on my table. Thanks!