Avoiding small talk, however, can worsen anxiety in the long run. Instead, decide on a few things to talk about ahead of time. This can help build your confidence and improve your social skills.