Ergophobia

The term "ergophobia" usually refers to a small collection of interrelated fears focused on work and working.

Folks who suffer from this phobia (which isn't an officially recognized disorder, but is often considered to be a spin-off of both social and performance anxieties) become irrationally anxious about anything related to going to work, performing work-like tasks, socializing at work, not living up to professional expectations, being dressed-down by a manager, being injured on the job, and pretty much anything else touching on the subject of the workplace as a physical or cultural space, or being paid to perform tasks.

So this is performance-related, but it's also situational, and thus tends to be categorized as a phobia rather than an anxiety.