Sustained attention depends on working memory — the mental space where you hold information active while working with it. Its capacity is small and shared: anything else occupying space takes it from the same pool.
Hence the effect that surprises people: worry consumes working memory directly. An unresolved concern doesn't wait quietly to one side — it runs in the background and cuts into available capacity. That is why an anxious person can't concentrate however hard they want to, and why trying to concentrate harder consumes more still.
The second factor is fragmentation. Every switch between tasks carries a re-engagement cost of several minutes. A day with thirty interruptions isn't a day with thirty minutes lost — it's a day in which attention never reached depth.