One way of looking at the federal government is that part of it is permanent and another part of it is transient. The transient government comprises those elected officials and political appointees who change when administrations change.
There are exceptions (like Bob Gates staying on at Defense), but presidents work ...