What are the drawbacks of having a power of attorney?

One of the significant downsides of having a power of attorney is that the person acting on your behalf is unsupervised by anyone other than you. Although there might be regulations in the state you reside that mandate the person to report their actions, you are the sole authority to enforce it, unless someone assumes the role of your guardian or conservator, or a government agency intervenes due to misconduct.