You are responsible for your business.
That does not mean you need to do the work.
There is a business analysis concept called a RACI matrix. RACI stands for Responsible, Accountable, Consulted, Informed.
The RACI matrix is applicable to any task. For that task, there is someone responsible, the person where the buck stops. There is someone accountable, the person who does the work. There may be someone who needs to be consulted, someone who has input that is required. There may be someone who needs to be informed or kept up to date.
For your business, you are responsible for everything. You can delegate that responsibility, but ultimately the responsibility comes back to you.
The work on the other hand can be done by others.
Even with the work that is done by others, since you are responsible you need to understand what needs to be done, what the outcome is, and how the outcome is measured. Without these understandings, you cannot be responsible. You will just get the blame if something goes wrong.
There are many people on your team, whether employees or outsourced. There are lawyers, accountants, bookkeepers, receptionists, all of which do work for your company.
The question is, do you have the understanding, and metrics to be the one responsible for this work?