Depending upon the size of the firm and the nature of the CEO/COO relationship, they can be anything.

The scope of their job can be everything from ensuring that the office windows get cleaned regularly, to working on a hyperspecific project as a fixer, to overseeing large parts of business strategy that the CEO does not have time or expertise for, to effectively waiting/in training to be a successor to the CEO.