I see the designer as one of the very key people on whom the success of the project depends.
Always surprised when a designer wants to limit the list of things they do on the project, limit the responsibility. The effect on the project is similar to CEO not taking care of project details and proceedings.
Please try to get your hands dirty with whatever’s necessary for success overall. Design better project worflow, better requirements structure, better team meetings, better skateholder demos and presentations.
Comes with the job, surprisingly, and for some cases critical for project success overall.
See the goal, help the team, get there by all means necessary. I bet you’ll learn a ton of useful things for hands-on design work along the way.