I assume you're using Azure App Service because you didn't specify where you're deploying your apps (since you said "moving to Azure"). Yes, you can use a single pipeline to deploy numerous projects.
Set up your build pipeline first, and then set up a release pipeline with several stages. This is the now "old" way of doing things. One app/project can be used for each stage of your release pipeline.
Microsoft suggests using the new multi-stage pipeline, which allows you to declare both your build and release parameters in the same YAML template.
Here's a link to a guide I found that provides a simple example of deploying several projects to Azure App Service from a single solution in Azure DevOps (this is the legacy way).