A team runs training jobs by using multiple Azure Machine Learning pipelines.

To ensure runtime dependencies are consistent and reusable, first create a conda.yaml or requirements.txt file that lists all Python packages and system libraries required by your training code — this file is the single source of truth for your runtime. Next, create an Environment object using the Azure ML Python SDK v2 with a name and reference to the conda.yaml file, specifying the base Docker image. Then register the Environment by calling ml_client.environments.create_or_update, which publishes it to the workspace registry with an auto-incremented version. Finally, reference the registered environment by name and version in all pipeline job steps. Azure ML will build or retrieve the cached Docker image and use it as the execution container. This approach means updating dependencies only requires modifying the conda.yaml and registering a new version — training code remains unchanged.

Microsoft Learn Reference Topic: Create and manage Azure Machine Learning environments – Reusable curated environments