435 questions
-1
votes
1
answer
36
views
Azure Batch Job Schedule has no tasks
I want to run a containerized task on Azure Batch and I want execute the task using a schedule.
I have created a job schedule but how do I associated tasks or jobs to that job schedule. The only ...
0
votes
1
answer
84
views
Azure Batch Pool with ACR fails to fetch image
I am creating Azure Batch service. I have my code in a docker image that is stored in Azure Container Registry, ACR. To access my ACR repositor I have created a user managed identity and assigned the ...
-1
votes
1
answer
35
views
Azure Batch Python SDK - 5 - 10% Chance to encounter "CreateTasksErrorException"
I have a python service running that is starting azure batch pools and adds a single job + task on user requests. In ~90% of the time, everything works fine, but sometimes i get the following error ...
- 494
0
votes
0
answers
54
views
Application package is not deployed to Azure Batch Node
I followed the steps described at: https://learn.microsoft.com/en-us/azure/batch/batch-application-packages. In particular:
Created a zip package containing my custom app
Added it to the list of ...
- 335
1
vote
0
answers
90
views
Azure Batch Development and Testing Workflow
For anyone who is using Azure Batch. What's your development and testing process when it comes to using Azure Batch with your application(s)?
I've come up with a solution using Azure Batch that ...
- 407
0
votes
1
answer
81
views
Why do we need dedicated nodes for running a batch job through Data Factory
I came across the below tutorial on Microsoft learn: https://learn.microsoft.com/en-us/azure/batch/tutorial-run-python-batch-azure-data-factory
It was very helpful to be able to run a python script ...
- 2,047
2
votes
0
answers
75
views
Nextflow Tower using Azure Batch and pre-built pools on private network is failing [closed]
I have an azure batch environment with manual pools. The pools are connected to a subnet, which includes a NAT and public IP. The Batch network profile is configured to allow the IP's returned by ...
- 5,068
0
votes
1
answer
437
views
Azure OpenAI GPT 4o-mini-batch. Batch request with grounded data (Azure Search) always returns empty response. No errors
I was trying to utilize the Azure OpenAI batch jobs.
My application uses Azure OpenAI for enterprise data. So my grounded data is taken from Azure Search (index)
I use GPT 4o-mini. While I make ...
- 164
0
votes
0
answers
64
views
How to properly secure Azure Data Factory Custom Batch Activity command line command?
Imagine running a simple ADF Pipeline that consists of 2 steps:
Fetching a sensitive value - like Storage Account URL - from Azure Key Vault
Executing a Python script with argsparse where this value ...
- 302
0
votes
1
answer
337
views
Create Pool in azure batch with user assigned managed identity
We are migrating our Python solution from Service Principal Name (SPN) to Managed Identity (MI) based authentication. We have made the necessary changes to the python code to enable authentication ...
- 755
0
votes
0
answers
121
views
Azure Data Fatory + Azure Batch and Python Script
I have been trying for a few days to create a pipeline to execute my python script, which connects to a Mysql Flexible Server database and stores some data.
I'm really new to this and it's my first ...
0
votes
1
answer
80
views
Are task logs deleted when the node is deleted due to autoscaling in Azure Batch service?
I am trying to access the logs (stdout.txt and stderr.txt) of the tasks run.
As soon as the task is completed I lose access to those files. Looking at the browser console, if I search a file in the ...
- 377
-1
votes
1
answer
49
views
Deleting Application Package using BatchClient API
I have a requirement to delete an Azure Batch Application package from our .Net background service. I am using BatchClient for various pool and job operations. It seems the ApplicationOperations Class ...
0
votes
1
answer
189
views
Cancelling or aborting an ongoing azure batch transcription request
I ran into a little trouble when using azures cognitive-services-speech-sdk for performing a batch transcription request. To be more specific I was looking into different options for cancelling an ...
- 133
0
votes
1
answer
295
views
Azure batch account , node unable to download the resource file using Managed Identity
Azure batch account , node unable to download the resource file using Managed Identity.
Below are my batch account settings.
I have a batch account , with linked auto storage , the authentication mode ...
- 149