Bringing Python to Azure Data Factory with Azure Batch Service
Azure Data Factory (ADF) is a cloud-based Extract-Transform-Load (ETL) and data integration service. It allows you to create data-driven workflows for orchestrating data movement and transforming data at scale. Through a simple drag-and-drop interface the tool ensures that processes are easy to maintain. In most cases programming is not needed. In the rare situations where […]
Concurrent API requests with Python by example
APIs are one of the things we often come across when working with data. In this blogpost we’ll have a look at some ways of extracting data out of them with Python in an efficient way. For small amounts of data we could write a simple script that sends one request at a time. For […]
Avoid headaches when working with separate PBIX files in Power BI
Splitting datasets and reports into separate PBIX files is a very common way of managing Power BI reports. This approach keeps data and calculations in a more central repository which acts as a “Single Source of Truth”. But dividing sets and reports can result in a headache or two. Let our blog be your Power […]
Running Python scripts on Azure with Azure Container Instances
Contents 1. Requirements 2. Register a repository on Docker Hub 3. Create the first Azure resources 4. Building and testing the container locally 5. Creating the Azure resources for the Container Instance 6. Optional: Disable access via environment variables to key vault 7. Closing words & further reading Running Python scripts on Azure with […]
