When an Azure runbook does not recognize your cmdlets…
Automating a Data Factory pipeline using a runbook seemed like an easy last step in a Azure DWH setup I developed lately. To automate the DWH load, I started to create a PowerShell script runbook in my Azure Automation Account.
Connecting to an (Azure) database from within Databricks
“Connecting to an (Azure) database from within Databricks using revoscalepy by deploying Microsoft’s Machine Learning Server”. I am sure that I am not the first guy typing this line into a search engine, and I’m very sure that I won’t be the last neither. The real power of Python resides in the flexibility of the language and the power of its data frames and the agility to play with data in a very easy way.
OPINION – Is SSRS on Azure happening?
Is SSRS on Azure happening? Well as always in Azure it depends… If you mean that ‘SQL Service Reporting Services’ is going to be provided on Azure, the answer is NO as SSRS is a product name as well as a part of SQL Server.
Using CTAS to efficiently load large tables
An Azure data warehouse is a real powerhouse. Personally, I consider it to be one of the most performant components that can be used and build into the Lambda architecture. Ludicrous power comes with a drawback of course and that drawback is potential inefficiency.
Azure pt.3: Parameterize and trigger
All good things in life consists of 3 parts, and so also this series of blogposts. In previous blogposts we have been creating the Linked Services in Azure and CTAS’ing files from Azure Data Lake into tables on Azure DWH. I finished my previous post by advising you to use Azure Data Factory V2 (ADF) as an orchestration tool for your ELT load.
Azure pt.2: The story continues… Enter Polybase
In the previous blog we have been creating the Linked Services between Azure Data Lake, Azure Data Factory (ADF) and our Azure Database. We have seen the power of the Linked Service, the security model used, and how it glues everything together. In case you have not read my previous blog on Linked Service, I highly recommend doing so before reading this one. We will use the same Application and OAuth2 token created in my previous blog. You can reach the blog using this link.
Azure pt.1: A word on Linked Services in Azure
How to best describe Azure Data Factory (ADF) V2? A friend of mine described it as the ETL of the skies. And since I based almost my entire career on ETL tools, this sounded like music to my ears.
How-To create an ultra-fast, concurrent DataMart for Self-service reports on Azure DWH and Azure DB
With Analysis Services, you can mashup and combine data from multiple data sources, define metrics, and secure your data in a single, trusted semantic data model. The data model provides an easier and faster way for your users to browse massive amounts of data with client applications like Power BI, Excel, Reporting Services, third-party, and even custom apps.
Azure hybrid solutions with on-premise SSRS Server
For the moment, SSRS (SQL server reporting services) is currently not an Azure component. Will it be available in the near future…? I don’t know. SSRS- functionalities become available in other dashboards and reporting tools like Power BI.
Store documents in Azure Blob storage using SQL
One little step in a migration track from on-premise to Azure is related to binary files like images, pdf and others. These files are often stored on many different places: SharePoint, file shares, local folders, SQL file tables, SQL tables as binary objects, etc.
