Azure Cloud

14 Jan 2019 Data Lake Security and Governance best practices

Data Lakes are the foundations of the new data platform, enabling companies to represent their data in an uniform and consumable way. In this document, we’ll describe how to setup a Data Lake in such a way that it will become the efficient Data Lake that users are looking for.

16 Dec 2018 All I want for Christmas is you

Oh, this is cheesy, can’t believe we could ever dare to mention Mariah Carey in our blogpost series.  Well, the holiday season is starting, so there is no escape at all 😊. By the way, what I meant with the title was: All I need for Christmas is you… Azure Data Flow. 

30 Nov 2018 When an Azure runbook does not recognize your cmdlets…

Automating a Data Factory pipeline using a runbook seemed like an easy last step in a Azure DWH setup I developed lately. The part in my script responsible to start and stop the DWH ran without problems, but then ...

21 Nov 2018 Connecting to an (Azure) database from within Databricks

I made a very useful ELT program in python and wanted it do run inside a Databricks cluster. Databricks on Azure fully supports python 3, so I thought I was up for a walk in the park. Trying to import the database connection classes, already gave a small hint of the troubles ahead...

20 Nov 2018 OPINION – Is SSRS on Azure happening?

Is SSRS on Azure happening? Well as always in Azure it depends… If you mean that ‘SQL Service Reporting Services’ is going to be provided on Azure, the answer is NO as SSRS is a product name as well as a part of SQL Server. But...

03 Oct 2018 Using CTAS to efficiently load large tables

An Azure data warehouse is a real powerhouse. Personally, I consider it to be one of the most performant components that can be used and build into the Lambda architecture. Ludicrous power comes with a drawback of course and that drawback is potential inefficiency.

07 Aug 2018 Azure pt.3: Parameterize and trigger

In previous blogposts we have been creating the Linked Services in Azure and CTAS’ing files from Azure Data Lake into tables on Azure DWH.  I finished my previous post by advising you to use Azure Data Factory V2 (ADF) as an orchestration tool for your ELT load. This is exactly what we’ll be doing in this post. 

06 Aug 2018 Azure pt.2: The story continues… Enter Polybase

Enter Polybase External Tables.  A technology introduced in SQL Server Parallel Datawarehouse (PDW) around 2013 and became more generally available since SQL 2016, allowing you to read flat files as easy as if they were database tables. 

04 Aug 2018 Azure pt.1: A word on Linked Services in Azure

How to best describe Azure Data Factory (ADF) V2?  A friend of mine described it as the ETL of the skies.  And since I based almost my entire career on ETL tools, this sounded like music to my ears. After running a nice project in ADF I can now look back on this statement, and conclude there is some truth behind it.

29 May 2018 Azure hybrid solutions with on-premise SSRS Server

For the moment, SSRS (SQL server reporting services) is currently not an Azure component. Will it be available in the near future…? I don’t know. SSRS- functionalities become available in other dashboards and reporting tools like Power BI. Today, you’ll need to work with an on-premise installed SSRS server or you'll have to setup one in an Azure VM.

15 May 2018 Store documents in Azure Blob storage using SQL

One little step in a migration track from on-premise to Azure is related to binary files like images, pdf and others. These files are often stored on many different places. When these files are stored in SQL, you probably have already created a variety of SQL procedures. But you can also use Azure blob-storage.

13 May 2018 Using Azure Blob storage in SSRS reports

Attractive reports are not only showing the hard material statistics and numbers. Visualization of your data leads more and more to graphical decision making. One particular part of your reports are images for logo’s, product images etc. When moving to the cloud, where do we need to store and find our data and images?

11 May 2018 Hybrid cloud solutions

I truly believe in the azure environment. The possibilities are huge and growing every day. Do we all need to migrate to the cloud ‘sito-presto’…yes, I think so. Why I’m so sure about this, is easy to explain. The most important reasons for me are: cost-efficient architecture possibilities and lower maintenance due to very stable architecture solutions.

09 May 2018 How-To create an ultra-fast, concurrent DataMart for Self-service reports on Azure DWH and Azure DB

With Analysis Services, you can mashup and combine data from multiple data sources, define metrics, and secure your data in a single, trusted semantic data model. The data model provides an easier and faster way for your users to browse massive amounts of data with client applications.

07 May 2018 Azure SQL Datawarehouse “Gen 2”: a mayor game changer

Moving Azure SQL Datawarehouse to the cloud made it available for the majority of all companies, enabling them to use this workhorse as a powerful engine to drive their analytical needs. Now the "Gen 2" is five times faster than the already blazing fast Gen1.

06 Feb 2018 Azure Data Architectures: Lambda

Are you familiar with the lambda architecture? It actually splits data flows into two components, receiving data centrally and doing as little as possible processing before copying and splitting the data stream into two streams, namely the real time and batch layers.

17 Jan 2017 Why invest in data science?

As you might have noticed, data science is not just a buzz word anymore. It has become serious business! Why?

21 Jun 2016 How to get your business ready for the cloud?

Cloud computing is no longer just a buzzword, it is here to stay. Companies should prepare by looking into cloud technology and getting their cloud strategy sorted out. If you look at cloud computing in its most basic form, you could simply call it store stuff on the internet. Although this is partially true, the cloud has much more to offer.