In business intelligence we extract data from everywhere. Besides the technical structures that define how the data is stored, we also need to understand the business processes behind that structure. It’s all in the name, right?
If it was as easy as simply extracting the data from the source and loading it directly into the data warehouse, BI analysts/developers would become redundant. In many cases the incoming data is transformed, which entails extra business rules or logic being applied to obtain a final, correct, expanded data set that makes sense to the business user and offers clear insights.
If a business rule isn’t translated properly into a technical transformation, this early error – which can be a small detail – made between analysis and development will cascade further and can have disastrous results. Defining this translation requires communicating with the people involved at the technical and the business level. This can mean meeting up, calling, or in most cases emailing the relevant people. In my personal experience, I’ve noticed that a visualization of a question/problem tends to give people a better understanding of the issue and involves them more effectively. A diagram is concise, more appealing and less prone to ambiguity, which goes hand in hand with the KISS principle (Keep It Short and Simple). Remember, nobody is waiting for the 100th mail of the day with pages of text.
You can create clear diagrams with Lucidchart. The application is a direct competitor of Microsoft’s Visio, which also offers extensive capabilities, but Lucidchart has the advantage of being cloud-based, so you don’t have to install anything. Since the customer often provides a workstation, it means you have access to a cloud-based working environment and a document repository for free. These benefits are why I choose Lucidchart over Visio. Being free also means having limited capabilities, but you still have a diverse range of options.
The user interface is appealing, responsive and intuitive, so you can get started quickly. You can import and export to Visio files and although this isn’t a free feature, it’s nice to know that the tool offers this kind of extensibility.
The main benefits of Lucidchart for me as an individual user:
Next I will explain two personal kinds of visualizations that recur from time to time.
Business user vs the BI developer:
Business needs often involve time as a transformation parameter. In my eyes this can quickly become a maze, especially if the business user is defining cases on the spot. Figure 2 shows the results of a first meeting with the business user. I have visualized 3 different cases based on a timeline (grey line), events (yellow rectangles) and contracts (green rectangles). All kinds of events can happen within a specific time period of a contract. The visual representation acts as a starting point for helping the business to think about new cases more easily: for instance, what if I drag a yellow rectangle behind a green rectangle? Moreover, this way we have common concepts based on colour: a timeline, an event and a contract. So we are always talking about the same things when communicating with each other. While this may seem self-evident, my experience teaches me that this is definitely not always the case.
Technical user vs the BI developer:
After the business requirements have been defined, a lot of times you will be searching for the correct data. This means going to the technical person who has knowledge of the data source: an application developer, functional analyst, etc. Sometimes this is a real hassle because of the normalization of OLTP systems, which xxx. You have your business definition that you can explain to the technical person and normally they should be able to point you in the right direction. But this isn’t enough. Remember, the devil is in the detail.
Occasionally I have been presented with an ERD (Entity Relationship Diagram), which made all the difference. So I have tried to create my own ERDs for source entities/tables, especially for longer assignments. Sometimes it may seem like overkill to make an ERD for 3 entities, but I have learned that with new business requirements new tables will have to be migrated with or without additional transformations. After a year you may end up extracting data from 40 entities and then a good ERD will prove its worth as a blueprint for offering quick insights.
Do we have to visualize everything? Of course not, but when it is the most efficient way to explain complex problems, define business cases, dissect database structures and so on, don’t be afraid to try it.
© 2023 Kohera
Crafted by
© 2022 Kohera
Crafted by
Cookie | Duration | Description |
---|---|---|
ARRAffinity | session | ARRAffinity cookie is set by Azure app service, and allows the service to choose the right instance established by a user to deliver subsequent requests made by that user. |
ARRAffinitySameSite | session | This cookie is set by Windows Azure cloud, and is used for load balancing to make sure the visitor page requests are routed to the same server in any browsing session. |
cookielawinfo-checkbox-advertisement | 1 year | Set by the GDPR Cookie Consent plugin, this cookie records the user consent for the cookies in the "Advertisement" category. |
cookielawinfo-checkbox-analytics | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics". |
cookielawinfo-checkbox-functional | 11 months | The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional". |
cookielawinfo-checkbox-necessary | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary". |
cookielawinfo-checkbox-others | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other. |
cookielawinfo-checkbox-performance | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance". |
CookieLawInfoConsent | 1 year | CookieYes sets this cookie to record the default button state of the corresponding category and the status of CCPA. It works only in coordination with the primary cookie. |
elementor | never | The website's WordPress theme uses this cookie. It allows the website owner to implement or change the website's content in real-time. |
viewed_cookie_policy | 11 months | The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data. |
Cookie | Duration | Description |
---|---|---|
__cf_bm | 30 minutes | Cloudflare set the cookie to support Cloudflare Bot Management. |
pll_language | 1 year | Polylang sets this cookie to remember the language the user selects when returning to the website and get the language information when unavailable in another way. |
Cookie | Duration | Description |
---|---|---|
_ga | 1 year 1 month 4 days | Google Analytics sets this cookie to calculate visitor, session and campaign data and track site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognise unique visitors. |
_ga_* | 1 year 1 month 4 days | Google Analytics sets this cookie to store and count page views. |
_gat_gtag_UA_* | 1 minute | Google Analytics sets this cookie to store a unique user ID. |
_gid | 1 day | Google Analytics sets this cookie to store information on how visitors use a website while also creating an analytics report of the website's performance. Some of the collected data includes the number of visitors, their source, and the pages they visit anonymously. |
ai_session | 30 minutes | This is a unique anonymous session identifier cookie set by Microsoft Application Insights software to gather statistical usage and telemetry data for apps built on the Azure cloud platform. |
CONSENT | 2 years | YouTube sets this cookie via embedded YouTube videos and registers anonymous statistical data. |
vuid | 1 year 1 month 4 days | Vimeo installs this cookie to collect tracking information by setting a unique ID to embed videos on the website. |
Cookie | Duration | Description |
---|---|---|
ai_user | 1 year | Microsoft Azure sets this cookie as a unique user identifier cookie, enabling counting of the number of users accessing the application over time. |
VISITOR_INFO1_LIVE | 5 months 27 days | YouTube sets this cookie to measure bandwidth, determining whether the user gets the new or old player interface. |
YSC | session | Youtube sets this cookie to track the views of embedded videos on Youtube pages. |
yt-remote-connected-devices | never | YouTube sets this cookie to store the user's video preferences using embedded YouTube videos. |
yt-remote-device-id | never | YouTube sets this cookie to store the user's video preferences using embedded YouTube videos. |
yt.innertube::nextId | never | YouTube sets this cookie to register a unique ID to store data on what videos from YouTube the user has seen. |
yt.innertube::requests | never | YouTube sets this cookie to register a unique ID to store data on what videos from YouTube the user has seen. |
Cookie | Duration | Description |
---|---|---|
WFESessionId | session | No description available. |