I love the cloud! I think the first time I heard of it was way back when google were launching its google docs style apps and to me it just made so much sense. No expensive upfront payments, your documents and work items available across all your devices if you could connect to the internet, and the apps would be updated for you as and when the developer pushed updates. Awesome!
Then the likes of Azure and AWS came on the scene (they did in my eyes anyway, I can’t remember what order everything was released or became most popular first), the idea of renting someone else’s hardware as and when you needed it, now more commonly known as IaaS (Infrastructure as a Service) was a great idea. Of course, early on you are always going to be weary around security and things like that, but the concept seemed so simple yet so useful. For me though at the time I didn’t have the need, the business I was working for had plenty in terms of infrastructure and storage but was always cool to spin stuff up on in labs on any training courses I attended.
From a data and analytics point of view the offerings that have become available and gained traction over the last couple of years are where, in my eyes, things become really cool (nerd alert!). The PaaS offerings in Azure from a data platform are, from my point of view, very useful. Microsoft describes PaaS as:
Platform as a service (PaaS) is a complete development and deployment environment in the cloud, with resources that enable you to deliver everything from simple cloud-based apps to sophisticated, cloud-enabled enterprise applications. You purchase the resources you need from a cloud service provider on a pay-as-you-go basis and access them over a secure Internet connection.
Like IaaS, PaaS includes infrastructure – servers, storage and networking – but also middleware, development tools, business intelligence (BI) services, database management systems and more. PaaS is designed to support the complete web application life cycle: building, testing, deploying, managing, and updating.
PaaS allows you to avoid the expense and complexity of buying and managing software licences, the underlying application infrastructure and middleware or the development tools and other resources. You manage the applications and services that you develop, and the cloud service provider typically manages everything else.
And it’s that last paragraph where I think PaaS really comes into its own in the data and analytics space, you don’t have to worry about expensive upfront costs, you don’t need to spec an environment for its theoretical largest, it allows some of the less “tech savvy” amongst us to get started on a project without worrying about complicated Infrastructure.
Some organisations still like to have full control of their systems though and might opt for your more traditional cloud computing with a bunch of VMs, which is also fine but here are some of my thoughts when comparing IaaS to PaaS:
|Business: Quick transition to Cloud||Business: Low Total Cost of Ownership|
|Technology: Mature ISV Ecosystem||Business: Accelerates Innovation|
|Technology: Complete Control||Technology: Better Development Operations|
|Technology: Solution Portability||Technology: Mitigates Vulnerability Risks|
|Business: Expensive to Operate||Harder Cloud Transition|
|Business: Slows Down Innovation||Technology: Application Portability Issues|
|Business: Security Risks from Unpatched Servers||Technology: PaaS ISV Ecosystem is not as mature as IaaS|
|Technology: Difficult to Maintain Legacy Apps||Technology: Different Codebases for Cloud and Premise|
|Technology: Requires Rigorous Processes for Enabling DevOps|
|Technology: Requires Rigorous Server Maintenance Processes|
Getting back to the data and analytics space, Microsoft Azure now has a full arrange of PaaS services to suit your needs. I will cover some of these services in more detail in a separate post but some of these include:
Azure Data Lake Store
Azure Blob Storage
SQL Data Warehouse
Azure Cosmos Db
Azure Data Lake Analytics
Data Factory V2
Azure Stream Analytics
Azure Analysis Services
Power BI (slightly different but to complete the platform)
Together these services offer a full end to end data and analytics offering. Not only that but you have flexibility and choice to suit your project.
People far more suited than me explain this architecture better than I do and their blog posts can be found here –
Now I’m in a position where I am living and breathing these services every day and I try my absolute best to keep up with the frequent updates that keep coming. After carrying out several strategic reviews for customers now, I have started to build and refer to our own reference architecture, from a high level this is pretty much what it looks like:
To quickly sum up my thoughts… these services are definitely becoming more and more popular. Time and money is being spent on improving them, offering more features, making them easier to use, more supporting information so becoming more and more attractive propositions all the time! You might have been able to tell that I am a massive fan already and cannot wait to see what the future holds, not just for Azure’s data platform but for cloud computing as a whole (but mainly for Azure’s data platform 😊).