Posts

Showing posts with the label Azure

Azure Data Lake : 101

Image
We are living in a Digital world where Data is everything and the Ability to process and generate insights to enable Business decision making is the absolute super power you want to have. And in order to process data into meaningful information, it might be a good practice to have a place to store all kinds of data - and Microsoft provides one such storage service with Azure Data lake .  So What is Azure Data Lake Storage?  Azure Data Lake Storage (ADLS) can be literally compared to a large lake/pond, where rain water passing through various terrains gets collected. Irrespective of whether a water stream passing through fields is muddy (or) a water stream passing through a cluster of rocks is clean - a lake would take in the water as it comes.  Just like that ADLS can be considered as a repository that has capacity to hold large amounts of data in their native, raw format.  Data lake storages can be terabytes and petabytes in size. Data can come from multiple heterog...

Azure Data Factory : 101

Image
If you have ever worked with a Data warehousing solution, you would probably say that the most important part of the job is to ensure proper Data ingestion (Data loading). If you lose any data at this point, then the resulting information (reports) will end up inaccurate, failing to represent the facts on which Business decisions are made. Microsoft Azure provides several services which you can use to ingest data and one of them is Azure Data Factory. So What is Azure Data Factory?  Azure Data Factory (ADF) is a Platform-as-a-Service offering from Microsoft. The primary purpose of this service could be to do Extract, Transform and Load (ETL)  or Extract, Load and Transform (ELT) and this is done via using a concept pipelines. Two types of pipelines to begin with - data movement pipelines (Extract & Load) and also data transformation pipelines (Transform). And being a PaaS service, ADF automatically scales out based on the demand enforced using these pipelines. ADF is ...

Azure DevOps and Sample Windows Web App

Image
It has been a while that I wrote a post in here.. been busy days 😅 This is the era of tons of information over WWW and new topics / services are born everyday. And for me, the only logical way to learn some new cool things in this fast paced industry is to  Learn by doing .. and thus, back to sharing what I am doing 😃 Today's learning's:  Azure DevOps (VSTS transformed into DevOps now) Azure Windows Web App (as a service) Azure SQL database Git Push from Visual studio 2017 If you have a Azure account (can also easily create a free account for one time use), one of the first things which will pop up when you login to https://portal.azure.com/ is to Create DevOps project   So I created a new DevOps project and went through the UI experience/suggestions and created a new Windows Web app.  Once I finished the process, Azure will automatically create several resources for me. 1. An Azure DevOps project was create -  https://...

What is Cloud. And what are IaaS, PaaS, and SaaS?

Image
The word " Cloud " is getting more heard and used with days passing by. So what actually is a Cloud (or) a Cloud platform (or) Cloud computing (or) Cloud services. Basically these are platform, computing ability, services respectively which are hosted in some part of the world and are accessible over Internet . To understand the best, we can take an example like electricity. In general, You just use electricity as an utility and pay according to the usage. You would seldom have to build, maintain and generate your own electricity - because of the comfort you receive using electricity as an utility. Cloud services can be mapped to the same concept. Cloud computing services can be of three kinds, private , public and hybrid . And they act as the name suggests. Many articles can be found in the internet on the definitions, pros and cons. Three such major cloud service providers are: Microsoft Azure - https://azure.microsoft.com/en-us/   Amazon web services - https:/...