Posts

Cloud Data Warehousing Advantages

cloud_storage-300x200 Cloud Data Warehousing Advantages

Data warehousing in the cloud

“Why create a data warehouse in the cloud?” I have been answering this question many a times when I go to networking events.

There are a number of cloud data warehousing advantages:

  • Cost savings
  • Total cost of ownership
  • Mergers and acquisitions
  • Standardization
  • Better understanding of competitive landscape
  • Improving product and service quality.

Many enterprises are finding that data warehouse appliances can significantly reduce the total cost of ownership. All resources, including expensive networking equipment, servers, IT personnel, etc are shared, resulting in reduced costs, especially for small to mid-sized applications and prototypes.

In the case of mergers and acquisitions, duplicate financial data warehouses need to be rationalized. An enterprise or government agency may want to rationalize various warehouses based on disparate warehouse technology platforms by moving to a standard platform. Cloud computing enables companies to shift money from capital expenses to operating expenses, enabling the customer to focus on adding value in their areas of core competence, such as business and process insight, instead of building and maintaining IT infrastructure.

In short, cloud computing allows you to focus your money and resources on innovating. “Regardless of the reason for the migration, in every case the reporting and analysis supported by the migrating data warehouse must continue to run seamlessly.” This is a common need expressed by my professional network. Cloud computing platforms such as  Microsoft Azure, provide many of the core services that, under traditional development models, would normally be built in house. These services, plus templates and other tools can significantly accelerate the development cycle.

“What should be the solution?” is the subsequent question that arises during conversation. “Use data visualization to insulate reporting users during data warehouse migrations” is my to-the-point answer. Additionally, data virtualization to the cloud provides a more agile integration approach that overcomes data complexity and disparate silos to provide business with the timely data it needs to meet today’s ever-changing business requirements. Provisioning-on-demand enables faster set-up and tear-down of resources on an as-needed basis. When a project is funded, you initiate service, then if the project is killed, you simply terminate the cloud contract.

Data Virtualization using cloud computing is the opposite of traditional data warehousing. The cloud is more vibrant and valuable in that it’s something elastic that customers can scale up or down with dynamic resource allocation ensuring efficient use of shared processing and storage resources. It wants data to be location independent, transparent and function shippable; whereas, the traditional data warehouse is a centralized, persistent data store. There will be a need for a run-time metadata in order to register and access data sources as a service. Growing data volumes are winning. Still, with cloud computing (as with web services), the service, not the database, is the primary data integration method.

The ability of the cloud to load data quickly allows the vendor to work with larger data sets during smaller time windows as dictated by the customer, as well as service more customers at any one time. While smaller companies may only refresh the data in their data mart weekly, larger customers typically refresh data daily. Moreover, the transactional database of such larger customers can only stay offline for short time periods during which data must be transferred to the data marts.

Data loaded in the data warehouse has to be organized in the best possible way to enable the optimal execution of queries. The managers of on-premise data warehouses and marts constantly look at the queries executed against their databases to determine how to best organize the data to achieve best query execution times. Some of these optimizations can be performed automatically by the database management system but most require manual intervention. Having full control of the database management system enables the SaaS BI vendor to better optimize the organization of the stored data.

Finally, the emotion of the language used to query the data mart in the cloud determines the range of data analyses that can be performed and reports that can be created by the business intelligence tools (like Microsoft SSRS). Cloud infrastructure also contributes to the speed with which queries are executed that generates quick analytics reports.

As a business intelligence vendor in Vancouver, OptimusAnalytics would be happy to share our experiences with you. To learn more about cloud based data warehouse solutions, contact me directly at rupmeet.singh@optimusinfo.com

(image credit: Goma on Flickr)

Windows Azure: Move your applications to the cloud

Windows-Azure-300x190 Windows Azure: Move your applications to the cloud

Set your apps up in the cloud using Windows Azure.

Many clients have been asking us about the Windows Azure platform so we’d like to take this opportunity to give a brief overview and let you know what we’ve been working on.

The Windows Azure platform is a platform-as-a-service offering from Microsoft that competes with Rackspace, Amazon Web Services, and Salesforce. It is everything you need to move your applications to the cloud. This enables developers to focus on developing great applications, instead of worrying about infrastructure.

It supports a variety of programming languages out of the box including Visual Studio, .Net, Java, PHP, and Ruby.

As illustrated above, using the Azure platform you can deploy your application, database, services, and access control service to the cloud. Then you can control who has access remotely while deploying your application through Microsoft’s globally distributed datacenters. The Azure platform will then automatically scale infrastructure up and down depending on load and charge only what you use. There are no upfront costs and organizations even have a free trial to get started.

A few other key components worth mentioning are:

  • The Azure Platform Appliance: If you need to keep your applications and data in your own data center, you can setup a private cloud using the Azure Platform Appliance. It is essentially a suite of software and hardware to setup on your own infrastructure. It is designed to be extremely efficient while providing massive scale.
  • The Azure Market Place: This is a market place for components, applications, and even services that run on Azure.
  • The Azure Data Market: This market is used for buying and selling raw data. From real estate to demographics, these data sets are rich with information that can be utilized in your applications.

At Optimus we focus on Software Development, Software Testing, and Business Analytics. We have been working with our clients to move all three services onto cloud based infrastructure. It has proven to be reliable, scalable, and increasingly cost efficient.

To learn more about how you can move your applications to cloud, contact us.

(image courtesy of Microsoft)