AmazonRedShift service for Big Data

Redshift es un servicio de Amazon cloud services que ofrece Peta-data scale fully managed data warehouse. Este servicio hace mas efectivo, rapido, elastico y mejor costo-beneficio para aplicaciones que usan Big Data como business inteligence or Analytics.

Amazon RedShift promete ser totalmente compatible con otras herramientas para procesar BigData como generador de reports, ETLs, dashboard etc.

Para tener una rapida idea sobre la arquitectura tecnica de Redshift puede visitar este sition: RedShift System Architecture

El servicio se basa en un cluster que esta formado por una serie de nodos que pueden crecer o reducir de acuerdo con la necesidad de proceso ( compute ) o de memoria ( storage ). Amazon Redshift ofrece una guia muy completa para ayudar al usuario desde la creacion del clusters, nodos, networks hasta el proceso para subir, verificar y uctualizar data en el datawarehouse.

Aqui puede consultar la guia y tambien videos: Starting Amazon Redshift

 

En la guia tambien hay sugerencias para hacer el diseno del Datawarehouse y los procesos asociados con los datos, mas eficiente y menos costoso.

why openstack is so cloud popular

Muchas companias alrededor del globo estan adoptando cloud computing model and services. Dentro de esta nuevo modelo www.openstack.org se esta consolidando como la plataforma, algunos llaman cloud OS ( operating System) lider a la hora de implementar cloud solutions.

Openstack es suficientemente solida y segura y ha demostrado ser una excellente plataforma con solido soporte a la hora de pensar en cloud model.

Si esta interesado en tener una business perspective sobre que es, como funciona y servicios que ofrece openstack le sugiero este documento

Recientemente se publico un encuesta de usurarios de openstack donde se muestra los beneficios y demas razones de usar openstack.

DevOps performance, and organizational performance.

Una encuesta de Puppet Labs muestra algo que se presumia pero que no estaba muy bien soportado y es que las empresas que tiene altos estandares en su IT infraestructure producen e instalan codigo 30 veces mas y producen 50% menos errores que las organisationes con pobre IT standares.

En este mismo orden de ideas las organisations con altos estandares en su IT infrasctructure tienen el doble de posibilidades de alcanzar o exceder sus objetivos globales comparadas con las de pobre IT infrastructure.

Esto muestra claramente el impacto positivo y concreto de una buena plataforma y cultura del IT sobre los objetivos globales de la Organizacion; Y de igual manera indica claramente las desventajas y riesgos para los objetivos globales de una organizacion, el hecho de tener una pobre cultura e insfraestructure informatica

Otro punto interesante en esta encuesta es la importancia de la cultura de trabajar enfocado en DevOps.

Pondre mas informacion sobre este topico en otra publicacion.

Cloud Computing Deployment Models

There are four models to deploy applications/services on the cloud.

Private cloud. The cloud infrastructure is provisioned for exclusive use by a single organization comprising multiple consumers (e.g., business units). It may be owned, managed, and operated by the organization, a third party, or some combination of them, and it may exist on or off premises.

Features of Private cloud:

• Internal to the enterprise

• Buy or lease model

• Secure infrastructure

• Dedicated infrastructure

• Resources are pooled and managed internally

• Internal security practices can be extended to the private cloud

• Greater control and resilience

• Greater customization and configuration

• Greater efficiencies and effectiveness

• Protected by a firewall

• Virtualization technology most adaptable for the private cloud

• Better cost management

• “Cloud computing at home”

Public cloud. The cloud infrastructure is provisioned for open use by the general public. It may be owned, managed, and operated by a business, academic, or government organization, or some combination of them. It exists on the premises of the cloud provider.

Features of public cloud:

• Universal usage

• Variety of functions

• Variable fee arrangements

• Multi-tenant infrastructure

• Cloud Service Provider (CSP) is responsible for setting up most of the resources namely hardware, software, network, communication, applications, security

• Some level of configurations and customizations

• Public cloud does not imply that the date is public

• Access control and mechanism may be in place

• May be a pay per use or on demand model

• May cost something and may not always be free

• May be a good avenue for Open Data

Hybrid cloud. The cloud infrastructure is a composition of two or more distinct cloud infrastructures (private, community, or public) that remain unique entities, but are bound together by standardized or proprietary technology that enables data and application portability (e.g., cloud bursting for load balancing between clouds).

Community cloud. The cloud infrastructure is provisioned for exclusive use by a specific community of consumers from organizations that have shared concerns (e.g., mission, security requirements, policy, and compliance considerations). It may be owned, managed, and operated by one or more of the organizations in the community, a third party, or some combination of them, and it may exist on or off premises.

 

Cloud Computing Service Models.

Cloud computing offer three main service models:

Software as a Service (SaaS). The capability provided to the consumer is to use the provider’s applications running on a cloud infrastructure2. The applications are accessible from various client devices through either a thin client interface, such as a web browser (e.g., web-based email), or a program interface. The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, storage, or even individual application capabilities, with the possible exception of limited user-specific application configuration settings.

Platform as a Service (PaaS). The capability provided to the consumer is to deploy onto the cloud infrastructure consumer-created or acquired applications created using programming languages, libraries, services, and tools supported by the provider.3 The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, or storage, but has control over the deployed applications and possibly configuration settings for the application-hosting environment.

Infrastructure as a Service (IaaS). The capability provided to the consumer is to provision processing, storage, networks, and other fundamental computing resources where the consumer is able to deploy and run arbitrary software, which can include operating systems and applications. The consumer does not manage or control the underlying cloud infrastructure but has control over operating systems, storage, and deployed applications; and possibly limited control of select networking components (e.g., host firewalls).

There are others services getting relevance such as Mobiles as a Service or Desktop as a Service.

What is Cloud Computing ?

DEFINITION OF CLOUD COMPUTING.

Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. This cloud model is composed of five essential characteristics, three service models, and four deployment models.

FIVE CHARACTERISTICS OF CLOUD COMPUTING.

On-demand self-service. A consumer can unilaterally provision computing capabilities, such as server time and network storage, as needed automatically without requiring human interaction with each service provider.

Broad network access. Capabilities are available over the network and accessed through standard mechanisms that promote use by heterogeneous thin or thick client platforms (e.g., mobile phones, tablets, laptops, and workstations).

Resource pooling. The provider’s computing resources are pooled to serve multiple consumers using a multi-tenant model, with different physical and virtual resources dynamically assigned and reassigned according to consumer demand. There is a sense of location independence in that the customer generally has no control or knowledge over the exact location of the provided resources but may be able to specify location at a higher level of abstraction (e.g., country, state, or datacenter). Examples of resources include storage, processing, memory, and network bandwidth.

Rapid elasticity. Capabilities can be elastically provisioned and released, in some cases automatically, to scale rapidly outward and inward commensurate with demand. To the consumer, the capabilities available for provisioning often appear to be unlimited and can be appropriated in any quantity at any time.

Measured service. Cloud systems automatically control and optimize resource use by leveraging a metering capability at some level of abstraction appropriate to the type of service (e.g., storage, processing, bandwidth, and active user accounts). Resource usage can be monitored, controlled, and reported, providing transparency for both the provider and consumer of the utilized service.