Elastic Compute Cloud

 EC2

Budget for AWS account setup

  • Can be enabled by root account as even admin account don't have access to it.
  • As you need to activate it from root account so that IAM user and role can use this facility.
  • After enabling the setting from root user then we can use admin role to check the billing and cost forecasting facility in AWS.
  • Free tires will help you to see all the facilities which are running at the moment and can lead to expanse. So it will help to know the service and you can close them if not needed.
  • We can create a budget for the month, for zero cost budget you can select the type of budget and can provide your email id to check the budget related alerts.
  • Email receiving criteria is 85%, 100% and above 100% usage.

EC2 basics:

  • Most popular AWS offering
  • EC2 - Elastic Compute Cloud - Infrastructure as a Service
  • It mainly consists in the capability of:
    • Renting virtual machines (EC2)
    • Storing data on virtual drives (EBS)
    • Distributing load across machines (ELB)
    • Scaling the services using an auto-scaling group (ASG)
  • Knowing EC2 is fundamental to understand how the cloud works

EC2 sizing and configuration options

  • Operating System (OS): Linux, Windows or Mac OS
  • How much compute power and cores (CPU)
  • How much random-access memory (RAM)
  • How much storage space:
    • Network-attached (EBS and EFS)
    • Hardware (EC2 Instance Store)
  • Network Card: speed of the card, Public IP address
  • Firewall rules: security group
  • Bootstrap script (configuration at first launch): EC2 User Data

ECS User Data

  • It is possible to bootstrap our instance using an EC2 User Data script
  • bootstrapping means launching commands when a machine starts
  • This script is only run once at the instance first start
  • EC2 user data is used to automate boot tasks such as:
    • Installing updates
    • Installing software
    • Downloading common files from the internet
    • Anything you can think of
  • The EC2 User data script runs with the root user

EC2 instance types: example

t2.micro is part of the AWS free tier (up to 750 hours per month)

Hands-On: Launching an EC2 Instance running Linux

  • We'll be launching our first virtual server using the AWS Console
  • We'll get a first high-level approach to the various parameters
  • We'll see that our web server is launched using EC2 user data
  • We'll learn how to start/stop/terminate our instance.
  • Key pair for ssh can be of RSA encryption and we can use .pem for linux and windows or Mac and .ppk for putty windows 7 and windows 8.

EC2 Instance Types:

  • You can use different types of EC2 instances that are optimized for different use cases (https://awe.amazon.com/ec2/instance-types/)
  • AWs has the following naming convention: m5.2xlarge
  • m: instance class
  • 5: generation (AWS improves them over time)
  • 2xlarge: size within the instance class
HPC Optimized is also a type of instance for EC2

General Purpose Instances:

  • Great for a diversity of workloads such as web servers or code repositories
  • Balance between:
    • Compute
    • Memory
    • Networking
  • t2.micro is a free tier general purpose EC2 instance.

Compute Optimized

  • Great for compute-intensive tasks that require high performance processors:
    • Batch processing workloads
    • Media transcoding
    • High performance web servers
    • High performance computing (HPC)
    • Scientific modeling and machine learning
    • Dedicated gaming servers
    • c6g is one of the example of it. It start with C.

Memory Optimized

  • Fast performance for workloads that process large data sets in memory
  • Use cases:
    • High performance, relational/non-relational databases
    • Distributed web scale cache stores
    • In-memory databases optimized for BI (business intelligence)
    • Applications performing real-time processing of big unstructured data
    • starts with R, X, high memory and z

Storage Optimized

  • Great for storage-intensive tasks that require high, sequential read and write access to large data sets on local storage
  • Use cases:
    • High frequency online transaction processing (OLTP) systems
    • Relational and NoSQL databases
    • Cache for in-memory databases (for example, Redis)
    • Data warehousing applications
    • Distributed file systems
    • It start with I, D, H

Please check the above screenshot for comparison as given in EC2 instance type.


Comments

Post a Comment

Popular posts from this blog

Machine Learning

Image
 Machine Learning Amazon Rekognition Find objects, people, text, scenes in images and videos using ML Facial analysis and facial search to do user verification, people counting Create a database of "familiar faces" or compare against celebrities Use cases: Labeling Content Moderation Text Detection Face Detection and Analysis (gender, age ranges, emotions...) Face Search and Verification Celebrity Recognition Pathing (ex: for sports game analysis) Amazon Transcribe Automatically convert speech to text Uses a deep learning process called automatic speech recognition (ASR) to convert speech to text quickly and accurately Automatically remove Personally Identifiable Information (PII) using Redaction Supports Automatic Language Identification for multi-lingual audio Use cases: transcribe customer service calls automate closed captioning and subtitling generate metadata for medis assets to create a fully searchable archive Amazon Polly Turn text into lifelike speech using deep lea...
Read more

Cloud Computing and IT

Image
Cloud Computing and IT How Website work?   Server composed of: Compute, memory, storage(file or database), network - Routers, switch, DNS server. IT terminology: Network: cables, routers and servers connected with each other. Router: A networking device that forwards data packets between computer networks. They know where to send your packets on the internet. Switch: takes a packet and send it to the correct server/client on your network. Problems: Pay rent for datacenter Pay for power, cooling and maintenance Adding and replacing hardware takes time Scaling is limited Hire 24/7 team to monitor the infrastructure Plan for taking care of disasters. eg: Earth-Quake, Power-Supply issue etc... Demand: How to externalize all above task? Solution: Cloud Cloud Computing: (on-demand/pay-as-you-go/) Cloud computing is the on-demand delivery of compute power, database storage, applications and other IT resources. Cloud services are pay-as-you-go pricing. Provision exactly the right type and ...
Read more

Cloud Monitoring

Image
 Cloud Monitoring Amazon CloudWatch Metrics CloudWatch provides metrics for every services in AWS Metric is a variable to monitor ( CPUUtilization, Networking...) Metrics have timestamps Can create CloudWatch dashboards of metrics Important Metrics EC2 instances: CPU Utilization, Status Checks, Network (not RAM) Default metrics every 5 minutes Option for Detailed Monitoring ($$$): metrics every 1 minute EBS volumes: Disk Read/Writes S3 buckets: BucketSizeBytes, NumberOfObjects, AllRequests Billing: Total Estimated Charge (only in us-east-1) Service Limits: how many you've been using a service API Custom mertics: push your own metrics Amazon CloudWatch Alarms Alarms are used to trigger notifications for any metric Alarms actions Auto Scaling: increase or decrease EC2 instances "desired" count EC2 Actions: stop, terminate, reboot or recover an EC2 instance SNS notifications: send a notification into an SNS topic Various options (sampling, %, max, min, etc...) Can choose the...
Read more