Learn AWS Compute and Storage In Action

Mental model production untuk memahami AWS compute dan storage sebagai satu sistem: execution, state, placement, durability, latency, failure domain, dan cost function.

Workload Taxonomy and Decision Map

24 min

Taxonomy workload dan decision map untuk memilih kombinasi AWS compute-storage berdasarkan behavior aplikasi, state contract, scaling shape, failure mode, dan operational ownership.

Placement, Time, State, and Failure Domains

Membentuk mental model production tentang placement, time, state, Availability Zone, Region, control plane, data plane, dan failure domain pada AWS Compute dan Storage.

Cloud Capacity as a Control System

Membangun mental model kapasitas cloud sebagai control system: demand signal, saturation, autoscaling, queueing, warmup, drain, backpressure, dan failure mode elastisitas.

Storage as Contract, Not Disk

Storage sebagai kontrak produksi, bukan sekadar disk: access semantics, durability, consistency, lifecycle, ownership, mutability, recovery, dan cost function di AWS.

AWS Compute-Storage Service Selection

Decision framework praktis untuk memilih layanan AWS compute dan storage berdasarkan execution model, state contract, placement, scaling, recovery, performance, dan cost.

Production Invariants for Compute-Storage

8 min

Production invariants untuk desain AWS compute-storage yang resilient, rebuildable, observable, cost-aware, dan aman dioperasikan dalam failure nyata.

Reference Architecture Map

8 min

Peta reference architecture compute-storage production-grade di AWS, mencakup synchronous API, async worker, object/block/file storage, batch, serverless, observability, recovery, dan evolution path.

EC2 From First Principles

EC2 from first principles: virtual machine, Nitro, lifecycle, metadata, storage attachment, tenancy, blast radius, and production recovery model.

EC2 Instance Family Selection

How to select EC2 instance families using workload signals, bottleneck analysis, CPU/memory/network/storage/accelerator trade-offs, cost, quota, and production risk.

EC2 Sizing with Real Workload Signals

26 min

How to size EC2 instances using real workload signals: CPU, memory, network, EBS, latency, throughput, queue depth, Java runtime behavior, headroom, and production feedback loops.

AMI, Golden Image, and Bootstrapping

How to design AMIs, golden images, user data, cloud-init, bootstrap contracts, EC2 Image Builder pipelines, patching, drift control, rollback, and production-safe bootstrapping.

Launch Templates and Instance Fleet Design

13 min

Deep production guide to EC2 Launch Templates, versioning, fleet contracts, Auto Scaling integration, metadata options, block device mappings, tagging, rollout safety, and failure-aware instance fleet design.

EC2 Network and Storage Attachment Model

11 min

Deep guide to the EC2 attachment model across ENI, EBS, root volumes, instance store, block device mappings, AZ-local constraints, identity, lifecycle coupling, and production failure modes.

EC2 Operating System Tuning

13 min

Deep practical guide to EC2 operating-system tuning for production workloads, covering Linux kernel boundaries, systemd, ulimit, networking, EBS I/O, filesystem mounts, observability, JVM/runtime interaction, and safe tuning rollout.

EC2 Failure Recovery and Rebuildability

9 min

Production-grade guide to EC2 failure recovery and rebuildability, covering replace-over-repair, Auto Scaling health replacement, status checks, boot failure triage, node quarantine, lifecycle hooks, state preservation, rollback, and incident runbooks.

EC2 Stateful vs Stateless Patterns

Stateful vs stateless EC2 patterns, ownership boundary, recovery model, EBS lifecycle, instance store risk, and production design for applications that run on EC2.

EC2 Placement Groups and Performance Shape

EC2 placement groups, performance shape, failure domain trade-offs, cluster/spread/partition strategy, and production patterns for high-throughput and low-latency workloads.

EC2 Spot, On-Demand, and Capacity Risk

EC2 capacity and purchasing strategy for production workloads, including On-Demand, Spot, Reserved Instances, Savings Plans, mixed instance fleets, interruption handling, capacity diversification, and failure-aware cost optimization.

EC2 Production Runbook and Debugging

Production EC2 debugging runbook covering boot failure, SSH loss, status checks, disk full, EBS latency, kernel panic, network reachability, ASG health, and safe recovery procedures.

Auto Scaling Control Loop

Deep production guide to Amazon EC2 Auto Scaling as a feedback control loop: demand signal, desired capacity, scaling policies, warmup, cooldown, metric selection, queue backpressure, and failure modes.

Auto Scaling Group Design

Production design guide for Amazon EC2 Auto Scaling Groups covering min max desired capacity, health checks, launch templates, lifecycle hooks, termination policies, instance refresh, scale-in protection, and failure modes.

Scaling Policies and Metric Selection

24 min

Deep production guide to Amazon EC2 Auto Scaling scaling policies and metric selection: target tracking, step scaling, scheduled scaling, predictive scaling, queue-based scaling, custom metrics, bad metrics, and operational failure modes.

Mixed Instance Policy and Capacity Diversification

Deep production guide to Auto Scaling mixed instance policy and capacity diversification: Spot, On-Demand, allocation strategies, weighted capacity, instance requirements, compatibility, fallback, interruption handling, and failure modes.

Warm Pools and Fast Recovery

Warm pools, pre-initialized capacity, fast scale-out, lifecycle hooks, cold-start reduction, cost trade-off, and operational runbooks for production EC2 Auto Scaling fleets.

Node Draining and Graceful Termination

Graceful node termination for EC2 Auto Scaling fleets: lifecycle hooks, ALB deregistration, request draining, queue worker shutdown, ECS/EKS node draining, state safety, and production runbooks.

Capacity Planning and Load Shape

Capacity planning dan load shape untuk EC2 Auto Scaling fleet: demand signal, SLO, queueing, headroom, forecast, quota, cost, dan production runbook.

Fleet Chaos and Capacity Game Days

15 min

Fleet chaos dan capacity game days untuk AWS EC2 Auto Scaling: AZ loss, Spot interruption storm, bad AMI rollout, scaling lag, quota exhaustion, storage bottleneck, dan incident rehearsal.

EBS Block Storage Mental Model

EBS block storage mental model for production engineering: network-attached block device, AZ boundary, durability boundary, attachment lifecycle, filesystem contract, latency path, failure modes, and debugging model.

EBS Volume Types and Workload Fit

Practical decision framework for EBS volume types and workload fit: gp3, io2, st1, sc1, IOPS, throughput, latency, queue depth, cost model, migration, benchmarking, and production runbooks.

EBS Performance Engineering

EBS performance engineering from first principles: IOPS, throughput, latency, queue depth, filesystem behavior, benchmarking, CloudWatch signals, OS-level diagnostics, and production tuning.

EBS Snapshots and Data Protection

EBS snapshots and data protection from production first principles: incremental backups, crash consistency, application consistency, retention, restore testing, snapshot lifecycle, and recovery architecture.

EBS Encryption and Key Boundaries

EBS encryption, KMS boundary, snapshot sharing, boot volume dependency, key governance, and production failure modes for encrypted block storage.

EBS Resize, Migration, and Volume Evolution

How to resize, migrate, retype, re-encrypt, expand, shrink-by-migration, and evolve EBS volumes safely in production.

EBS RAID, LVM, and Database Storage Layout

15 min

How to design EBS RAID, LVM, filesystem, and database-oriented storage layouts without turning block storage into an operational trap.

EBS Failure Modes and Debugging

13 min

A production runbook for EBS failure modes including impaired volumes, latency spikes, attachment problems, full disks, filesystem corruption, and restore failures.

Instance Store and Ephemeral Disk

14 min

Instance store dan ephemeral disk sebagai local block storage cepat tetapi tidak durable; bagaimana memakainya untuk cache, scratch, spill, dan replicated temporary data tanpa mencampurnya dengan state of record.

Local Cache, Scratch, and Spill Patterns

14 min

Pattern produksi untuk local cache, scratch space, dan spill di EC2 instance store; bagaimana membuat temporary storage cepat tanpa mengubahnya menjadi state tersembunyi yang rapuh.

Compute Locality vs Durability

Deep dive on compute locality versus durability when using EC2 instance store, local cache, scratch disk, and spill storage in production workloads.

Ephemeral Storage Runbook

Operational runbook for ephemeral storage on AWS EC2, including disk pressure, cleanup, cache poisoning, node recycle, rebuild storms, and safe incident response.

S3 Object Storage Mental Model

Deep mental model of Amazon S3 as object storage, covering buckets, keys, objects, metadata, versioning, durability, consistency, immutability, access semantics, and production design boundaries.

S3 Key Design and Access Pattern

Deep dive on Amazon S3 key design, prefix strategy, access pattern modeling, listing behavior, hot prefixes, small files, partitioning, manifests, and production object namespace design.

S3 Consistency and Application Semantics

Deep dive on Amazon S3 consistency and application semantics, covering strong consistency, overwrite/delete behavior, versioning, conditional writes, manifests, idempotency, event processing, and multi-object workflow correctness.

S3 Storage Classes and Lifecycle Policy

Deep dive on Amazon S3 storage classes and lifecycle policies, including Standard, Intelligent-Tiering, Standard-IA, One Zone-IA, Glacier classes, lifecycle transitions, expiration, versioning, retrieval, cost, retention, and recovery trade-offs.

S3 Versioning, Delete Marker, and Recovery

Deep dive on Amazon S3 versioning, delete markers, accidental overwrite/delete recovery, noncurrent versions, lifecycle interaction, Object Lock boundaries, and production restore runbooks.

S3 Replication and Multi-Region Data

Deep dive on Amazon S3 replication and multi-region data design, covering CRR, SRR, replication lag, RTC, KMS, ownership, delete behavior, failover, DR, observability, and production runbooks.

S3 Object Lock, Retention, and WORM

Deep dive on Amazon S3 Object Lock, WORM retention, governance mode, compliance mode, legal hold, retention policy design, ransomware-resilient backups, regulated records, IAM guardrails, and recovery runbooks.

S3 Event-Driven Storage Patterns

Deep dive on S3 event-driven storage patterns using Lambda, SQS, SNS, EventBridge, idempotency, duplicate/out-of-order events, poison objects, event routing, retry, DLQ, and production pipeline design.

S3 Large Object and Multipart Upload

Deep dive on Amazon S3 large object and multipart upload, covering multipart protocol, part sizing, checksums, retry, resumability, pre-signed uploads, orphan cleanup, integrity validation, and production ingestion design.

S3 Data Layout for Analytics and Applications

Deep dive on Amazon S3 data layout for analytics and applications, covering key layout, partitioning, manifests, catalogs, small-file problem, compaction, table formats, application object models, and production data lake design.

S3 Performance, Cost, and Operational Debugging

Deep dive on Amazon S3 performance, cost, and operational debugging, including prefix request rates, latency, 503 Slow Down, 403 vs 404, LIST/HEAD amplification, Storage Lens, Inventory, lifecycle cost, and production runbooks.

File Storage Mental Model

Deep mental model of AWS file storage, covering EFS, FSx, shared file semantics, NFS, SMB, POSIX-ish behavior, metadata bottlenecks, locking, throughput, latency, access patterns, and production decision boundaries.

EFS Architecture and Performance

Deep dive on Amazon EFS architecture and performance, covering mount targets, Regional vs One Zone, throughput modes, performance modes, client behavior, metadata workload, cost, and production runbooks.

EFS Access Points, Permissions, and Security

Deep dive on Amazon EFS access points, POSIX identity, IAM authorization, TLS, file permissions, root directory enforcement, ECS/EKS/Lambda patterns, tenant isolation, and operational security runbooks.

EFS Backup, Lifecycle, Replication, and Operations

Deep dive on Amazon EFS backup, replication, lifecycle, migration, DataSync, cleanup, DR, restore testing, and operational runbooks for production file systems.

FSx Family Selection and Architecture Map

Deep decision map for the Amazon FSx family, covering FSx for Windows File Server, Lustre, NetApp ONTAP, OpenZFS, Amazon File Cache, architecture patterns, workload fit, migration, performance, security, and operations.

FSx for Windows File Server

Deep dive on Amazon FSx for Windows File Server, covering SMB, Active Directory, Windows ACLs, deployment types, throughput, backups, shadow copies, migration, security, and production runbooks.

FSx for Lustre HPC and ML File Systems

Deep dive on Amazon FSx for Lustre, covering HPC and ML workloads, scratch vs persistent deployment, storage classes, S3 integration, data repositories, throughput sizing, checkpointing, job patterns, cost, and production runbooks.

FSx for NetApp ONTAP Enterprise NAS

Deep dive on Amazon FSx for NetApp ONTAP, covering enterprise NAS, SVMs, volumes, NFS, SMB, iSCSI, SSD and capacity pool tiers, SnapMirror migration, snapshots, FlexClone, security, performance, and production operations.

FSx for OpenZFS Snapshots and Clones

Deep dive on Amazon FSx for OpenZFS, covering NFS file workloads, volumes, snapshots, clones, copy strategies, performance, nconnect, throughput, backup, replication, migration, dev/test patterns, and production runbooks.

Amazon File Cache and Remote Dataset Acceleration

Deep dive on Amazon File Cache, covering remote dataset acceleration, S3 and NFS data repositories, lazy load, cache eviction, Lustre clients, import/export, source-of-truth boundaries, cache warmup, cost, security, and production runbooks.

File Storage Production Patterns and Decision Runbooks

Cross-service production patterns for AWS file storage, covering EFS, FSx, Amazon File Cache, S3, EBS, instance store, source-of-truth boundaries, shared state, migration, backup, observability, and architecture review runbooks.

Backup, Disaster Recovery, and Data Protection Mental Model

Deep mental model for backup, disaster recovery, and data protection across AWS compute and storage, covering RPO, RTO, RPA, restore-first design, backup vs replication, immutable recovery, game days, and production runbooks.

AWS Backup Control Plane and Operating Model

Deep dive on AWS Backup as a centralized backup control plane, covering backup plans, vaults, recovery points, selections, lifecycle, cross-account and cross-region copy, Vault Lock, logically air-gapped vaults, restore testing, Audit Manager, and production runbooks.

EC2 and EBS Backup and Recovery Strategy

Deep dive on EC2 and EBS backup and recovery strategy, covering AMIs, EBS snapshots, rebuildable instances, boot/data volume separation, instance store, golden image recovery, restore patterns, game days, and production runbooks.

EBS Snapshot Lifecycle, DLM, and Application Consistency

Deep dive on EBS snapshot lifecycle, Amazon Data Lifecycle Manager, multi-volume crash consistency, application-consistent snapshots, Fast Snapshot Restore, snapshot copy/share/encryption, KMS, cost, and production runbooks.

S3 Data Protection, Versioning, Object Lock, and Replication

Deep dive on Amazon S3 data protection, covering versioning, delete markers, Object Lock, legal holds, governance and compliance mode, replication, AWS Backup for S3, PITR, restore workflows, lifecycle risk, and production runbooks.

EFS and FSx Backup, Restore, Replication, and File-System DR

Deep dive on EFS and FSx data protection, covering AWS Backup, item-level restore, EFS replication, FSx automatic and user-initiated backups, snapshots, file-level recovery, identity/permission restore, DR patterns, and production runbooks.

Disaster Recovery Architectures and Region Evacuation

Deep dive on AWS disaster recovery architectures, covering backup and restore, pilot light, warm standby, multi-site active-active, cross-account and cross-region recovery, DNS cutover, Route 53, ARC, failover, failback, and region evacuation runbooks.

Ransomware-Resilient Recovery and Immutable Backup Architecture

Deep dive on ransomware-resilient and compromise-resilient recovery on AWS, covering immutable backups, recovery accounts, Vault Lock, logically air-gapped vaults, Object Lock, KMS isolation, clean-room restore, malware-safe recovery, incident containment, and game days.

Compute and Storage Observability Signal Design

Deep dive on observability signal design for AWS compute and storage, covering metrics, logs, traces, events, CloudWatch, CloudTrail, EventBridge, AWS Config, service-specific signals, SLOs, dashboards, anomaly detection, and production alerting.

Incident Response, Runbooks, and Automated Remediation

Deep dive on incident response and automated remediation for AWS compute and storage, covering Incident Manager, OpsCenter, Systems Manager Automation runbooks, EventBridge, AWS Config remediation, safe automation, escalation, post-incident review, and production runbook design.

Compute and Storage Cost Engineering and Unit Economics

Deep dive on AWS compute and storage cost engineering, covering unit economics, Cost Explorer, Cost and Usage Reports, cost allocation tags, Compute Optimizer, Savings Plans, Reserved Instances, Spot, S3 Storage Lens, EBS/EFS/FSx cost controls, budgets, anomaly detection, and FinOps runbooks.

Capacity Engineering, Quotas, Reservations, and Forecasting

Deep dive on AWS capacity engineering for compute and storage, covering Service Quotas, EC2 On-Demand Capacity Reservations, Capacity Blocks for ML, Reserved Instances, Spot diversification, ASG capacity planning, storage forecasting, quota automation, headroom, and capacity game days.

Reference Architecture - Production Web/API Workload

End-to-end production reference architecture for a web/API workload on AWS, combining EC2 Auto Scaling, ALB, EBS, S3, EFS or FSx, backups, DR, observability, security guardrails, cost controls, and operational runbooks.

Reference Architecture - Batch, Worker, and Data Processing Workloads

End-to-end production reference architecture for batch, worker, and data-processing workloads on AWS, combining SQS, EC2 Auto Scaling, Spot, AWS Batch concepts, S3, EBS scratch, FSx Lustre, Amazon File Cache, checkpoints, idempotency, backup, observability, cost, and capacity runbooks.

Reference Architecture - Stateful Compute and Self-Managed Data Systems

End-to-end production reference architecture for stateful compute and self-managed data systems on AWS, covering EC2, EBS, FSx, quorum, fencing, backup, snapshots, application consistency, Multi-Attach cautions, failover, upgrades, observability, cost, and runbooks.

Migration and Modernization Playbook for Compute and Storage

Production migration and modernization playbook for AWS compute and storage workloads, covering the 7 Rs, discovery, wave planning, landing zone readiness, MGN, DataSync, SnapMirror, cutover, rollback, validation, rehost-to-modernize strategy, and runbooks.

Production Readiness Review for Compute and Storage Workloads

Production readiness review for AWS compute and storage workloads, covering architecture decision records, operational readiness, security, reliability, backup, disaster recovery, observability, cost, capacity, deployment, game days, and go-live criteria.

Capstone Synthesis and Path to Top-Tier Compute and Storage Engineering