Subdomain 1.3: Recognize infrastructure concepts
1.A data engineering team needs to store petabytes of unstructured data, including images, videos, and JSON logs. The data must be highly durable, scalable, and accessible via REST APIs over the internet. Which of the following storage types is the most appropriate for this use case?
- A.Block storage
- B.Object storage
- C.File storage
- D.Relational database
Show answer & explanation
Correct answer: B — Object storage
- A. Block storage is typically used for high-performance, low-latency storage directly attached to virtual machines or servers (e.g., SAN or Amazon EBS). It is not designed for petabyte-scale unstructured media storage or native internet-based access via REST APIs.
- B. Object storage is the standard for massive-scale unstructured data. It treats data as objects with comprehensive metadata, provides extremely high durability and scalability, and is natively accessed via RESTful APIs over the internet (HTTP/HTTPS), making it ideal for this requirement.
- C. File storage uses a hierarchical structure (folders and files) and is generally shared via protocols like NFS or SMB. It often faces scalability bottlenecks at the petabyte level for unstructured media and does not provide the same ease of internet-accessible REST API integration as object storage.
- D. Relational databases are designed for structured data using tables and schemas. They are not suitable for storing massive amounts of unstructured files like images and videos due to performance overhead, high cost at petabyte scales, and the lack of native RESTful delivery for web clients.