Question 1
AdvancedIngesting and processing the data · Building the pipelines
You are designing a data ingestion architecture for a global logistics company. The system must ingest telemetry data from millions of IoT devices installed in delivery trucks. The data arrives in bursts, and the order of events is critical for calculating accurate delivery estimates. However, due to intermittent connectivity, some devices may send data hours late. You need a solution that ensures strictly ordered processing per truck ID while handling high throughput and potential duplicates.
Which architecture should you implement?
Answer and explanation
Correct answer: A
Pub/Sub ordering keys ensure that messages with the same key (truck ID) are delivered to subscribers in the order they were published, which is critical for this scenario. Dataflow's streaming engine with 'exactly-once' processing handles the deduplication and ensures reliable processing of the ordered stream. Standard Pub/Sub without ordering keys does not guarantee order, and Kafka on Compute Engine adds unnecessary operational overhead.
