Title: Discussion 2 — Picking the Right Infrastructure for the Job
Course: AIINFRA 100: AI Systems & Development Environments > Section: Week 02 — AI Workloads: Training vs. Inference, Latency vs. Throughput

💬 Discussion 2 — Picking the Right Infrastructure for the Job (20 pts)

Think of an AI-powered product or feature you've encountered in daily life — a customer service chatbot, a photo app that tags faces, a spam filter, a recommendation feed, a voice assistant, etc. In your initial post (150–250 words):

- Name the AI-powered product/feature you chose.
- Decide whether it's most likely using real-time inference or batch inference (or possibly both, for different parts of the product) — and explain your reasoning using this week's concepts.
- Describe what would likely go wrong, in terms of cost or performance, if the company built it using the wrong type of infrastructure (e.g., serving it in a way optimized for throughput instead of latency, or vice versa).

Then, respond to at least two classmates' posts. In your responses, try to add something new: do you agree with their real-time vs. batch classification? Can you think of a part of their example that might actually need the other approach?