Cohort Link: https://aiengg.dev 00:00 Introduction 00:48 1. Hallucinations in AI 04:28 2. Evals and Tool Calling 13:45 3. Taking AI to 100% Automation 20:33 4. What will happen in 5 years? 27:30 5. Is DSA Dead? 28:23 6. Is AGI Coming 29:55 7. Steps to Learn AI as an SDE 33:16 Thank you! Core Theme: Problem Definition & Evaluation The key to successful AI systems isn't the model—it's how well you define the problem and evaluate the solution. Problem definition accounts for 30% of success, evaluation 70%. Main Points: Problem Definition - Be explicit about constraints, tech stack, success metrics, and requirements. Don't give vague instructions to AI; frame the problem like you would for a human engineer. Context Matters - Hallucinations don't just come from models; bad context you provide causes them. Scope context to what's actually needed for the problem. Evaluation is Everything - Most engineers evaluate AI systems on output alone. The 5% winners evaluate on tool-calling sequences, decision-making logic, and whether the system followed proper patterns—not just whether the final answer looks right. Example: Booking a Flight - A bad system just books the ticket (95% metric). A good system first gathers user data, identifies missing information (date, preferences, airline), asks clarifying questions, then books (5% thinking). Subject Matter Experts Are Critical - Don't automate without verification. Sit with domain experts (nurses for healthcare, aerospace engineers for aviation) to validate prompts and instructions before deployment. Don't Overcomplicate - Focus on fundamentals, not frameworks. Don't use LLM-as-judge as a cop-out; that's lazy when you should have ground truth and proper evaluation. Bottom Line: Success comes from rigorous problem scoping, proper evaluation metrics, and subject matter expert involvement.