Video summary

Prompt Writing Explanation - INQA Evaluation

Main summary

Key takeaways

Educational

Main ideas / purpose of the task

  • The video explains how to complete an INQA evaluation prompt/test involving debugging a real, highly complex piece of code.
  • The test is designed to assess the depth and complexity of real-world code experience, especially in situations with runtime errors and troubleshooting.

What you are required to submit

Submit:

  • A highly complex code submission (the challenger’s debugging task).
  • The error you encounter when you try to run the code.
  • The error messages / logs you observe during execution.

You must clearly mention all issues you face when running the code, including any relevant error logs.

Content requirements / what to avoid

The code must not be:

  • Written solely for learning purposes.
  • Based on practice problems, competitive programming, or simplified textbook/demo code.
  • Simple algorithm demonstrations (e.g., sorting demos).

Avoid submitting code that would not reflect real engineering complexity.

Guidance on selecting the code (strategy)

  • Do not use AI-generated code for this task.

Reason: AI code often:

- Assumes a narrow issue, then
- Constructs an entire program around that single expected failure mode.

Instead, you should:

  • Find the most complex and sophisticated code you have genuinely worked on before.
  • Prefer code from:
    • Real projects
    • Your own repositories
    • Passion projects
  • Look for code that uses:
    • Complex libraries
    • Uncommon libraries that are not widely known.
  • Choose the most challenging piece of code you can, because the goal is to make evaluation more useful for improving AI models.

“Three rules of thumb” (explicit criteria)

  1. High complexity

    • The code complexity should be very high.

  2. Real production system characteristics

    • It should reflect a real production codebase/system.

  3. Practical purpose

    • The code should have a use beyond demonstrating a single issue—i.e., it should be more than a contrived example.

Stakes / importance

  • This question/test has significant evaluation weight and can strongly influence whether you pass the course.
  • The speaker encourages taking time to select representative, challenging code examples.

Speakers / sources featured

  • Speaker: “Hi everyone…” (no name provided in subtitles)
  • Video title/source: {Prompt Writing Explanation - INQA Evaluation} (no additional source mentioned)

Original video