Video summary

VPL Evaluasi Pengembangan Kapasitas Pelatihan Fungsional

Main summary

Key takeaways

Educational

Main ideas and lessons conveyed

  1. ASN competency development must be evaluated for real impact, not just completed training

    • Training programs should not stop at producing certificates.
    • Evaluation should measure:
      • changes in work behavior
      • sustainability of learning application
      • organizational and public-service impact

  2. Shift from “learning/attendance metrics” to “results and impact metrics”

    • Traditional view: training delivered + participant satisfaction scores + certificates.
    • New view: evaluate capabilities gained, then how those capabilities improve performance and outcomes.

  3. Quality assurance should be continuous and data-driven

    • Quality assurance occurs before, during, and after training.
    • It includes:
      • institutional accreditation
      • ongoing audits and monitoring
      • post-training and longer-term evaluation

  4. Digital systems and centralized data enable better planning

    • Training institutions must update standardized data:
      • programs, instructors (widya iswara), budget allocation, infrastructure capacity, and facilities
    • Data is collected via integrated platforms (e.g., Smart/IDselan mentioned), enabling:
      • clearer national capacity maps
      • data-driven decision-making for targeted competency development

  5. Integrity and anti-gratification principles are part of public-service culture

    • Gratification can include gifts/money/services related to position.
    • Even “small tokens” can create expectations of reciprocity and lead to preferential treatment/conflicts of interest.
    • Encouragement: give non-material appreciation (e.g., sincere thanks) and refuse/report improper requests.

  6. Methodological emphasis: evaluation cycles and models

    • Evaluation models referenced include multi-level frameworks (e.g., Kirkpatrick-like levels) and ROI-style thinking.
    • A major theme is that evaluation is a starting point for continuous improvement and updated policy/training design.

Methodologies / evaluation approaches explicitly described (detailed)

A) LAN / VPL keynote: national post-training evaluation approach (2025 onward)

  • Core principle: measure training success beyond satisfaction/learning outcomes.
  • Key evaluation targets:
    • changes in work behavior
    • sustainability of learning application over time
    • impact on:
      • individual performance
      • work unit performance
      • organizational performance
      • quality of public services
  • Paradigm described:
    • shift from learning-process orientation → results and impact orientation
  • Process direction:
    • LAN has conducted national post-training evaluation (starting 2025)
    • evaluation instruments will be strengthened and adopted by organizing institutions

B) Ministry of Health (Yudi Pramono): health-sector training quality assurance and evaluation cycle

System foundations (HR and training governance)

  • standardized curriculum development via competency analysis
  • integrated monitoring through a national health information system
  • planning based on priority programs and disease patterns, reviewed annually

Accreditation & quality control of training institutions

  • accreditation assesses multiple elements:
    • structure & governance
    • quality management
    • curriculum/learning programs
    • resources and facilities
  • accreditation includes leveling:
    • provincial → national
    • basic → full/plenary
  • accredited institutions must:
    • integrate training into the national system
    • submit annual training plans
    • conduct free training at least twice a year
    • perform internal quality audits and report through the system
  • evaluation frequency:
    • quarterly institutional evaluations
  • sanctions/rewards:
    • verbal warning up to revocation
    • “yellow/orange card” style consequences (described)
    • rewards for institutions with good results

Evaluation timing for learning impact

  • evaluations occur:
    • during training
    • after training
    • post-training (examples mentioned: 3 months / 6 months)

Post-training evaluation logic (EPP mentioned)

  • evaluates alumni ability to apply knowledge, attitudes, skills
  • assessment structured into four levels (reaction → learning → behavior/result stages)
  • data sources include:
    • alumni superiors
    • alumni subordinates
    • alumni
    • beneficiaries (patients/patient families/peers as applicable)

Information collection tools

  • electronic questionnaires
  • discussion guides / interview guides
  • observation guides
  • conducted about within ~1 month to send evaluation into the field

Use of evaluation outcomes

  • recommendations given to technical directorates
  • recommendations can revise training content (e.g., refocusing materials to match needs and reduce “too many materials” complaints)

C) Mandiri Corporate University (Laediatama Sudarmoyo & Rini Yulia Stanti): learning impact & quality assurance framework

Evaluation philosophy

  • not “did they finish/study,” but:
    • is what they learned used in work?
    • does it improve company performance? (“learning impact”)

Learning organization maturity model (phased development)

  • Level 1: organization focuses on providing training
  • Level 2: talent development focus (more professionalism)
  • Level 3: talent performance improvement (selected roles, career-based training)
  • Level 4: training provider becomes a strategic partner aligned to business goals

Strategic learning process (cycle)

  • identify needs → design solutions → execute learning → measure impact
  • after impact measurement, loop back into needs diagnostics and improvement

Quality assurance model principle: “QA throughout the process”

  • QA must consider:
    • context
    • mechanism
    • scope
    • measurement method
  • QA applied in a before, during, after structure:
    • planning → prototyping → training delivery → post-training check

Competency/capability development design principles

  • learning not solved by training alone
    • training is one cause among others (e.g., tools, incentives, expectations, motivation)
  • development programs built as:
    • Top-down Annual People Development Program (APDP)
    • Bottom-up Individual Development Program (IDP) through dialogue between employee and superior

Blended learning tied to the “forgetting curve”

  • classroom is insufficient alone; learning must be reinforced through practice and work attachment
  • emphasis on 70/20/10:
    • ~70% on-the-job experience
    • ~20% social learning/mentoring
    • ~10% formal classroom/structured instruction

Evaluation levels (learning reaction/gain/behavior/results/ROI-like)

  • L1 reaction: satisfaction + relevance + facilitator quality + facilities
  • L2 learning gain: pre/post or assessed mastery (passing threshold referenced as 70)
  • L3 behavior: behavior change measured via inputs such as 360-degree; typically 3–6 months after
  • L4 results/impact: performance outcomes tied to business metrics (e.g., SLA reduction, cost reduction, customer satisfaction, sales)
  • L5 return on training investment: harder to calculate; uses cost vs benefits approximation (high-level approach)

Example impact measurement method (synthetic/control style)

  • compare outcomes of trained employees vs similar employees who did not attend
  • example described using credit agreement productivity differences between groups

Quality assurance standards & monitoring

  • internal technical guidelines/policies define:
    • facilitator/mentor qualification
    • module testing (user acceptance test style)
  • quality assurance department and external reviewers/auditors involved
  • references to standards and governance practices such as ISO 21001 and educational quality governance practices (IFMD/CLI PIFMD-like and external recognition references)

Additional topics included in the video

  • Administrative/technical training accreditation and assessors

    • assessors must objectively evaluate training suitability based on:
      • accreditation policies
      • quality standards
      • accountable evidence
    • assessors manage accreditation team work and provide recommendations

  • Event logistics and participation instructions (VPL format)

    • interactive participation via:
      • Zoom Workplace (camera activation recommended; virtual background suggested)
      • questions via Slido
    • e-certificates provided if participants:
      • fill the attendance list
      • download the certificate from the provided link afterward

Speakers / sources featured (identified)

  1. Reni — moderator host/MC figure (opening; referenced as “I am very pleased, Reni…”)
  2. Mrs. Dranda Armi Winarti, M.Si. — Deputy for Quality Assurance, Competency Development and ASN Learning
  3. Mrs. Ervi Mutmainah — Director of Quality Assurance for Capacity Development (LAN)
  4. Mr. Yudi Pramono — Director of Health Human Resources Quality, Ministry of Health
  5. Mr. Laediatama Sudarmoyo — Head of Learning Strategy and Governance, Mandiri Corporate University (referred to as “Lorens” / “Lawrence” in subtitles)
  6. Mrs. Rini Yulia Stanti — Head of Learning Budget and Monitoring, Mandiri Corporate University (also referred to as “Mrs. Rini Yulia”)
  7. Mas Sultan Aurfahri — Moderator for discussion session (also appears as “Sultan Adiya Nurfahri”)
  8. Cultural/anti-gratification narration characters (names shown in subtitles; unspecified further)
    • “Mr. Arif” (improper gift scenario: receiving/declining)
    • other “Mr./sir” and “ma’am” participants in the dramatization
  9. Video/event platform sources mentioned
    • Zoom Workplace
    • Slido
    • YouTube channel of LAN (Lembaga Administrasi Negara) (referenced as broadcast source)
    • Smart/IDselan dashboards and Smart Bankcom (system sources referenced in narration)

Original video