Free ISACA AAIA practice questions

10 free ISACA AAIA practice questions with the correct answer and a full explanation for each, taken from the CertStash pack of 258 questions. Work through them, then open each answer to check your reasoning.

Get all 258 questions (US$39) · Download these 10 as a PDF

Question 1

Which of the following key performance indicators (KPIs) are MOST important when evaluating whether an AI model meets business objectives?

  1. Cost of resources required for AI model training
  2. AI model accuracy in predicting actual outcomes
  3. Frequency of AI model retraining
  4. Number of users interacting with the AI model
Show answer and explanation

Correct answer: B. AI model accuracy in predicting actual outcomes

AI model accuracy in predicting actual outcomes is the most critical KPI for evaluating business objectives because it directly measures whether the model delivers value and achieves its intended purpose. While cost, retraining frequency, and user engagement are relevant operational metrics, accuracy is fundamental, a highly accurate model justifies investment and use, whereas an inaccurate model fails its core objective regardless of other factors.

Why the other options are wrong

  • A. Training resource costs are important for budgeting but do not directly measure whether business objectives are met.
  • C. Retraining frequency is an operational consideration, not a measure of whether objectives are achieved.
  • D. User interaction volume indicates adoption but not whether the model performs correctly or meets business goals.

Question 2

The BEST way to prevent sensitive information disclosure by large language model (LLM) chatbots is through:

  1. manual monitoring.
  2. data sanitization.
  3. data masking.
  4. access controls. ✅Correct Answer: B, data sanitization. Data sanitization is the best preventive control because it strips, redacts, or tokenizes sensitive information before it enters training data, prompts, or fine-tuning sets, so the model never holds data it could later reveal. Guidance on sensitive information disclosure in LLM applications lists sanitization and scrubbing of input and training data as the primary mitigation. Monitoring, masking techniques, and access controls support a defense-in-depth approach, but sanitization eliminates the exposure at the source.
Show answer and explanation

Answer and explanation for question 2

Question 3

An organization is using information gathered from customer accounts to train its AI chatbot.

Which of the following is the GREATEST risk associated with this practice?

  1. Transparency
  2. AI model hallucinations
  3. AI bias
  4. Disclosure of personal information
Show answer and explanation

Correct answer: D. Disclosure of personal information

Disclosure of personal information is the greatest risk because customer account data contains personally identifiable information (PII) and sensitive financial details. If this data is used to train a chatbot without proper safeguards, it can be reconstructed, leaked, or inferred from model outputs, violating customer privacy and potentially triggering regulatory penalties. While bias, hallucinations, and transparency concerns are valid AI risks, the direct exposure of personal customer information represents the most immediate and serious harm.

Why the other options are wrong

  • A. Transparency about data usage is important for ethics but is not the greatest risk from using customer data.
  • B. Hallucinations are a model behavior concern, not a primary risk of using customer account data.
  • C. Bias could result from skewed training data, but unauthorized disclosure of personal information is a more direct and severe risk.

Question 4

An IS auditor is evaluating an organization’s incident management program to ensure it is sufficiently prepared to manage AI-related incidents.

Which of the following is MOST important for the auditor to validate?

  1. The program includes processes to respond to AI model drift and data integrity attacks.
  2. The program prioritizes incidents based on alignment with industry leading practices.
  3. The program uses past AI-related incidents and resolutions to categorize current incidents.
  4. The program mandates retraining AI systems after incidents are investigated.
Show answer and explanation

Correct answer: A. The program includes processes to respond to AI model drift and data integrity attacks.

An incident management program must include specific processes to respond to A-elated incidents such as model drift (performance degradation over time) and data integrity attacks, as these are unique challenges in AI systems. Model drift and data poisoning are critical AI-specific threats that general incident programs may not address. Validating these specific processes ensures the organization can detect, respond to, and recover from AI-specific incidents effectively.

Why the other options are wrong

  • B. Prioritization based on industry practices is important for process maturity but does not ensure readiness for AI-specific incidents.
  • C. Using past incidents for categorization is useful but does not validate the program's ability to handle emerging AI threats.
  • D. Mandatory retraining after incidents is one response tactic, not the most important aspect of a comprehensive incident management program.

Question 5

Which of the following is MOST important for an IS auditor to consider when identifying AI risk in a know your customer (KYC) application within a banking organization?

  1. Business disruption and financial impact
  2. Intellectual property leakage and invalidation
  3. Benchmarking against peer organizations
  4. Incident response plan
Show answer and explanation

Correct answer: A. Business disruption and financial impact

Business disruption and financial impact are the most important considerations for a KYC application in banking because KYC is a critical regulatory and operational function. If the AI system fails, makes incorrect decisions, or produces unreliable results, it directly impacts customer onboarding, regulatory compliance, fraud prevention, and revenue. For a financial institution, the business and compliance consequences of AI failure far outweigh other concerns.

Why the other options are wrong

  • B. Intellectual property leakage is a consideration but less critical than the direct business and regulatory impact of KYC system failure.
  • C. Benchmarking against peers provides context but does not directly assess the risks specific to this organization's KYC operations.
  • D. An incident response plan is a mitigation control, not the primary focus when identifying risk in the first place.

Question 6

A digital bank utilizes an AI system to generate credit scores.

Which of the following would BEST mitigate the risk of sudden and unexplained changes in a borrower's credit score?

  1. Using only data from the last six months to one year to avoid outdated information affecting the credit score
  2. Ensuring the system is periodically reviewed and calibrated by human experts to maintain stability in predictions
  3. Obtaining and validating the credit scores from third-party agencies to cros-heck AI-generated results
  4. Allowing the AI to operate fully autonomously to prevent processing delays
Show answer and explanation

Correct answer: B. Ensuring the system is periodically reviewed and calibrated by human experts to maintain stability in predictions

Periodic human expert review and calibration best mitigates sudden unexplained credit score changes because it combines ongoing monitoring with corrective action. Humans can detect anomalies, identify the root causes (model drift, data quality issues, feature changes), and recalibrate the system to maintain stability and transparency. This approach preserves model performance while ensuring decisions remain explainable and trustworthy to borrowers and regulators.

Why the other options are wrong

  • A. Using only recent data may reduce outdated information but does not address the root causes of sudden score changes or prevent future instability.
  • C. Third-party cross-checks provide validation but do not mitigate the risk that the bank's own AI system produces unexplained changes.
  • D. Full autonomy without human oversight increases the risk of undetected drift and unexplained changes; human involvement is essential.

Question 7

Which of the following is MOST important for an IS auditor to review during an AI system audit in order to determine compliance with intellectual property and data rights?

  1. Data performance metrics
  2. Use of open-source intellectual property
  3. Model runtime efficiency logs
  4. Data usage agreements
Show answer and explanation

Correct answer: D. Data usage agreements

Data usage agreements are the most important document to review because they define the legal rights, restrictions, and obligations regarding how data and models can be used, including third-party IP, open-source components, and customer data. These agreements establish the compliance framework for intellectual property and data rights. Without reviewing agreements, an auditor cannot verify whether the organization has the legal right to use data and models, or whether compliance obligations are met.

Why the other options are wrong

  • A. Data performance metrics measure model effectiveness, not compliance with IP and data rights.
  • B. Open-source IP usage is one aspect, but data usage agreements comprehensively address all IP and data rights compliance.
  • C. Runtime efficiency logs relate to performance monitoring, not to IP and data rights compliance verification.

Question 8

Which of the following is the PRIMARY objective of AI governance?

  1. Implementing compliance and ethics controls for AI initiatives
  2. Promoting a positive return on investment (ROI) from AI projects
  3. Defining clear roles and responsibilities for AI development, use, and oversight
  4. Ensuring controls over AI are designed well and operate effectively
Show answer and explanation

Correct answer: C. Defining clear roles and responsibilities for AI development, use, and oversight

Defining clear roles and responsibilities for AI development, use, and oversight is the primary objective of AI governance because it establishes the organizational structure, decision-making authority, and accountability mechanisms required for all other governance activities. Clear roles enable effective compliance implementation, risk management, ROI tracking, and control design, making this the foundational element upon which all other AI governance depends.

Why the other options are wrong

  • A. Implementing compliance and ethics controls is an important outcome of governance, but governance's primary objective is establishing the framework and accountability structures that enable this.
  • B. ROI promotion is a business objective, not the primary purpose of governance, which focuses on managing risk and ensuring responsible AI use.
  • D. Ensuring control design and operation is a governance activity, but the primary objective is defining the roles and structures that govern how controls are established.

Question 9

A healthcare organization uses patient data to train an AI model for early disease detection.

Which of the following practices provides the BEST assurance that personal data is secure and its integrity is maintained?

  1. Implementing strict data access controls and conducting security tests
  2. Encrypting stored data to reduce exposure and log access
  3. Updating the AI model with new data and tracking changes
  4. Anonymizing patient data and performing regular quality checks ✅Correct Answer: D, Anonymizing patient data and performing regular quality checks Anonymizing patient data strips identifiers from the training records, greatly limiting privacy exposure, and regular quality checks confirm the data stays accurate, complete, and fit for the model. Together these cover both protection of personal data and integrity, which is what the question asks. Encryption and access controls guard data in place but leave identifiable information in the dataset, while anonymization reduces the impact of any exposure, subject to residual re-identification risk.
Show answer and explanation

Answer and explanation for question 9

Question 10

An organization deploys an AI recruitment platform to screen job applicants. The IS auditor identifies that the platform’s decisions may be influenced by model bias.

Which of the following risk mitigation strategies is BEST for the auditor to recommend?

  1. Implement a process to periodically test the AI system for biases and adjust parameters as needed.
  2. Suspend the use of the AI system until the training data can be verified for fairness and compliance.
  3. Require manual reviews of all AI-generated recruitment decisions before hiring is finalized.
  4. Retrain the AI model using an external data set certified for inclusivity and fairness.
Show answer and explanation

Correct answer: A. Implement a process to periodically test the AI system for biases and adjust parameters as needed.

Periodic testing for biases with parameter adjustment is the most practical and sustainable mitigation strategy. It establishes an ongoing control framework that identifies bias issues early and allows for continuous improvement rather than reactive measures. This balanced approach enables the organization to use the AI system while actively managing the risk, which is appropriate for bias that may be addressable through tuning. Suspending the system is overly disruptive, manual review doesn't scale, and external certified datasets may not eliminate bias specific to the organization's use case.

Why the other options are wrong

  • B. Suspension is an extreme measure that halts operations entirely and doesn't establish a framework for responsible AI use going forward.
  • C. Manual review of all decisions eliminates the efficiency benefits of the AI system and may not scale economically.
  • D. External datasets don't guarantee elimination of bias; the organization's specific context and fairness requirements must still be validated.

That was 10 of 258.

The full ISACA AAIA pack has all 258 questions, each with the answer, the explanation and why the other options are wrong, plus a questions-only copy for timed runs. US$39, paid once, with free monthly updates and a pass-or-your-money-back guarantee.

Get the full pack