IBM watsonx Generative AI Engineer v1 - Associate Free Sample Questions

Description

Covers generative AI and large language model capabilities, prompt engineering for zero- and few-shot use cases, fine-tuning and cost reduction, and API orchestration.

40 free sample questions438 in the full practice test

Try simulator

C1000-185 Sample Questions

  1. Question 1

    Advanced

    Fine-Tuning · Customize LLMs with InstructLab

    A financial services firm is using InstructLab to customize an IBM Granite model for internal policy compliance checks. The goal is to teach the model two things: first, to recognize and classify new, firm-specific financial product names, and second, to follow a specific three-step reasoning process for evaluating compliance. How should the engineering team structure their taxonomy files in InstructLab to achieve this?

    Answer and explanation

    Correct answer: C

    This is the correct approach. InstructLab distinctly separates 'knowledge' from 'skills'. Knowledge pertains to factual information ('what'), such as product names, definitions, and facts. Skills pertain to abilities and processes ('how'), such as following instructions, performing a reasoning process, or writing in a specific style. Therefore, the new financial product names belong in the knowledge taxonomy, while the structured reasoning process belongs in the skills taxonomy.

  2. Question 2

    IntermediateMultiple answers

    Fine-Tuning · LoRA

    An engineer is implementing Low-Rank Adaptation (LoRA) to fine-tune a foundation model on a domain-specific dataset. To ensure training is both effective and resource-efficient, which TWO of the following are the most critical LoRA-specific hyperparameters to configure? (Select TWO)

    Answer and explanation

    Correct answers: B, D

    The rank (r) determines the dimensionality of the trainable update matrices. It is the most critical LoRA hyperparameter, directly controlling the trade-off between model expressiveness (higher r) and the number of trainable parameters (lower r). A well-chosen rank is key to successful and efficient tuning.

    Alpha (α) is a scaling factor for the LoRA updates. It is used in conjunction with the rank (r) to control the magnitude of the adaptation. The ratio of α/r is often kept constant, making α a crucial parameter to tune alongside r for optimal performance.

  3. Question 3

    Intermediate

    Retrieval-Augmented Generation (RAG) · Generate vector embeddings utilizing models

    A team is building a RAG system to answer questions from a large corpus of lengthy legal documents. The documents have a clear hierarchical structure (chapters, sections, clauses). The initial prototype using a fixed-size chunking strategy is performing poorly, often missing context that spans across chunk boundaries. Which chunking strategy should the team implement to best preserve the semantic context within these structured documents?

    Answer and explanation

    Correct answer: D

    For highly structured documents like legal texts, a fixed-size or simple recursive chunking strategy often fails by splitting semantically coherent units. Semantic or agentic chunking is an advanced technique that uses the document's structure (e.g., headings, paragraphs, clauses) or an LLM to identify logical boundaries. This ensures that the generated chunks are meaningful and self-contained, leading to much better retrieval quality.

  4. Question 4

    Beginner

    Prompt Engineering · Determine the best model parameters for each GenAI prompt

    When using the watsonx.ai Prompt Lab, an engineer wants to increase the creativity and diversity of the model's generated responses, even at the risk of occasional non-factual statements. Which model parameter should be increased to achieve this effect?

    Answer and explanation

    Correct answer: C

    The temperature parameter controls the randomness of the output. A lower temperature (e.g., 0.1) makes the model more deterministic and factual, picking the most likely next tokens. A higher temperature (e.g., 0.8 or higher) increases randomness, leading to more diverse and creative outputs, but also increases the likelihood of hallucinations or deviations from the source context.

  5. Question 5

    Advanced

    Analyze and Design a Generative AI Solution · Articulate the optimal model architecture based on a use case

    A global logistics company plans to develop a generative AI-powered assistant for its supply chain managers. The assistant must provide real-time shipment tracking summaries, predict potential delays by analyzing weather and traffic data from external APIs, and answer queries about internal shipping protocols stored in a document repository.

    The solution needs to be highly responsive, secure, and capable of grounding its answers in the company's proprietary protocol documents to avoid hallucinations. The development team has expertise in Python and is using the watsonx.ai platform. The internal protocol documents are updated weekly.

    Which architectural design provides the most effective, secure, and maintainable solution for this use case?

    Answer and explanation

    Correct answer: D

    This is the most robust and scalable architecture. An AI Agent pattern is ideal for tasks requiring multiple, distinct capabilities. Using a RAG tool grounds the model in the latest proprietary data, addressing the hallucination risk and handling weekly updates efficiently. Separate tools for external APIs cleanly encapsulate the real-time data fetching logic. The orchestrating LLM can then intelligently route requests and synthesize information from all sources, providing a comprehensive answer. This modular design is more maintainable and extensible than a monolithic fine-tuned model or a simple RAG setup that can't handle external tools.

  6. Question 6

    Intermediate

    Deployment · Plan out deployment of prompts for versioning

    A development team is managing multiple versions of a prompt template for a customer service chatbot within the watsonx.ai Prompt Lab. They need to test a new prompt version (v2) against the current production version (v1) without impacting all users. What is the most appropriate industry-standard strategy for deploying and evaluating the new prompt version?

    Answer and explanation

    Correct answer: C

    A/B testing (or a canary release) is the best practice for deploying and evaluating new prompt versions. This approach allows the team to gather real-world performance data on the new prompt (e.g., user satisfaction, task completion rate) from a small subset of users. It minimizes risk by limiting the impact of any potential degradation in performance and provides empirical data to make an informed decision about whether to roll out v2 to all users.

  7. Question 7

    Beginner

    Fine-Tuning · Articulate model quantization techniques

    True or False: Applying INT8 quantization to a fine-tuned foundation model will always reduce its inference latency and memory footprint without any impact on its accuracy.

    Answer and explanation

    Correct answer: B

    False. While quantization (like converting weights from FP32 to INT8) does significantly reduce model size and typically improves inference speed, there is almost always a trade-off with a slight reduction in model accuracy. The process of reducing the precision of the model's weights can lead to a loss of information, which may impact the model's performance on certain tasks. The goal of quantization-aware training or post-training quantization is to minimize this accuracy loss.

  8. Question 8

    Intermediate

    Retrieval-Augmented Generation (RAG) · Develop using libraries

    A RAG-based chatbot designed to answer questions about internal HR policies is frequently providing answers that are factually correct but irrelevant to the user's specific question. For example, when asked "What is the policy for paternity leave?", it returns a detailed paragraph about the company's general holiday policy. The system uses an appropriate embedding model and a vector database. What is the most likely cause of this issue?

    Answer and explanation

    Correct answer: C

    This is the most common cause for retrieving irrelevant information. If chunks are too large, a single chunk might contain information on paternity leave, holiday policy, and sick leave. The embedding for this chunk will be a blend of these topics. When a user asks about paternity leave, this 'blended' chunk might be retrieved due to keyword overlap, but the LLM is then presented with a large, unfocused context, leading it to generate an answer about a more general or different topic within that same chunk. Refining the chunking strategy to create smaller, more topically focused chunks is the correct solution.

  9. Question 9

    Intermediate

    Integration with Model Orchestration · Integrate watsonx.ai with Other Services/Manage APIs and SDKs

    A developer is building a Python application to interact with a deployed model on watsonx.ai. They need to send a prompt and receive a generated response. Which class from the ibm_watson_machine_learning.foundation_models library is primarily used for this purpose?

    Answer and explanation

    Correct answer: C

    The Model class is the primary interface in the watsonx.ai Python SDK for interacting with deployed foundation models. An instance of this class is created with the model ID and other credentials. Its generate() method is then used to send prompts and receive completions from the model.

  10. Question 10

    Intermediate

    Fine-Tuning · Generate synthetic data using the User Interface

    A team is using the synthetic data generation feature within watsonx.ai to augment their dataset for fine-tuning. They provide a few high-quality examples of instruction-response pairs. What is the primary purpose of this feature?

    Answer and explanation

    Correct answer: C

    The synthetic data generation feature uses a foundation model to generate many new, varied examples based on the few seed examples provided by the user. This is extremely useful when creating a large, high-quality dataset for fine-tuning is time-consuming or expensive. It allows the team to bootstrap a small number of examples into a much larger dataset that captures the intended task, style, and format.