Introduction to Generative AI & Foundation Models

Question 1

What is the fundamental difference between Discriminative (or Predictive) AI and Generative AI?

Accepted Answer

Discriminative AI classifies or predicts existing data; Generative AI creates new original content.

Answer

Generative AI only works with images, Discriminative only with text.

Answer

Discriminative AI is more expensive than Generative.

Answer

There is no difference, they are interchangeable terms.

Question 2

Which OpenAI Generative AI model is specifically designed to generate images from text descriptions?

Accepted Answer

DALL-E

Answer

GPT-4

Answer

Whisper

Answer

Codex

Question 3

In the context of LLMs (Large Language Models), what is a 'Token'?

Accepted Answer

The basic unit of text (part of a word) that the model processes.

Answer

A digital currency to pay for the service.

Answer

An API security key.

Answer

The maximum length of the response.

Question 4

What phenomenon occurs when an LLM confidently answers with information that is factually incorrect or fabricated?

Accepted Answer

Hallucination

Answer

Overfitting

Answer

Latency

Answer

Temperature

Question 5

Which 'Prompt Engineering' technique involves providing the model with a few examples of questions and answers (input-output pairs) within the prompt?

Accepted Answer

Few-shot learning

Answer

Zero-shot learning

Answer

Chain of thought

Answer

Fine-tuning

Question 6

What are 'Embeddings' in the context of AI?

Accepted Answer

Numerical representations (vectors) of text that capture its semantic meaning.

Answer

Images embedded in text.

Answer

Browser plugins.

Answer

Errors in the model code.

Question 7

If you set the 'Temperature' parameter to 0, how will the model behave?

Accepted Answer

It will be very deterministic and repetitive, always choosing the most likely answer.

Answer

It will be very creative and random.

Answer

It will stop responding.

Answer

It will generate images instead of text.

Question 8

Which OpenAI model is capable of understanding and generating programming code?

Accepted Answer

Codex (or GPT-3.5/4 which include Codex capabilities)

Answer

DALL-E

Answer

Whisper

Answer

Text-Embedding-Ada

Question 9

What is 'Chain of Thought' in prompt engineering?

Accepted Answer

Asking the model to explain its reasoning step-by-step before giving the final answer.

Answer

Chaining several different models together.

Answer

Repeating the same question many times.

Answer

Using chat history to remember the user's name.

Question 10

What is the role of the 'System Message' in a chat with an LLM?

Accepted Answer

To set the behavior, tone, and general rules of the assistant (e.g., 'You are a helpful and concise assistant').

Answer

It is the question the user asks.

Answer

It is the answer the model gives.

Answer

It is a system error message.