ICS503 Final - Dr-Style Question Bank

Practice questions shaped like the midterm: experiment behavior, conceptual parameters, plot reading, Talbi-style framing, and coevolution comprehension.

How to use this bank: Do not memorize exact numbers. Practice writing 4-8 sentence answers that explain observation, mechanism, exploration/exploitation, and the HW/report connection.

0. Probable 30-Point Structure

Part Likely points Likely question style What to prepare
Q1 10 Experiment/plot/parameter behavior question. CB/BSF plots, HW observations, parameter extremes, elitism/bully, PSO/ACO/DE behavior.
Q2-Q5 20 total Short conceptual/design/calculation questions. SA extremes, schema theorem, problem framing, Talbi-style compare, TS/tabu, coevolution internal fitness.
Default answer formula: Observation -> cause/mechanism -> exploration/exploitation -> HW or slide connection -> conclusion/fix.

1. High-Probability 10-Point Q1 Candidates

HIGH10 pts Q1-A: CB/BSF Plot Interpretation

Consider the following five Current Best plots produced by different metaheuristic runs on the bin-packing problem. For each plot, analyze the algorithm behavior in terms of exploration and exploitation. Indicate which plots could also be valid Best-So-Far plots, which suggest elitism, and which behavior you would aim for. Relate your answer to your mini-project observations.

Expected answer skeleton:

  • BSF in minimization cannot increase. Any increasing CB curve cannot be BSF.
  • Smooth monotone decrease = exploitation/local refinement/greedy acceptance.
  • Stepwise decrease with exploitation periods = balanced behavior.
  • Large irregular jumps = exploration or no elitism/current solution allowed to worsen.
  • Fast drop then plateau = premature convergence or too much exploitation.
  • Flat/high current with preserved best = elitism/bully risk.
  • Tie to HW: HC/DE preserved-best behavior, PSO current oscillating above BSF, HCRR restart jumps, AS/ACS plateau/pheromone convergence.

HIGH10 pts Q1-B: Parameter Settings From Plot Behavior

Assume you run PSO, DE, GA, and ACS on the same bin-packing instances. The plots show: one run converges very quickly and plateaus, one oscillates around the best-so-far, one improves monotonically, and one has late improvements after long plateaus. Explain which algorithm/parameter behavior could produce each plot. What changes would you make to improve exploration or exploitation?

  • Very fast plateau: strong exploitation, high elitism/global-best/ACS greediness, low diversity.
  • Oscillation around BSF: PSO current particles move while personal/global memory preserves BSF; SA/high exploration could also oscillate.
  • Monotonic improvement: HC greedy acceptance, DE greedy replacement, GA with strong elitism if plotting preserved best.
  • Late improvements: restart/perturbation/AS democratic exploration/TS escaping plateau.
  • Fixes: reduce bully/global-best pressure, add mutation/noise/restarts, use local informants, adjust pheromone evaporation, preserve BSF but avoid excessive lock-in.

HIGH10 pts Q1-C: HW Observation Across Algorithms

Based on your mini-projects, compare how HC, TS, GA, DE, PSO, AS, and ACS navigated the bin-packing landscape. Do not give exact numerical tables. Explain conceptually what each algorithm added and why the best method changed across instances.

  • HC: local exploitation; good with permutation encoding but can plateau.
  • TS: adds memory/anti-cycling and best-neighbor movement; strongest pre-ACO non-population method.
  • GA: population, crossover, mutation, elitism; diversity but crossover may disrupt global order.
  • DE/PSO: stable population methods but random-key encoding is indirect for BPP.
  • ACS/AS: constructive search plus pheromone co-location memory; ACS exploits, AS explores.
  • Instance effect: easy/large-item instances do not differentiate; FFD-friendly instances reward greedy structure; Instance 3 rewards exploration/co-location learning.

HIGH10 pts Q1-D: Coevolution Multi-Goal Fitness

Consider a 1-population competitive coevolution problem with multiple goal states. Some individuals are very close to Goal 1, while only one individual is moderately close to Goal 2. How should internal fitness be assessed? Should we simply average distance to all goals? Justify using the idea of internal/external fitness.

  • Do not simply average distances. Average hides goal coverage.
  • External fitness measures actual progress/quality.
  • Internal fitness is used for selection/breeding and should measure potential contribution.
  • Fitness should be relative to other individuals targeting the same goal.
  • Reward unique coverage of underrepresented goals; penalize redundancy when many individuals crowd the same goal.
  • Purpose: maintain diversity and prevent the whole population from converging to one goal.

HIGH10 pts Q1-E: HC Random Restart From Experiment

Consider the set of runs you conducted using HC on bin packing. If you repeat the experiment using HC with random restart under the exact same iteration/time budget, would you choose a long, short, or moderate restart interval? Justify based on the behavior observed across your runs.

  • Choose moderate interval.
  • Long interval: wastes budget after local plateau.
  • Short interval: does not allow enough exploitation within each basin.
  • Moderate: each restart has time to improve, then budget samples another region.
  • HW tie: HC runs reached local optima; different starts can end differently, so restart helps but must not be too frequent.

2. SA / Parameter Extremes

HIGH3 pts Q2-A: SA Temperature Extremes

What happens to Simulated Annealing when the temperature is set to zero? What happens when the temperature is set to infinity? Explain in terms of exploration and exploitation.

  • T = 0: worse moves are not accepted; SA becomes HC-like; exploitation.
  • T = infinity: worse moves are accepted almost freely; random-walk-like; exploration.
  • Plot: low T gives monotone/plateau behavior; high T gives oscillating CB while BSF only improves when lucky.

HIGH4 pts Q2-B: PSO Memory Extremes

In PSO, explain conceptually what happens if particles are guided mainly by global best. What happens if there is no global-best influence and particles only use personal/local informant information?

  • Mainly global best: swarm races to one leader; strong exploitation; bully/premature convergence risk.
  • No global best: more distributed search; particles rely on their own memory and local informants; more exploration/diversity but slower convergence.
  • CB/BSF: current best can oscillate, but BSF is preserved by memory.

MED4 pts Q2-C: ACO Pheromone Extremes

In ACO/ACS, what happens if pheromone evaporation is too low? What happens if evaporation is too high? What happens if reward is given only to the best solution?

  • Too low evaporation: old pheromone persists; early paths dominate; lock-in.
  • Too high evaporation: memory disappears; construction becomes closer to greedy/random heuristic.
  • Best-only reward: elitist/exploitative; fast convergence but possible premature convergence.
  • AS-style broader reward: more exploration; may discover unusual co-locations but can be less stable on greedy-friendly instances.

MED4 pts Q2-D: DE Movement Extremes

In DE, explain what happens when the differential movement is zero, small, moderate, or very large. Avoid formula details; answer conceptually.

  • Zero movement or identical population: no useful direction; stagnation.
  • Small movement: local refinement; exploitation.
  • Moderate movement: balance between exploiting the population structure and exploring nearby regions.
  • Very large movement: big jumps; exploration but may overshoot or require repair/clamping.
  • In BPP random-key encoding, even small key movement may cause no permutation change or sudden swaps.

3. Schema / GA Calculation and Interpretation

HIGH5 pts Q3-A: Schema Survival

Given a binary chromosome of length 10 and the schema H = 1 * * 0 * 1 * * * 0, compute the lower bound probability that H survives one-point crossover with probability pc, and the exact probability that it survives mutation with probability pm. Explain which schema is more likely to survive.

  • Define order: number of fixed positions.
  • Define defining length: distance between first and last fixed positions.
  • Crossover survival lower bound: 1 - pc * defining_length / (l - 1).
  • Mutation survival: (1 - pm)^order.
  • Short, low-order schemas survive more easily.

MED4 pts Q3-B: Crossover vs Mutation Roles

In GA, explain why crossover is considered communication between individuals, and why removing crossover changes the behavior of the algorithm.

  • Crossover combines partial structures from different individuals.
  • Without crossover, individuals mostly self-breed through mutation.
  • This reduces communication and makes the method closer to multiple parallel local searches/evolution strategy.
  • Mutation adds exploration; selection and elitism add exploitation.

4. Problem Framing / Talbi-Style Questions

HIGH5 pts Q4-A: Boxes in Columns / Equal Piles

You are given several boxes with different weights and asked to place them into a fixed number of columns so that the difference between column loads is minimized. Formulate the optimization problem: objective, representation, fitness if needed, and a tweaking operator. Comment on locality.

  • Objective: minimize load imbalance, such as max load - min load or variance of column loads.
  • Representation: assignment of each box to a column, or permutation decoded by a placement heuristic.
  • Fitness: may include objective plus sensitivity term if many moves have same objective.
  • Tweak: move one box to another column, swap boxes between columns, or perturb assignment.
  • Locality: depends on tweak; moving one large box can cause large objective change, so locality may be weak.

MED5 pts Q4-B: Objective vs Fitness

In bin packing, the objective is to minimize the number of bins. Why might this objective alone be insufficient as a fitness function for a metaheuristic? Give a better fitness idea.

  • Many small tweaks do not change the number of bins, so the landscape has large plateaus.
  • Fitness should be more sensitive to changes.
  • Add empty-space distribution, fill variance, minimum slack, or penalty for bad packing patterns.
  • External objective remains number of bins; internal fitness guides search/selection.

5. Meta1 vs Meta2 / Effectiveness vs Efficiency

HIGH5 pts Q5-A: Meta1 vs Meta2

Two metaheuristics are applied to the same problem. Meta1 quickly reaches a moderate-quality solution and then plateaus. Meta2 improves more slowly but eventually reaches a better solution. Compare them in terms of efficiency, effectiveness, exploration, and exploitation. Which would you choose?

  • Meta1 is more efficient early: good result with fewer resources.
  • Meta2 is more effective if final quality is better.
  • Meta1 likely exploits quickly; Meta2 may maintain exploration longer.
  • Choice depends on time budget and required quality.
  • Best answer: balanced method, effective and efficient for the constraint.

MED4 pts Q5-B: When Stability Is Not Enough

An algorithm has very low variance across runs but consistently stops at a mediocre solution. Another has higher variance but sometimes finds a much better solution. Discuss which is preferable.

  • Low variance means stable/reliable, but not necessarily effective.
  • Higher variance can indicate useful exploration.
  • If the goal is guaranteed acceptable quality, stable may be preferred.
  • If the goal is best quality and multiple runs are possible, the exploratory method may be preferred.

6. Tabu / Noising / Local Optima

HIGH5 pts Q6-A: Tabu List Design

A student suggests storing complete solutions in the tabu list. Another suggests storing only the reverse move or moved component. Compare these options in terms of memory, restriction severity, exploration, and exploitation.

  • Storing complete solutions is expensive and very specific; may not prevent near-cycles.
  • Storing moves/components is cheaper and can prevent immediate reversal.
  • More restrictive tabu attributes increase exploration but may block useful moves.
  • Less restrictive attributes preserve exploitation but may allow cycling.
  • Aspiration can override tabu if a move gives a new best solution.

MED4 pts Q6-B: Reactive Tabu / Noising

During a search, the algorithm keeps returning to similar solutions. What would a reactive tabu or noising strategy try to do? Explain conceptually.

  • Reactive tabu adjusts memory/tenure based on observed cycling or stagnation.
  • If cycling occurs, increase restrictions/diversification.
  • Noising perturbs the objective/fitness or evaluation to escape local traps.
  • Both aim to avoid repeated exploitation of the same region.

7. Coevolution / 8-Tile Multi-Goal Questions

HIGH5 pts Q7-A: Internal vs External Fitness

In coevolution, explain the difference between internal fitness and external fitness. Use either the 8-tile multi-goal example or bin packing as your example.

  • External fitness: absolute quality/progress measure, used to report the best solution.
  • Internal fitness: used for selection/breeding; can be relative and context-sensitive.
  • 8-tile: external may be distance to a goal; internal also considers which goal is covered by others.
  • BPP: external may be number of bins; internal may include empty-space distribution to distinguish equal-bin solutions.

HIGH5 pts Q7-B: Multiple Goal States

In the 8-tile slide, Individual A is closest to Goal 1 but many individuals are also close to Goal 1. Individual B is farther from Goal 2 but is the only one targeting it. Which individual should have higher internal value? Explain.

  • It depends on relative coverage, but B may deserve high internal value.
  • A is redundant if many individuals already cover Goal 1.
  • B preserves diversity and goal coverage.
  • The internal fitness should reward contribution to underrepresented goals, not just raw closeness.

MED4 pts Q7-C: Why Average Is Dangerous

For each individual, a student computes distance to every goal and uses the average as internal fitness. What is the problem with this approach?

  • Average ignores which goal the individual is actually useful for.
  • Average ignores whether many competitors already cover that same goal.
  • It can eliminate unique individuals that are important for diversity.
  • A better method is relative, goal-aware, and coverage-aware.

MED4 pts Q7-D: Is Multiple Restart a Population Method?

A student says HC with many random restarts is a population metaheuristic because many solutions are being searched. Do you agree?

  • Not necessarily. Multiple solutions alone are not enough.
  • Population metaheuristics require interaction: communication, competition, shared memory, or collaboration.
  • Independent restarts do not exchange information during the search.
  • GA/PSO/ACO/co-evolution have interaction mechanisms.

8. AS / ACS / Constructive Search

HIGH5 pts Q8-A: AS vs ACS

Compare AS and ACS in terms of transition rule, pheromone update, and exploration/exploitation. Explain why AS may outperform ACS on one instance while ACS performs better on another.

  • AS: proportional stochastic choice; democratic pheromone update; more exploration.
  • ACS: greedier choice with best-focused update; more exploitation.
  • AS can find unusual co-locations on hard/differentiating instances.
  • ACS preserves strong greedy structure on FFD-friendly instances.

MED4 pts Q8-B: ACO Is Incremental

The doctor said ACO is different because it builds the solution incrementally. Explain what this means and why it matters for bin packing.

  • Ants construct a solution component by component.
  • In TSP, components are edges; in BPP, components can be item placements or item co-locations.
  • Pheromone changes future construction probabilities.
  • This differs from algorithms that modify a complete candidate solution after it already exists.

9. Extra Short Questions That Could Fill Remaining Points

Stem Expected answer
Why does elitism sometimes help and sometimes hurt? Helps preserve best solution; hurts by creating bully/premature convergence if diversity collapses.
Why can CB be worse than BSF? Current search moved away; BSF memory/archive preserves the best historical solution.
Why did SA with low temperature behave like HC in your HW? Low temperature rarely accepts worse moves, so behavior is mostly greedy exploitation.
Why did DE and PSO struggle on precise ordering instances? Random-key encoding gives indirect control over permutations; small real-vector movement may not map cleanly to useful ordering changes.
What does high variance across runs indicate? Run sensitivity/diverse outcomes; may show useful exploration or instability depending on quality.
What is the difference between stochastic and random? Stochastic means probabilistic with a chosen distribution; distribution shape matters for exploration/exploitation.
What is a good answer when asked "what did you observe in your HW?" Name the behavior and mechanism, not just "algorithm X was better": e.g., TS improved because tabu memory and best-neighbor search escaped plateaus.

10. Three Full Mock Final Sets

Mock Final A

Mock Final B

Mock Final C

This bank is intentionally conceptual. The doctor may include a calculation, but his repeated style is to ask for rationale, observed behavior, and the design consequence.

← Hub