HumachLearnLearn · explore · apply
Start learning
Math for ML · Lesson 8

Dot Products and Linear Functions

The dot product multiplies corresponding vector components and sums them: x·w = Σ x_j w_j.

ConceptWorked examplePracticeKnowledge check
Textbook walkthrough

Dot Products and Linear Functions

The dot product multiplies corresponding vector components and sums them: x·w = Σ x_j w_j. Linear models use this operation to turn a feature vector into a scalar score. Adding an intercept gives an affine prediction, and each weight controls how its feature contributes when other inputs are held fixed.

Learning goal: explain why Dot Products and Linear Functions behaves this way, apply it to a small example, and verify the result independently. Begin by being able to justify this first step: Align feature and weight vectors with the same dimension.

Deeper walkthrough

Read Dot Products and Linear Functions as a mechanism, not a recipe

Treat this as a sequence of observable decisions rather than one opaque command. Stage 1: Align feature and weight vectors with the same dimension. Stage 2: Multiply corresponding components. Stage 3: Sum those products to obtain the linear score. Final checkpoint: Interpret sign and magnitude only in the context of feature scale and model assumptions.

Mechanism

Follow the transformation

Align feature and weight vectors with the same dimension.

Multiply corresponding components.

Sum those products to obtain the linear score.

Evidence

Know what would convince you

  • Verify the split/validation boundary before comparing scores.
  • Inspect model/preprocessing state or a hand-computable tiny example.
Useful distinctionRepresentation: How the method encodes inputs/predictions.
Visual demonstration of Dot Products and Linear Functions
Visual demonstration: use the diagram to trace the main objects and state changes involved in Dot Products and Linear Functions.
Click a stage to inspect what happens, what changes, and what should be checked before moving on.
Stage 1

Align feature and weight vectors with…

Align feature and weight vectors with the same dimension. For Dot Products and Linear Functions, identify the exact state before this stage, the operation or rule applied here, and the observable state afterwards so the mechanism remains inspectable.

State focus: identify exactly what changed at this stage and what observable evidence confirms that change.
How it works

Trace the mechanism step by step

  1. Align feature and weight vectors with the same dimension.
  2. Multiply corresponding components.
  3. Sum those products to obtain the linear score.
  4. Add an intercept when the model includes one.
  5. Interpret sign and magnitude only in the context of feature scale and model assumptions.
Worked demonstration

Manual dot product

# Step 1 — Compute the right-hand expression and store its result in `x` for the next step.
x = [2, 3]
# Step 2 — Compute the right-hand expression and store its result in `w` for the next step.
w = [0.5, -1]
# Step 3 — Compute the right-hand expression and store its result in `score` for the next step.
score = 2*0.5 + 3*(-1)
# Step 4 — Display the current value explicitly so the result/state can be inspected during execution.
print(score)
Expected / illustrative result
The dot product is -2.0; an intercept b would shift the final linear function to b - 2.0.
Interpret the result.

For Dot Products and Linear Functions, identify exactly what each reported quantity represents, including its units/denominator, and independently recompute one part of the result.

Distinctions & related ideas

Place the concept correctly

RepresentationHow the method encodes inputs/predictions.
Learning/operationWhat fitted state or calculation changes.
ValidationIndependent evidence used to judge generalisation or correctness.
Use deliberately

When it is appropriate

Use Dot Products and Linear Functions when it answers a defined question in Math for ML and its inputs/assumptions match the current data or program state.

Boundary conditions

When to stop or reconsider

Reconsider Dot Products and Linear Functions when the required information is unavailable, the operation would violate a validation/data boundary, or a simpler operation answers the question more transparently.

Common mistakes

Failure modes to recognise

  • Optimising on the final test set.
  • Ignoring feature scale/representation or split structure when the method depends on them.
  • Reporting a single score without checking errors, variance or operating conditions.
Verification

How to check the result

  • Verify the split/validation boundary before comparing scores.
  • Inspect model/preprocessing state or a hand-computable tiny example.
  • Perturb one input/hyperparameter and predict the expected direction or behaviour.
Hands-on practice

Demonstrate understanding

Try this:

Construct a tiny example of Dot Products and Linear Functions. First align feature and weight vectors with the same dimension. Then multiply corresponding components. Predict the result before execution and explain one boundary or failure case.

Use a very small example and calculate one quantity manually. Separate sample evidence from population/causal claims.
Knowledge check

Check reasoning, not memorisation

Which approach best demonstrates understanding of Dot Products and Linear Functions?

Quick reference

Remember the logic

Step 1Align feature and weight vectors with the same dimension.
Step 2Multiply corresponding components.
Step 3Sum those products to obtain the linear score.
Step 4Add an intercept when the model includes one.
Lesson summary

What to remember

  • The dot product multiplies corresponding vector components and sums them: x·w = Σ x_j w_j. Linear models use this operation to turn a feature vector into a scalar score. Adding an intercept gives an affine prediction, and each weight controls how its feature contributes when other inputs are held fixed.
  • Align feature and weight vectors with the same dimension.
  • Optimising on the final test set.
  • Verify the split/validation boundary before comparing scores.