HumachLearnLearn · explore · apply
Start learning
Preprocessing · Lesson 42

Target Transformations

Target Transformations is a preprocessing operation that changes feature representation before modelling.

ConceptWorked examplePracticeKnowledge check
Textbook walkthrough

What Target Transformations actually means

Target Transformations is a preprocessing operation that changes feature representation before modelling. Preprocessing is part of the learned pipeline because statistics such as means, categories or quantiles must be estimated on training data and then applied unchanged to validation/test data.

Target Transformations matters because preprocessing defines the representation a model actually sees. Learned transformations must be fitted inside the training boundary so their parameters do not leak information from validation or test cases.

Deeper walkthrough

Read Target Transformations as a mechanism, not a recipe

Treat this as a sequence of observable decisions rather than one opaque command. Stage 1: Split the data before fitting learned preprocessing. Stage 2: Apply transformations separately by column type. Stage 3: Fit preprocessing only on the training fold. Final checkpoint: Bundle preprocessing and estimator in one pipeline so cross-validation repeats the correct sequence automatically.

Mechanism

Follow the transformation

Split the data before fitting learned preprocessing.

Apply transformations separately by column type.

Fit preprocessing only on the training fold.

Evidence

Know what would convince you

  • Fit the transformation on training data only and confirm validation/test rows are transformed without refitting.
  • Inspect transformed shape, feature names/ranges and several rows against the raw inputs.
Useful distinctionStandardisation: (x - training mean) / training standard deviation.
Click a stage to inspect what happens, what changes, and what should be checked before moving on.
Stage 1

Split the data before fitting learned…

Split the data before fitting learned preprocessing. At this stage of Target Transformations, keep the incoming data or object separate from the learned parameter, transformed object, or statistic so the change can be reproduced and independently checked.

Transformation focus: keep the input and produced parameters/result separate so the change is observable and reproducible.
How it works

Trace the mechanism step by step

  1. Split the data before fitting learned preprocessing.
  2. Apply transformations separately by column type.
  3. Fit preprocessing only on the training fold.
  4. Transform validation/test with the stored training parameters.
  5. Bundle preprocessing and estimator in one pipeline so cross-validation repeats the correct sequence automatically.
Worked demonstration

Make the concept concrete

Demonstration

Python example

# Step 1 — Import the module so its functions/classes are available to the rest of this example.
import math
# Step 2 — Compute the right-hand expression and store its result in `y` for the next step.
y=1000
# Step 3 — Compute the right-hand expression and store its result in `logy` for the next step.
logy=math.log1p(y)
# Step 4 — Compute the right-hand expression and store its result in `back` for the next step.
back=math.expm1(logy)
# Step 5 — Display the current value explicitly so the result/state can be inspected during execution.
print(round(logy,3), round(back,1))
Expected / illustrative result
log1p compresses a positive skewed target; inverse transformation returns to the original unit for interpretation.
Interpret the result.

For Target Transformations, trace representative source rows/columns into the result and reconcile row counts, dtypes, keys or missing values that the operation could change.

Distinctions & related ideas

Know what this is — and what it is not

Standardisation(x - training mean) / training standard deviation.
Robust scalingUses median and quantile range; less influenced by extremes.
One-hot encodingCreates indicator columns for categories without imposing numeric order.
PipelineChains preprocessing and estimator so fitting/evaluation stay leakage-safe.
Use deliberately

When it is appropriate

Use Target Transformations when the model/analysis requires a deliberate representation of raw features and the transformation can be fit without leaking future or held-out information.

Boundary conditions

When to stop or reconsider

Avoid transformations that are unnecessary for the chosen model, cannot be reproduced at inference time, or learn from data that should remain held out.

Common mistakes

Failure modes to recognise

  • Fitting scaling, encoding, imputation or feature selection on the full dataset before validation.
  • Creating feature values whose meaning changes between training and inference.
  • Ignoring output shape/feature names and losing track of what the transformed columns represent.
Verification

How to check the result

  • Fit the transformation on training data only and confirm validation/test rows are transformed without refitting.
  • Inspect transformed shape, feature names/ranges and several rows against the raw inputs.
  • Place the transformation in a pipeline and cross-validate the complete workflow, not a preprocessed snapshot.
Hands-on practice

Demonstrate understanding

Try this:

Build a tiny, inspectable example of Target Transformations. First split the data before fitting learned preprocessing. Then apply transformations separately by column type. Write the expected result before running it, and explain one condition that would make the result misleading or invalid.

Use a tiny train/validation split. Fit only on train, print the transformed shape/values, and confirm validation transformation does not update learned state.
Knowledge check

Check reasoning, not memorisation

Before trusting a result from Target Transformations, which check provides the strongest evidence that you understand and applied it correctly?

Quick reference

Keep the important distinctions visible

Step 1Split the data before fitting learned preprocessing.
Step 2Apply transformations separately by column type.
Step 3Fit preprocessing only on the training fold.
Step 4Transform validation/test with the stored training parameters.
Lesson summary

What to remember

  • Target Transformations is a preprocessing operation that changes feature representation before modelling. Preprocessing is part of the learned pipeline because statistics such as means, categories or quantiles must be estimated on training data and then applied unchanged to validation/test data.
  • Split the data before fitting learned preprocessing.
  • Fitting scaling, encoding, imputation or feature selection on the full dataset before validation.
  • Fit the transformation on training data only and confirm validation/test rows are transformed without refitting.