Testing and running the system: expectancy, drawdowns and a weekly routine

What you will learn

  • Write a complete, testable trend-following rule set.
  • Judge a backtest by expectancy after costs, drawdown depth and length, and robustness.
  • Run the system with a daily and weekly routine and compare live results with the test.

Check your understanding

Answer each question to see the explanation. Answers are not saved.

  1. A backtest of a new breakout rule shows +0.6R expectancy after costs, from 38 trades over two years. What is the main concern?

    1. A The expectancy is too high to be useful for planning
    2. B There is no concern: +0.6R after costs is excellent
    3. C Too few trades: a few big winners could explain it
    4. D Two years is too long a period for a breakout test
    Show the answer

    Answer: C. Trend-following results depend on a few large trades, so small samples are especially unreliable. Test more stocks or a longer period before trusting the number.

  2. A 20-day breakout earns +0.45R per trade. The same rule with 18 days earns −0.10R and with 22 days −0.05R. What does this suggest?

    1. A The result is fragile and probably a fit to past noise
    2. B 20 days is the true optimum and should be traded as it is
    3. C Lookbacks do not matter for breakout systems
    Show the answer

    Answer: A. A real edge usually holds across neighbouring settings. A single sharp peak surrounded by losses is the signature of overfitting.

  3. A system’s backtest showed a maximum drawdown of 18%. Six months into live trading, with the rules followed exactly, the drawdown reaches 14%. What is the most reasonable response?

    1. A Stop: the system has failed and should be replaced
    2. B Continue: 14% is inside the tested range
    3. C Double the risk to recover faster
    4. D Switch to the best-performing preset of the last month
    Show the answer

    Answer: B. Reshuffling the same trades shows drawdowns can exceed the backtest’s by chance, so 14% is unremarkable. Decisions to stop should follow a level set in advance.

  4. Which backtest setting is the more conservative, and why?

    1. A Signal-day close, because it is the exact price the system’s rules use
    2. B Zero costs, because brokers no longer charge commission
    3. C Next day’s open with costs: the signal is known only after the close
    Show the answer

    Answer: C. Filling at the signal close assumes you could act on a price you did not yet know. Spreads and slippage exist even without commissions.

  5. A backtest on the screener’s 500 most liquid stocks of today shows strong results over 10 years. Which bias should make you read it cautiously?

    1. A Survivorship and hindsight: failed firms are missing
    2. B Look-ahead bias in the way the moving averages are computed
    3. C None: 500 stocks over 10 years is a large sample
    4. D Recency bias, because the period is too short
    Show the answer

    Answer: A. Choosing the universe with today’s knowledge favours stocks that trended up. The results are likely flattered, as the backtest notes state.

  6. Your end-of-day system flags a breakout at today’s close. What does the routine in this lesson do next?

    1. A Wait until mid-morning tomorrow to see whether the stock holds up, then decide
    2. B Buy in after-hours trading immediately at any price
    3. C Skip it if the last two trades lost
    4. D Check the regime, size from the stop, and order for the next open
    Show the answer

    Answer: D. Decisions are made in the evening by rule and executed at the next session. Waiting to see intraday action reintroduces the judgement the system was built to remove.

Continue in Clear Tape

With a free account, your progress and quiz scores are saved, and you can practise with the question bank, keep a wrong-answer book and study real chart examples.