051: Strategy evaluation techniques, flaws and solutions with Dave Walton

051: Strategy evaluation techniques, flaws and solutions with Dave Walton

Today we’re covering a topic which can really be a concern for traders of all levels, from beginner to pro, and that is the topic of strategy evaluation.

  • Have you ever found that real-life performance does not match expected results?
  • Or perhaps you have a strategy that is stuck in a drawdown and wondering if it’s actually broken?

I’m sure we’ve all heard of data mining bias, over-optimization and curve fitting and the impacts this can have on our trading accounts.

We may be even using techniques such as Out Of Sample testing, Walk Forward Analysis, Monte Carlo analysis and a number of other measures to identify or reduce the impact of these issues, but do these approaches actually work? Are there limitations or dangers with these techniques? Are there better ways?

In this episode we talk to someone who evaluates trading systems for a living, plus his research into system evaluation techniques has won awards. The guest is Dave Walton.

Dave was the winner of the Wagner award in 2014 for a paper titled ‘Know your system – turning data mining bias to benefit through System Parameter Permutation’.

In our chat today we talk about the technique in his paper and how it can be applied to trading strategy evaluation. We also discuss some of the assumptions and limitations of the approach, and he shares with us some valuable insights he’s made since publishing the paper which have resulted in an updated approach he now considers a better alternative, so make sure you listen out for that.

Topics discussed
  • How the typical approaches to system development can introduce datamining bias without you knowing
  • The types of systems that can increase the chance of data mining bias and what to look for
  • How the method of splitting your out of sample data could be causing you to throw away good strategies
  • Out of sample, walk forward analysis and Monte Carlo - do they actually reduce data mining bias?
  • The problems with using Monte Carlo analysis to assess strategy performance and why it doesn’t protect from overfitting
  • System Parameter Permutation - how to use it, why use the median, parameter range selection and new insights since the SPP paper was published
  • How System Parameter Randomization solves some of the issues of System Parameter Permutation
  • Stochastic modelling and how it can be used to determine if a rule is adding value to your strategy

Disclaimer:
Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

Jaksot(242)

201: “Getting serious about part-time trading” – Kris Longmore

201: “Getting serious about part-time trading” – Kris Longmore

Kris Longmore from RobotWealth joins us to discuss 4 key areas part-time traders need to take seriously to be successful, including: Why it’s important to understanding market participants and why they're trading, 3 common things traders do that almost guarantee they will blow up, Setting realistic expectations for retail traders, The "edge pyramid" and where retail traders should target, The “backtest cycle of doom”, why backtesting is not research, and a better approach to finding a trading edge, plus Risk premia harvesting, turn of the month edges, universe selection, VIX trading edges, FX seasonality, portfolio Zen, risk allocation, crypto trading, machine learning and much more!   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

23 Syys 20211h 6min

200: “Using market noise to improve strategies” – Martyn Tinsley

200: “Using market noise to improve strategies” – Martyn Tinsley

Martyn Tinsley from TradeLikeAMachine joins us to discuss market noise, and how to leverage noise to improve trading strategies, including: Why it's important to understand market noise, The impact of market noise on trading strategies, Using noise to filter assets and timeframes, Example of impact of market noise on Mean Reversion strategies, The best strategies to trade in noisy markets, The difference between noise and volatility, Harmonic price patterns, instantaneous noise filtering, trading currency pairs, signal lag in noise indicators, repeatable patterns vs indicators and much more!   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

15 Syys 20211h

199: “Trading statistical edges in crypto” – Brian Blandin

199: “Trading statistical edges in crypto” – Brian Blandin

Brian Blandin from Markets Science joins us to discuss how to find and trade statistical edges in the crypto markets, including: The things traders need to be aware of before trading crypto, Common factors and repeatable patterns that move the crypto markets, Software, programming language and exchange selection, How to screen cryptocurrencies to find those worth trading, Safety of funds at unregulated brokers, Crypto market correlation to stocks and index futures, Moving from discretionary to systematic crypto trading, volatility, slippage, liquidity and much more!   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

7 Syys 202159min

198: “3 ways to improve trading models” – Curtis White

198: “3 ways to improve trading models” – Curtis White

Curtis White from Beyond Backtesting joins us to discuss 3 ways traders can build better trading models, including: The problem with trading models and why traders struggle to incorporate predictive factors into models, What drives the markets and using market cognition for better trading ideas, Identifying and trading different markets and datasets, Using statistical creativity in the strategy validation process, Problems with Walk Forward Optimization and the 'proven winner' solution, Testing with different bar types, the negative impacts of being too risk averse, and much more!   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

24 Elo 202147min

197: “How to use volatility to outperform the market” – Kyle Schultz

197: “How to use volatility to outperform the market” – Kyle Schultz

Kyle Schultz from Algorithmic Futures joins us to discuss how to leverage volatility in your trading strategies to improve risk/reward and outperform the market, including: Why volatility is a key component in trading strategies, 3 main ways to apply volatility in trading strategies,\ Types of volatility filters and when to use them in the strategy development process, Using VIX term structure as a regime filter, Adapting strategies to different volatility regimes, Mean reversion vs momentum in different volatility regimes, And much more!   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

10 Elo 202154min

196: “How to avoid curve fitting using independent testing” – Jeff Swanson

196: “How to avoid curve fitting using independent testing” – Jeff Swanson

Jeff Swanson from EasyLanguageMastery discusses how to avoid curve fitting your trading strategies using the "independent testing" technique, including: The things traders do that cause curvefitting, Is curvefitting a trading strategy really that bad? Independent testing and why you should use it when developing trading strategies, How to do independent testing of filters and using optimization to judge filter consistency, Testing combinations of filters and why you should look to remove Plus, types of filters to test, where to get trading ideas, how long to test a trading idea, when to switch strategies off, combining filters, tweaking a strategy and much more!   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

3 Elo 202155min

195: “Low-effort Trading Strategies” – Cesar Alvarez

195: “Low-effort Trading Strategies” – Cesar Alvarez

Algorithmic trader Cesar Alvarez from Alvarez Quant Trading joins us to discuss low effort trading strategies, including: An explanation of rotational trading and the benefits/challenges of using rotational strategies, Why rotational trading is a fantastic way to diversify time (and also get to “trade lazy”), How often to rebalance and the impacts of the day you choose to rebalance, Ranking methods and some of the most effective ways to find the best candidates, How to reduce the churn in rotational trading with one small but powerful exit tweak, Plus, universe selection, risk management, rebalancing, short trades, mean reversion, stock splits, audience questions and much more!   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

27 Heinä 202154min

194: “How to improve trend following performance” – David Lundgren

194: “How to improve trend following performance” – David Lundgren

Trend following trader David Lundgren joins us to discuss how to improve trend following performance, including: The problem with momentum (and why momentum “doesn’t work”), Why momentum isn't working today, Mixing momentum with trend following for better performance, The 4 conditions that must happen for a trend to occur, Modeling regime drivers and digging deeper to understand true market health, What to do when trading strategies are struggling, And much more.   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

20 Heinä 20211h 5min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
psykopodiaa-podcast
mimmit-sijoittaa
rss-rahapodi
puheenaihe
ostan-asuntoja-podcast
rss-rahamania
rss-startup-ministerio
pomojen-suusta
rss-lahtijat
herrasmieshakkerit
taloudellinen-mielenrauha
rss-bisnesta-bebeja
rss-paasipodi
rss-seuraava-potilas
oppimisen-psykologia
hyva-paha-johtaminen
kasvun-kipuja
rss-myyntipodi
rss-ammattipodcast