051: Strategy evaluation techniques, flaws and solutions with Dave Walton

051: Strategy evaluation techniques, flaws and solutions with Dave Walton

Today we’re covering a topic which can really be a concern for traders of all levels, from beginner to pro, and that is the topic of strategy evaluation.

  • Have you ever found that real-life performance does not match expected results?
  • Or perhaps you have a strategy that is stuck in a drawdown and wondering if it’s actually broken?

I’m sure we’ve all heard of data mining bias, over-optimization and curve fitting and the impacts this can have on our trading accounts.

We may be even using techniques such as Out Of Sample testing, Walk Forward Analysis, Monte Carlo analysis and a number of other measures to identify or reduce the impact of these issues, but do these approaches actually work? Are there limitations or dangers with these techniques? Are there better ways?

In this episode we talk to someone who evaluates trading systems for a living, plus his research into system evaluation techniques has won awards. The guest is Dave Walton.

Dave was the winner of the Wagner award in 2014 for a paper titled ‘Know your system – turning data mining bias to benefit through System Parameter Permutation’.

In our chat today we talk about the technique in his paper and how it can be applied to trading strategy evaluation. We also discuss some of the assumptions and limitations of the approach, and he shares with us some valuable insights he’s made since publishing the paper which have resulted in an updated approach he now considers a better alternative, so make sure you listen out for that.

Topics discussed
  • How the typical approaches to system development can introduce datamining bias without you knowing
  • The types of systems that can increase the chance of data mining bias and what to look for
  • How the method of splitting your out of sample data could be causing you to throw away good strategies
  • Out of sample, walk forward analysis and Monte Carlo - do they actually reduce data mining bias?
  • The problems with using Monte Carlo analysis to assess strategy performance and why it doesn’t protect from overfitting
  • System Parameter Permutation - how to use it, why use the median, parameter range selection and new insights since the SPP paper was published
  • How System Parameter Randomization solves some of the issues of System Parameter Permutation
  • Stochastic modelling and how it can be used to determine if a rule is adding value to your strategy

Disclaimer:
Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

Jaksot(242)

Using "Big Picture" Analysis to Guide Trading Decisions - Brent Penfold

Using "Big Picture" Analysis to Guide Trading Decisions - Brent Penfold

Are you looking for unique ways to use “Big Picture” analysis to guide your trading decisions? In this episode, Brent Penfold from indextrader.com.au joins me to share some interesting (and effective) techniques he uses to determine the big picture to guide trading and investing decisions, including:   Why the big picture is so important in trading, How technical analysis can fool traders, What are fractals and why they matter, Validating market reactions to specific levels, The Market Ladder that projects support and resistance levels, Using fractals to see the big picture and the simplest fractal pattern there is, Pivot points over multiple timeframes and market expectations around pivots, Examples of market reactions to pivot points, Is it safe to get back into the market? Fractals and pivot points on non-index markets, Dynamic pivot points vs static pivot points, Robustness in old trading ideas, And much more!   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

26 Marras 20221h 7min

Indicators vs Price Action - Which is King?

Indicators vs Price Action - Which is King?

Which is better for trading strategies - Indicators or Price Action? In this episode, Scott Welsh from scottwelshstrategies.com joins me to answer this eternal question. Here are some of the topics we discuss: Strange things that have impacted the markets this year, The value of reviewing simple strategies, Expectations traders have of trading strategies, Choosing the right trading style for a market, How to determine which markets trend the most, Old trading strategies that continue to do very well, How to manufacture “lucky” trading, Tracking dozens of old strategies, Identify strategy failure, The recent performance simple trading strategies, Plus much more! Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

14 Marras 202256min

207: Preparing for a new trading year

207: Preparing for a new trading year

3 amazing guests join us to discuss trading insights of the past year and how to prepare for a HUGE trading year ahead, including: Getting better as a strategy builder, Challenges building short index strategies, Switching between old and new strategies, Timeframes for short-term trading strategies, Scaling out in volatile sideways markets, When the next bear market will begin and the transition from Bull to Bear, Trend following over the last few months, "V" price movements in the markets, Stop & Reverse and small stops in crazy markets, Plus doing more of what works, old strategies that do well, algorithmic short selling and much more.   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

24 Joulu 20211h 33min

206: “Systematic Crypto” – Adrian Reid

206: “Systematic Crypto” – Adrian Reid

Adrian Reid from Enlightened Stock Trading joins us to discuss systematic crypto trading, including: Why traders should consider the crypto markets right now, The mistakes most traders make with crypto, Choosing the best exchanges, data and software for crypto trading, Why buy and old is a bad approach to crypto and what you should do instead, The types of strategies that work in the crypto markets right now, The 3 types of risk in the crypto space (and how to reduce them), How to overcome limitations in crypto data, plus Regime filters, optimization, stop losses, backtesting, robustness, auto trading, price behaviour and much more.   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

25 Marras 202158min

205: “Simple strategies, stable results.” – David Stendahl

205: “Simple strategies, stable results.” – David Stendahl

David Stendahl from SignalTradingGroup joins us to discuss techniques traders can use to achieve more stable results, including: Why it's good to understand a systems logic and will simple systems continue to work, How to apply adaptive logic to simple systems, Mistakes traders make using seasonals, How "seasonal depth" can identify when a market is likely to make a big move, Using environmental overlays to adjust position sizing, Using VIX to switch strategies on/off, Plus, we discuss which is better: diversification of systems or markets?   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

11 Marras 20211h

204: “How to leverage market biases to improve strategy performance” – Lawrence Chan

204: “How to leverage market biases to improve strategy performance” – Lawrence Chan

Lawrence Chan from DayTradingBias joins us to discuss market bias and how to leverage structural bias to increase strategy performance, including: "Atomic strategies" and knowing when to NOT trade, The most toxic period to backtest a strategy, Why market behaviours are becoming so predictable, How some trading platforms are taking traders down the wrong path, Exploring biases caused by recurring events, Why traders should think in concepts first, Plus, leverage and volatility breakouts, chart patterns, simple tools, knowing the behaviours of market participants, human psyche, market internals and much more.   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

28 Loka 202156min

203: “Going against the crowd - a contrarian approach to trading profits.” – Jason Shapiro

203: “Going against the crowd - a contrarian approach to trading profits.” – Jason Shapiro

Jason Shapiro from Crowded Market Report discusses a contrarian approach to trading profits, including: Why contrarian trading makes sense, How to identify crowded trades and why price is not a good contrarian signal, What the markets really are and why traders don’t understand it, Risk management for contrarian trades, Why traders shouldn't care about being right or wrong, Plus, COT report, hedgers and speculators, fading the “experts”, trading through news events and much more.   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

21 Loka 202150min

202: “Buying pullbacks, avoiding bear markets” – Larry Tentarelli

202: “Buying pullbacks, avoiding bear markets” – Larry Tentarelli

Larry Tentarelli from Blue Chip Daily joins us to discuss techniques to buying pullbacks and avoiding bear markets, including: Determining the trend with price action and why price action is better than indicators, Using volatility and range expansion as warning signs, Impact of the index on individual stocks, Managing trades when markets are breaking down, Reliability of moving average crosses, Clues that indicate a pullback may be turning into a bear market, Using market internals to identify potential turning points, Plus, systematic rules vs discretionary trading, trading in a bear market, controlling the urge to overtrade, scaling-out of positions, sector rotation and selection, what to watch for in the markets right now, and much more.   Disclaimer: Trading in the financial markets involves a substantial risk of loss and is not suitable for everyone. All content produced by Better System Trader is for informational or educational purposes only and does not constitute trading or investment advice. Past performance is not necessarily indicative of future results.

7 Loka 202151min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
psykopodiaa-podcast
mimmit-sijoittaa
rss-rahapodi
puheenaihe
ostan-asuntoja-podcast
rss-rahamania
rss-startup-ministerio
pomojen-suusta
rss-lahtijat
herrasmieshakkerit
taloudellinen-mielenrauha
rss-bisnesta-bebeja
rss-paasipodi
rss-seuraava-potilas
oppimisen-psykologia
hyva-paha-johtaminen
kasvun-kipuja
rss-myyntipodi
rss-ammattipodcast