• 525 days Will The ECB Continue To Hike Rates?
  • 526 days Forbes: Aramco Remains Largest Company In The Middle East
  • 527 days Caltech Scientists Succesfully Beam Back Solar Power From Space
  • 927 days Could Crypto Overtake Traditional Investment?
  • 932 days Americans Still Quitting Jobs At Record Pace
  • 934 days FinTech Startups Tapping VC Money for ‘Immigrant Banking’
  • 937 days Is The Dollar Too Strong?
  • 937 days Big Tech Disappoints Investors on Earnings Calls
  • 938 days Fear And Celebration On Twitter as Musk Takes The Reins
  • 940 days China Is Quietly Trying To Distance Itself From Russia
  • 940 days Tech and Internet Giants’ Earnings In Focus After Netflix’s Stinker
  • 944 days Crypto Investors Won Big In 2021
  • 944 days The ‘Metaverse’ Economy Could be Worth $13 Trillion By 2030
  • 945 days Food Prices Are Skyrocketing As Putin’s War Persists
  • 947 days Pentagon Resignations Illustrate Our ‘Commercial’ Defense Dilemma
  • 948 days US Banks Shrug off Nearly $15 Billion In Russian Write-Offs
  • 951 days Cannabis Stocks in Holding Pattern Despite Positive Momentum
  • 952 days Is Musk A Bastion Of Free Speech Or Will His Absolutist Stance Backfire?
  • 952 days Two ETFs That Could Hedge Against Extreme Market Volatility
  • 954 days Are NFTs About To Take Over Gaming?
Frank Hogelucht

Frank Hogelucht

Individual investor, trading for a living since 2007, taking a statistical approach in combination with historical market data and addicted to developing market-neutral algorithmic trading…

Contact Author

  1. Home
  2. Markets
  3. Other

COT: Commercial, Non-Commercial and Small Traders

Cartoon
www.CartoonStock.com

Most recently the Commitments of Traders(COT) reports got (and still get) a lot of press around the blogosphere, regularly picking out the rapid increases in the net short /net long positions of non-commercial and commercial traders (respectively) in major market index futures, regularly pointing to the bearish (rarely the bullish) implications of the current elevated readings.

Three weeks ago I presented an analysis concerning the Commitments of Traders(COT)'s (questionable) quality of forecast due to the fact that on October 5, 2010 commercial traders held a net short position of -30,762 contracts in Nasdaq 100 futures (large contract, not the E-minis), the lowest reading on record (since 4/16/1996), see here. Three weeks later, the Nasdaq 100 has gained (and not lost) 5.00%.

(If you're interested in a short summary only, please click here)

On , October 19, 2010, the U.S. Commodity Futures Trading Commission (CFTC) reported net positions in ES E-mini (S&P 500) futures as follows:

  • Commercial Traders: 116,804 contracts
  • Non-Commercial Traders: -169,869 contracts
  • Small Traders: 53,065 contracts

Currently non-commercial traders hold their highest net short position in ES E-mini (S&P 500) futures since September 8, 2008, while commercial traders held a net long positions more than 1.75 standard deviations above its 6-month mean (but no record net long position in absolute terms). I thought this would be the right time to check who is the better follow (commercial, non-commercial or small traders) - if any - and their respective 'quality of forecast' (and precision in timing the market).

In order to account for absolute and relative level, I checked for the following setups (what happened if you would've followed the respective group of traders either on the short or long side of the market, e.g. one went short when a group of traders switched their net position from long to short, or one went short when positions were reported at an elevated low level, and vice versa):

  • the group (commercial, non-commercial or small traders) switched from a net long to a net short position and vice versa,

and net position in ES E-mini (S&P 500) futures were reported

  • in the bottom / top percentile of the up to then current readings (no hindsight bias)
  • at the lowest / highest level during the last 6 months (6-months low/high)
  • at least 1.75 standard deviations below / above the (running) 6-months mean.

Table I below shows the SPY's historical performance over the course of the then following 5 , 21 (regularly 1 month), 42 sessions (approximately 2 months), 63 sessions (approximately 3 months) and 126 sessions (approximately 6 months) sessions assumed one went short on close of a session where the respective group (commercial, non-commercial or small traders) switched from a net long to a net short position (e.g. 'CM: L -> S' = commercial traders switched from net long to net short), and long on close of a session where the respective group switched from a net short to a net long position. In this event 'Profitable Close' x sessions later represents the respective group's quality of forecast (winning percentage).


Larger Image

Whenever any group of traders has switched their net position from net long to net short, historically this has never been a good point in time to close out one's long position and / or to short the market. The probability of a profitable close over the course of the then following 6 month always had its difficulties to make it above the 50% mark (you'd be better of to flip a coin), leave alone to beat the random chance for a profitable close if you were always long the market (buy and hold approach). And even if any group of traders has switched their net position from net short to net long, none of the groups were able to qualify as above-average market timers (historically they were not able to beat the random chance for a higher close x sessions later).

Table II below shows the SPY's historical performance over the course of the then following 5, 21 (regularly 1 month), 42 sessions (approximately 2 months), 63 sessions (approximately 3 months) and 126 sessions (approximately 6 months) sessions assumed one went short on close of a session where the respective group's (commercial, non-commercial or small traders) net position was reported in the bottom percentile of the of the up to then historical readings, and long on close of a session where the respective group's (commercial, non-commercial or small traders) net position was reported in the top percentile of the of the up to then historical readings.


Larger Image

Conclusions remain unchanged (and partly not only unimproved, but even worse): Historically elevated levels (bottom or top percentile) in net positions in ES E-mini (S&P 500) futures did not provide - for none of the participating group of traders - an (considerably) above-average (leave alone a reliable) signal to go short or long the markets.

Table III below now shows the SPY's historical performance over the course of the then following 5, 21 (regularly 1 month), 42 sessions (approximately 2 months), 63 sessions (approximately 3 months) and 126 sessions (approximately 6 months) sessions assumed one went short on close of a session where the respective group's (commercial, non-commercial or small traders) net position was reported at the lowest level during the last 6 month (6-months low) , and long on close of a session where the respective group's (commercial, non-commercial or small traders) net position was reported at the highest level during the last 6 month (6-months high).


Larger Image

Two notably observations:

  • with net positions in ES E-mini (S&P 500) futures reported at a 6-month low, commercial and non-commercial traders were regularly positioned on the wrong side of the market over the course of the then following 6 months. With commercial traders net positions in ES E-mini (S&P 500) futures at a 6-month low, the SPY was trading at a higher level 21 sessions (1 month) later on 3 out of every 4 occurrences (winning percentage on the short side of the market of 23.29% only), and with non-commercial traders net positions in ES E-mini (S&P 500) futures at a 6-month low, the SPY was trading at a higher level 3 and 6 months later on 3 out of every 4 occurrences as well (winning percentage on the short side of the market of 25.42% and 25.86% only),

  • with net positions in ES E-mini (S&P 500) futures reported at a 6-month high (and with 86 occurrences a statistically significant and remarkable sample size), and looking 1 month ahead, small traders were conspicuously frequent (70.93% of the time) positioned on the right (the long) side of the market.

Table IV below now shows the SPY's historical performance over the course of the then following 5, 21 (regularly 1 month), 42 sessions (approximately 2 months), 63 sessions (approximately 3 months) and 126 sessions (approximately 6 months) sessions assumed one went short on close of a session where the respective group's (commercial, non-commercial or small traders) net position was reported at least 1.75 standard deviations below the (running) 6-months mean, and long on close of a session where the respective group's (commercial, non-commercial or small traders) net position was reported at least 1.75 standard deviations above the (running) 6-months mean.


Larger Image

Two notably observations again:

  • with net positions in ES E-mini (S&P 500) futures reported at least 1.75 standard deviations below the (running) 6-months mean, commercial, non-commercial and small traders were regularly on the wrong side of the market over the course of the then following 6 months. With commercial trader's net positions in ES E-mini (S&P 500) futures at least 1.75 standard deviations below the (running) 6-months mean, the SPY was trading at a higher level 21 sessions (1 month) later on 7 out of every 10 occurrences (winning percentage on the short side of the market of 30.14% only), and with non-commercial and small traders net positions in ES E-mini (S&P 500) futures at least 1.75 standard deviations below the (running) 6-months mean, the SPY was trading at a higher level 3 and 6 months later on 3 out of every 4 occurrences as well (winning percentage on the short side of the market at or around 25% only),

  • with commercial trader's net positions in ES E-mini (S&P 500) futures reported at least 1.75 standard deviations above the (running) 6-months mean, the SPY was trading at a higher level 3 and 6 months later on 4 out of every 5 occurrences and 3 out of every 4 occurrences respectively (winning percentage on the long side of the market at 80.77% and 75.00% respectively)

But one thing to keep in mind:

Non-commercial trader's held a net short position in ES E-mini (S&P 500) futures of -150,000 contracts (or even more, like on October 19, 2010) over long periods of time in 2007 and 2008 (financial crisis), and since 05/2007 looking ahead 3 and 6 months later they were positioned on the right (the short) side of the market almost all of the time, while they were positioned on the wrong side of the market on almost all of those occurrences before 04/2007, see table V below:



Conclusions:

  • Historically switching from a net long to a net short position and/or elevated levels (net short position in the bottom percentile, at a 6-months low or at least 1.75 standard deviations below the 6-months mean) in net positions in ES E-mini (S&P 500) futures did not provide - for none of the participating groups of traders - an (considerably) above-average (leave alone a reliable) signal to close long positions or short the market, but instead sometimes provided a (contrary) significantly above-average chance (above the respective at-any-time / random chance for a higher close x months later) to go long,

  • when net positions in ES E-mini (S&P 500) futures were reported at an elevated positive level, commercial traders were significantly more often positioned on the right (the long) side of the market than non-commercial or small traders, and especially when commercial trader's net positions in ES E-mini (S&P 500) futures were reported at least 1.75 standard deviations above the (running) 6-months mean (as of October 19, 2010), the SPY was trading at a higher level 3 and 6 months later on 4 out of every 5 occurrences and 3 out of every 4 occurrences respectively (winning percentage on the long side of the market at 80.77% and 75.00% respectively),

  • but when non-commercial trader's held a net short position in ES E-mini (S&P 500) futures of -150,000 contracts (or even more, like on October 19, 2010), they were almost always proved correct 3 and 6 month later at least with respect to those occurrences since 04/2007, but positioned on the wrong side of the market on almost all of those occurrences before (fortune or timing ?).

With 3 setups triggered in favor of the long side of the market (non-commercial net short position at 6-month low and at least 1.75 standard deviations below 6-months mean - regularly a contrary signal to go long - ; commercial net long position at least 1.75 standard deviations above 6-months mean - historically an intermediate- and longer-term buy signal) and 1 setup (non-commercial trader's hold a net short position in ES E-mini (S&P 500) futures of at least -150,000 contracts) triggered in favor of lower prices ahead, it will be interesting to see who ultimetely will be on the right side of the market with respect to the most recent occurrence.

Successful trading,

 

Back to homepage

Leave a comment

Leave a comment