Like beauty, "the best" of anything is
very much in the eye of the beholder. For this analysis I have tried
to approach the process from the perspective of a fund manager looking for
a specialist trader to trade a portion of the managers fund, or an
experienced, analytical broker looking for Collective2 systems to
recommend to clients.
So good, consistent results with excellent
risk management is the ideal, and while I might add systems under 6 months
old to my "watchlist", I'm mainly interested in the more mature, proven
systems and traders.
I'll get into the full details of criteria and
scoring
later (towards the bottom of this page). At this stage let me just
summarize the process and results:
On Nov 28, 2007, I ran a query on "The Grid" at Collective2 with all the Filter boxes
checked: ie "Profitable
systems" "Smooth equity
curves" "Low risk per
trade" were all selected. I also selected systems that trade
stocks, futures or forex. I excluded options systems since I don't
feel adequately qualified or experienced in this area to assess
them. So if you're interested in trading options, this analysis
won't help.
This generated a list of 79 systems, which I copied
into Excel for further analysis, which included applying criteria and
calculating "The Muzza
Score".
In the table below the five systems in blue font at the
top are the only ones that meet all criteria, out of the 79 considered. The
table shows all those with a Muzza Score of 1.0 or
more.
The two systems with dark blue fill in their Age column
(Holly FTSE and Team Aphid Bird) are
the only two "mature" systems that meet all criteria.
Two criteria that eliminated some of the
other systems from the final list only related to system age and market
experience (number of trades x average trade duration, expressed in
days). Failing these two criteria doesn't mean a system is not one
of the best - it simply means there is too little data to make an
assessment with any confidence. Assuming they continue to trade
consistently, the systems marked with * will eventually join the list of systems that
meet the criteria, while those marked with ** are already "mature" systems (Have Fun) and would
be of particular interest to our fund manager or broker. Have Fun would be of
particular interest as it also has a good Muzza
Score.
Below the list of best systems (in blue font) the criteria
each system failed to meet are shown in bold
font. So for example, down at position 16 (Muzza Rank), Deep Value fails
the >=25% criteria for Annual Return: Maximum Drawdown ratio. A
ratio of 20:1 is set at 100% and other results are scaled relative to
this, up to a maximum of 500%. So the >=25% criteria equates to
an annual return : max DD ratio of 5:1 or higher. Challenging, but
certainly not impossible. Deep Value's result of 17% is in bold font
as it fails to meet the criteria.
Summary: As a broker or fund manager,
here are the "mature" systems (at least 180 days on C2) I would be
interested in:
Updates: I'll aim to update this
analysis on a regular basis and include a comment here on new additions to
the list of best systems, and deletions from the list. The next
update is planned for late Jan 2008.
The Best Of Collective2
(Exclude Options systems): Based On Data Extracted Nov 28,
2007.
The Muzza Score = [Mkt Exp Weight]
x [APD Factor] x [Profit
Factor] x [Ann Ret : Max DD Weight]
x [Max DD Factor] x [Realism
Factor]
NOTES:
All factors have maximum scores set for them to prevent undue
influence from "outlier" results. These range from 100% to 800% -
see below for more details for each factor.
Mkt Exp Weight: Market Experience data doesn't exist at
Collective2, but I have calculated it using other C2 data, specifically:
average trade duration (in days) and number of trades on C2 for this
system. Market Experience is a very important concept as it gives
the total "days in the market" for a trading system (number of trades x
average trade duration, expressed in days). Let's consider an
example to clarify this: a system that has traded for a year but
has only completed three trades may seem impossible to assess. But
if those trades have averaged 30 days each, then the trader has had 90
days in the market, during which he/she can botch things up, or
excel.
On each of those 90 days the trader is reviewing their
trades and answering these questions:
Do I close the trade?
Do I top-up the trade?
Do I close some of the trade to reduce its size?
Do I leave the trade as it is?
So, although there are
only 3 trades, there are 90 days of market experience, which meets the
minimum criteria of 70 days. The weighting process sets 70 days
at 100% and sets an upper cap at 300% (or 210 days). At this
point there is ample data to be confident in the performance analysis,
and additional market experience adds little in terms of additional
certainty.
APD Factor: APD is included as a statistic in C2, and is a key
performance measure. I make an important adjustment I'll get to in
a minute. Here's how I think of APD (Average profit per dollar of
drawdown): It's like an ROI figure for venture capitalists
investing in businesses. They will look for returns of 35 to 50%
or more to justify their high risk in investing in relatively unproven
businesses. Trading is also a risky business and we should aim to
achieve 0.35 to 0.50 or more, with 0.30 as a minimum.
As a
venture capitalist I might accept a lower return (say 30-40%) from a
proven management team that makes 80-90% great decisions, than from a
company with an average, or unproven, management team. This leads
to the simple adjustment I make to APD: systems with a % of winning
trades over 50% get their APDs adjusted up proportionately, while those
with less than 50% winning trades get adjusted down. Why?
Because a system with 90% winning trades can afford to make less gain
per dollar of risk (and most likely will) and still achieve a great
outcome.
An APD of 0.4 converts to 100% prior to applying the %
of winning trades adjustment. After adjustment, that 100% could
sit somewhere in the 80% to 200% range, and an upper cap of 800% is
applied. I view the APD Factor as the key measure of performance
in the Muzza Score calculation.
Profit Factor = total dollars gained / total dollars lost. A
score of 1.5:1 is set at 100% and a cap is set at 500% (equates to a
score of 7.5:1).
Ann Ret % : Max DD Weight: A ratio of 20:1 is set at 100% and
the minimum of 5:1 equates to a 25% score or higher. The cap is 500%
(equating to a ratio of 100:1). This is also a key measure as a
good score means high Annual Return with a low maximum drawdown, which
is a very attractive mix.
Max DD Factor: A maximum drawdown of 20% or higher is set at a 0%
factor score. A maximum drawdown of 0% would achieve a 100% factor
score. Other points are scaled between these two - eg: a max DD of 10%
would get a 50% factor score as 10% is midway between 20% and 0%. The
cap is 100%.
Realism Factor: this ranges from 0% to 100% and is taken as-is
from Collective2 and used in the Muzza Score calculation. A figure
of 80% or higher is required to meet the criteria for realism.
Maximum possible Muzza Score = 3 x 8 x 5 x 5 x 1 x 1 = 600, but in
reality no system is likely to get close to a perfect score, and the 116
for GoldenStocks Short Only is very creditable, and it
will be interesting to see how well this system ages.
For Collective2 System Vendors: For those who
have their systems highlighted with a link - CONGRATULATIONS! With my
"fund managers hat" on I can honestly say I believe you're doing an
awesome job! Keep up the great work. You're the vendors who give
Collective2 its real value.
For Investors: In my view, the highlighted
systems have traded extremely well. But what they have done, and
what they will do in the future can be two very different things.
I cannot give any guarantees and nor could the vendors themselves.
You need to make your own decisions based on your own research and
professional advice received. And always feel free to ask vendors at
Collective2 your most difficult or important questions - just use the
Private Message facility at Collective2. Please also read the full
disclaimer at the bottom of this page, and the one at Collective2.
You can view the
systems highlighted on this page, altogether for ease of comparison, at my
Analyst Page at
Collective2.
TrendSensor.com is a client of Collective2, but does not
represent Collective2. Specifically, the analysis on this page is the work
of Murray Nickel of TrendSensor.com and does not represent the views of
Collective2 or its representatives.
Disclosure: I am the vendor and trader
for the two TrendSensor systems at positions 9 and 10 in this
list.
To contact Murray just click on the
Contact link under the Information tab at
the top of each page.
Collective2 Growth:
Collective2 continues to become a more
popular destination for folk searching for the best trading systems to
trade: