Ratings - please read before commenting - Archived

Locked
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

jujigatame wrote:Not saying he should be limited by a previous loss, but you should have to work a little harder to push yourself up the ratings than beating 11 total bums. Anybody in the top 50 could have beaten the guys that Briggs beat in the time since he lost to McCline.
I think you're being a little harsh.. Total bums are the guys that Justin Blevins beats.

Chris Koval, Ray Mercer, Abraham Okine are pretty decent fighters.

Statistically, we compute what's best for the whole. Perhaps guys like Briggs and Fields are placed higher than they should be.. but there's no fixing that without hurting the accuracy of the entire system. Ironically, everytime we improve the overall accuracy.. Briggs seems to climb the ratings.
jujigatame
Heavyweight
Heavyweight
Posts: 7434
Joined: 30 Oct 2004, 21:08

Post by jujigatame »

I just think it's kind of ridiculous that you can get rated #4 in the world by fighting solely C-level opposition. It goes against my delicate sensibilities.
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

jujigatame wrote:I just think it's kind of ridiculous that you can get rated #4 in the world by fighting solely C-level opposition. It goes against my delicate sensibilities.
Should expect the ratings to shift again here soon.. I dont think the intended results are posted.
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

JCS83MD wrote:
jujigatame wrote:I just think it's kind of ridiculous that you can get rated #4 in the world by fighting solely C-level opposition. It goes against my delicate sensibilities.
Should expect the ratings to shift again here soon.. I dont think the intended results are posted.
They are now available.
jujigatame
Heavyweight
Heavyweight
Posts: 7434
Joined: 30 Oct 2004, 21:08

Post by jujigatame »

Briggs is still #4!! DAMN YOU!!!
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

jujigatame wrote:Briggs is still #4!! DAMN YOU!!!
Well if Brock wins tomorrow, Briggs will drop to #5.
RiddickBowe
Heavyweight
Heavyweight
Posts: 159
Joined: 16 Apr 2002, 20:00

Post by RiddickBowe »

Well, the ratings are getting better, but still aren't there yet. Chad Dawson the #1 LH? Ouma still rated above Karmazin? Tye Fields still above Rahman? Valueve still #1 at HW?

I commend your work to improve the system, but the ratings still look ridiculous in places.
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

RiddickBowe wrote:Well, the ratings are getting better, but still aren't there yet. Chad Dawson the #1 LH? Ouma still rated above Karmazin? Tye Fields still above Rahman? Valueve still #1 at HW?

I commend your work to improve the system, but the ratings still look ridiculous in places.
Well its a performance rating, not a traditional ranking. So there's no reason why Ouma can't be ahead of Karmazin. I agree, theres some issues.. but the stats don't lie. We optimize for overall accuracy, no matter if its a fight involving Top 10 guys, or an ESPN2 main event.

This last update was pretty big.
pundit
Heavyweight
Heavyweight

Post by pundit »

#1 Chad Dawson, #2 Stipe Drews, ...... , #13 Paul Briggs.

I'm sure this is all totally scientific, but it doesn't make sense.

P
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

pundit wrote:#1 Chad Dawson, #2 Stipe Drews, ...... , #13 Paul Briggs.

I'm sure this is all totally scientific, but it doesn't make sense.

P
Stipe is a resiliant beast!!!
pundit
Heavyweight
Heavyweight

Post by pundit »

JCS83MD wrote:
pundit wrote:#1 Chad Dawson, #2 Stipe Drews, ...... , #13 Paul Briggs.

I'm sure this is all totally scientific, but it doesn't make sense.

P
Stipe is a resiliant beast!!!
Yeah, continues to gets beaten down and yet makes it up the boxrec ratings again and again! :wink:
jujigatame
Heavyweight
Heavyweight
Posts: 7434
Joined: 30 Oct 2004, 21:08

Post by jujigatame »

JCS83MD wrote:
jujigatame wrote:Briggs is still #4!! DAMN YOU!!!
Well if Brock wins tomorrow, Briggs will drop to #5.
It doesn't matter how he wins? Has method of victory been removed from the criteria?
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

jujigatame wrote:
JCS83MD wrote:
jujigatame wrote:Briggs is still #4!! DAMN YOU!!!
Well if Brock wins tomorrow, Briggs will drop to #5.
It doesn't matter how he wins? Has method of victory been removed from the criteria?
Sure it does, but the gap between them is so small.. any win will propel him up.

I know it sounds awful, but a good or great win will take him to #1
RiddickBowe
Heavyweight
Heavyweight
Posts: 159
Joined: 16 Apr 2002, 20:00

Post by RiddickBowe »

JCS83MD wrote:Well its a performance rating, not a traditional ranking. So there's no reason why Ouma can't be ahead of Karmazin.
Except for the fact that when they met, Karmazin beat Ouma. I understand that these rankings try to predict who will beat whom, and I fully recognize that Ouma would likely beat Karmazin if they fight again. That being said, the fact remains that Karmazin beat Ouma in a head-to-head matchup. It's hard to justify ranking Ouma ahead of him, even if Ouma has been more active.
I agree, theres some issues.. but the stats don't lie.
Of course they do. Remember the Twain quote -- "lies, damn lies, and statistics." As was pointed out elsewhere, it's hard to have rankings of this sort because so few fighters in the top 25 fight each other.

Take the heavyweight rankings. These rankings say that Valuev would beat every heavyweight out there. While it's true that in the next year or so Valuev will beat every heavyweight he fights, that's not the same as saying he'd beat every heavyweight. He simply won't fight the heavyweights whom his management knows will beat him. I think Rahman would beat him, for instance, but they are unlikely to meet.

Tye Fields is the same thing. Sure, he'll beat the guys he fights, but he won't be fighting good guys. So these rankings will reward him for that, but we all know that if he fought someone like Rahman or even Chris Byrd, he'd likely lose. But since that won't happen, your rankings will still be accurate in the technical sense, but they won't reflect reality.

All rankings are subjective. To try and get it down to a science is futile since there will always be the human factor at play. For example, since these rankings are trying to show who would beat whom, for them to be accurate in 1990 they would have needed to show that Buster Douglas was ranked ahead of Mike Tyson. Any computer program that would have produced a ranking like that before their Tokyo fight would have been seriously flawed. But Douglas did beat Tyson and no computer rankings could have predicted that.
We optimize for overall accuracy, no matter if its a fight involving Top 10 guys, or an ESPN2 main event.
I know, but I disagree with how you define "accuracy."
This last update was pretty big.
Indeed it was, and it rectified some of the problems I noticed before.

Look, I'm not trying to be a pain in the ass on this. I know it's hard work to do all the rejiggering of the ratings criteria. The last thing you probably want is to have some guy like me sitting at my computer pointing out what I perceive as flaws. I want to see the best ratings possible, though, and if they look strange from my perspective, I'm going to let you know. I do appreciate the work you do, though.

In the end, I agree with an editorial I read in a 1970's copy of Ring magazine. Some guy had approached the editor Nat Loubet and said that he had a computer program for ranking boxers. Loubet explained why this wouldn't be a good idea, since all the variables that go into ranking fighters would be difficult to quantify in a computer program. That's true in my mind. Sometimes you just know Fighter A is better than Fighter B for some undefinable reason, and that's that. No computer program can do this.
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

RiddickBowe wrote:
JCS83MD wrote:Well its a performance rating, not a traditional ranking. So there's no reason why Ouma can't be ahead of Karmazin.
Except for the fact that when they met, Karmazin beat Ouma. I understand that these rankings try to predict who will beat whom, and I fully recognize that Ouma would likely beat Karmazin if they fight again. That being said, the fact remains that Karmazin beat Ouma in a head-to-head matchup. It's hard to justify ranking Ouma ahead of him, even if Ouma has been more active.
I agree, theres some issues.. but the stats don't lie.
Of course they do. Remember the Twain quote -- "lies, damn lies, and statistics." As was pointed out elsewhere, it's hard to have rankings of this sort because so few fighters in the top 25 fight each other.

Take the heavyweight rankings. These rankings say that Valuev would beat every heavyweight out there. While it's true that in the next year or so Valuev will beat every heavyweight he fights, that's not the same as saying he'd beat every heavyweight. He simply won't fight the heavyweights whom his management knows will beat him. I think Rahman would beat him, for instance, but they are unlikely to meet.

Tye Fields is the same thing. Sure, he'll beat the guys he fights, but he won't be fighting good guys. So these rankings will reward him for that, but we all know that if he fought someone like Rahman or even Chris Byrd, he'd likely lose. But since that won't happen, your rankings will still be accurate in the technical sense, but they won't reflect reality.

All rankings are subjective. To try and get it down to a science is futile since there will always be the human factor at play. For example, since these rankings are trying to show who would beat whom, for them to be accurate in 1990 they would have needed to show that Buster Douglas was ranked ahead of Mike Tyson. Any computer program that would have produced a ranking like that before their Tokyo fight would have been seriously flawed. But Douglas did beat Tyson and no computer rankings could have predicted that.
We optimize for overall accuracy, no matter if its a fight involving Top 10 guys, or an ESPN2 main event.
I know, but I disagree with how you define "accuracy."
This last update was pretty big.
Indeed it was, and it rectified some of the problems I noticed before.

Look, I'm not trying to be a pain in the ass on this. I know it's hard work to do all the rejiggering of the ratings criteria. The last thing you probably want is to have some guy like me sitting at my computer pointing out what I perceive as flaws. I want to see the best ratings possible, though, and if they look strange from my perspective, I'm going to let you know. I do appreciate the work you do, though.

In the end, I agree with an editorial I read in a 1970's copy of Ring magazine. Some guy had approached the editor Nat Loubet and said that he had a computer program for ranking boxers. Loubet explained why this wouldn't be a good idea, since all the variables that go into ranking fighters would be difficult to quantify in a computer program. That's true in my mind. Sometimes you just know Fighter A is better than Fighter B for some undefinable reason, and that's that. No computer program can do this.

I follow everything you're saying... but there's a flipside to every point you try to make.

Valuev is not #1 because he can beat every other heavyweight. If that was the case, there probably won't be a #1 in any division. Someone has to be #1 and it just so happens the system has him at #1.

Guys like Briggs and Fields are hell for the system. The system is kinder to those who are very active and score decisive victories. These guys do both, so there is no keeping them down unless you hurt the accuracy of the rest of the system.

Accuracy is determined by the amount of bouts predicted correctly pre-bout. We can handle this since we have well over 100 years of data (although we're only concerned with the 2000s). We simply count how many we get correct and how many we get incorrect. If we were to weight this on fights only containing two Top 10 or 25 or whatever fighters, than I think that would be unfair.

To an extent, you can quantify results in computerized rankings.. Thats ALL you can do. Traditional ranking which people create often introduce bias, overlooked factors and ignorance. The former computerized systems invoked these same traits. Now, it is purely objective and I feel this is the only real honest way to make a computerized ranking. It WILL get better... but people will find it bad.. Because

A. It deviates from the norm.

B. There will be noticeable glitches.

C. Their ignorance.


I am not saying all fans are ignorant but a lot are. At least in the objective system, you can put a finger on a problem and fix it.. rather than argue why you think A is better than B.




Edit:

And aside from what people may say... Every once in a while, guys like Briggs and Fields do get decent victories. Perhaps not Top 25 victories, but we can use deductive reasoning to say if they can KO a guy around #40 in the 3rd round.. they can most likely beat a #25 guy.

The system also gives some credit for tune-up fights... I mean if tune-up fights were worthless.. than fighters wouldn't take them. As for Ouma, Karmazin.. It may just happen that Roman beats Spinks decisively and then he himself is #1. Its a lot of flip-flopping.. but its all about who is where before their bouts because anything can happen between then and now.
pundit
Heavyweight
Heavyweight

Post by pundit »

JCS83MD wrote:To an extent, you can quantify results in computerized rankings.. Thats ALL you can do. Traditional ranking which people create often introduce bias, overlooked factors and ignorance. The former computerized systems invoked these same traits. Now, it is purely objective and I feel this is the only real honest way to make a computerized ranking. It WILL get better... but people will find it bad.. Because

A. It deviates from the norm.

B. There will be noticeable glitches.

C. Their ignorance.

I am not saying all fans are ignorant but a lot are. At least in the objective system, you can put a finger on a problem and fix it.. rather than argue why you think A is better than B.
Look, I really don't want to piss you off and appreciate the efforts you and others put into this. But if I may say: I personally cannot help but find the rankings boxrec had about a year ago more convincing than todays'. I understand that the criteria differ between the old and the new rankings, and that you prefer the new criteria for objectivity reason - but others, including myself, fail to be convinced.

Would it perhaps be possible to keep ratings according to the old criteria somewhere where visitors to this side can still find them?

Cheers, P
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

pundit wrote:
JCS83MD wrote:To an extent, you can quantify results in computerized rankings.. Thats ALL you can do. Traditional ranking which people create often introduce bias, overlooked factors and ignorance. The former computerized systems invoked these same traits. Now, it is purely objective and I feel this is the only real honest way to make a computerized ranking. It WILL get better... but people will find it bad.. Because

A. It deviates from the norm.

B. There will be noticeable glitches.

C. Their ignorance.

I am not saying all fans are ignorant but a lot are. At least in the objective system, you can put a finger on a problem and fix it.. rather than argue why you think A is better than B.
Look, I really don't want to piss you off and appreciate the efforts you and others put into this. But if I may say: I personally cannot help but find the rankings boxrec had about a year ago more convincing than todays'. I understand that the criteria differ between the old and the new rankings, and that you prefer the new criteria for objectivity reason - but others, including myself, fail to be convinced.

Would it perhaps be possible to keep ratings according to the old criteria somewhere where visitors to this side can still find them?

Cheers, P

We (Computerrank and I) are not trying to compete with the old system.. because that is a more traditional ranking system. IF you REALLY want one of them.. Try the Ring Magazine, or boxingtalk.net, or fightnews.com and even those force you to trust the person making it.
pundit
Heavyweight
Heavyweight

Post by pundit »

JCS83MD wrote: We (Computerrank and I) are not trying to compete with the old system.. because that is a more traditional ranking system. IF you REALLY want one of them.. Try the Ring Magazine, or boxingtalk.net, or fightnews.com and even those force you to trust the person making it.
I thought the old system was also computerized, but gave more importance to histroical achievements. It would be news to me that it was entirely opinion based (as The Ring's ranking).
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

pundit wrote:
JCS83MD wrote: We (Computerrank and I) are not trying to compete with the old system.. because that is a more traditional ranking system. IF you REALLY want one of them.. Try the Ring Magazine, or boxingtalk.net, or fightnews.com and even those force you to trust the person making it.
I thought the old system was also computerized, but gave more importance to histroical achievements. It would be news to me that it was entirely opinion based (as The Ring's ranking).
I'd call it a hybrid. Opinions influenced the factors and program code to make the ratings look good, but they were based on previous results.

Now we're coding for maximum accuracy.
pundit
Heavyweight
Heavyweight

Post by pundit »

JCS83MD wrote:
pundit wrote:
JCS83MD wrote: We (Computerrank and I) are not trying to compete with the old system.. because that is a more traditional ranking system. IF you REALLY want one of them.. Try the Ring Magazine, or boxingtalk.net, or fightnews.com and even those force you to trust the person making it.
I thought the old system was also computerized, but gave more importance to histroical achievements. It would be news to me that it was entirely opinion based (as The Ring's ranking).
I'd call it a hybrid. Opinions influenced the factors and program code to make the ratings look good, but they were based on previous results.
OK. I can only say I liked them and I regret that they can't be accessed any more.

Cheers, P
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

MontyCircus wrote:
JCS83MD wrote:Well its a performance rating, not a traditional ranking.
You should really stop using this defense as it's kind of silly.

Under this system, boxers have ratings and are ranked from best to worst.

It's kind of like "It's not a doll it's an action figure" or "We're not invading, we're liberating".

So we have a computerized system optimized to reduce "upsets", with (basically) absolutely no human intervention apart from endless refinements.

Should it be switched up to "look right", no. But yikes guys...Minto, Sykes, Thompson in the top 10? That's just wrong. Wrong wrong wrong wrong wrong.

There's got to be a refinement out there to limit this kind of crap. When you test to find optimal settings, are you testing multiple ones at the same time? Example...maybe with the system you decide to see how the decay rate should function, and you test that and find the optimal rate. But maybe changing both the decay rate and say...opponent point limits at the same time, having them all thrown into the bowl and mixed around would give you more of an optimal system?

Or maybe you do that already.

If this system were in place a few years ago I wouldn't be surprised to have seen Butterbean as the #1 heavyweight...he just kept on winning.

Good luck anyway
Its not an excuse, its the truth.. thats what it is, I should know as I helped program it.

Any and all limitations we've tested thus far lowered overall prediction rate. Martin and I have attacked this thing from many different angles and so far we have not found anything successful.
computerrank
Editor
Editor
Posts: 2492
Joined: 04 Jan 2003, 18:59

Post by computerrank »

New ratings - informations:

- prediciton ratio up to
-- 83.7 % for bouts between established boxers
-- 77.8 % for bouts between established boxers with win ratios of more than 75 %.
- improvement of about 1 %

- boxers with more than 2 bouts in a country have an home advantage of 125 points
- there is a lowering of the rating for boxers with a combined high average rating difference to their opponents ( boxing relative bums), high bout rate and high no-loss series
- there is a lowering of the earnings for boxers with a much lower actual bout performance than in their last bout

- all-time ratings are now based on the average of the best 5 annual ratings of a boxer
-
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

MontyCircus wrote:
JCS83MD wrote:Its not an excuse, its the truth.. thats what it is, I should know as I helped program it.

Any and all limitations we've tested thus far lowered overall prediction rate. Martin and I have attacked this thing from many different angles and so far we have not found anything successful.
Well truth be damned, because to outsiders it sounds like you're hiding behind semantics.

Also, may I suggest that you stop pretending you aren't "competing" with Ring rankings et. al. because you are.

Sure you're completely objective, scientifically measured, etc. and they are just picked by a couple of guys on a whim each week; but essentially you are all trying to do the same thing...create a boxing ranking that is accepted, respected, useful, etc. to people. You're just going about it in very different ways.

Anyway...enough for public relations...as for constructiveness...

Have you looked at focusing predictability on just the elite boxers? Let's be real for a minute...who really cares if you got a fight right between heavyweights #500 and #574? Is there a way to adjust the formula so the top 50'ish or top 100'ish are predicted better? Because that's all that anyone ever looks at anyway...

If you got all fights in the top 100 right and the next 1000 wrong, your overall predictability would probably be around 5% correct, abysmal eh? But it would look perfect (or at least predict perfectly) at the top. Which, I would argue, should be what you're striving for. I would imagine most others would find that more useful as well.

I think you've measured that somewhat with the "established boxers" predictability rating computerrank just posted up...but anyway...just throwing it out there :D
Primary focus is on fights that have two established boxers. An established boxer is one who has accumulated 300 pre-lim points. The process there is pretty involved.. but if you beat an established boxer, you're established. CRank could explain that one better.. but for example - Someone like Justin Blevins is not established. Actually, he's the highest ranked non-established boxer.. hehe, King of the Turds.

The secondary focus on accuracy is based on fights that have two established boxers, both with winning percentages equal to or over 75%.
generic screen name
Heavyweight
Heavyweight
Posts: 631
Joined: 11 Feb 2006, 16:28

Post by generic screen name »

Its totally bias to undefeated boxers, which is why alot of prospects who have a minor and/or crappy belt are up in the rankings. Look at the lb for lb ranking, Isaac Hlatshwayo is ahead of Jose Luis Castillo. Isaac Hlatshwayo!!!!!
JCS
Heavyweight
Heavyweight
Posts: 6243
Joined: 17 Dec 2004, 13:27

Post by JCS »

generic screen name wrote:Its totally bias to undefeated boxers, which is why alot of prospects who have a minor and/or crappy belt are up in the rankings. Look at the lb for lb ranking, Isaac Hlatshwayo is ahead of Jose Luis Castillo. Isaac Hlatshwayo!!!!!
P4P needs revising since its somewhat artificial.. Its an admitted problem... but simply because we do not program for it.
Locked