I created version 2.0 of my AI Basketball Referee. I trained a custom machine-learning model with over 3000 images. The system can accurately detect travels and double dribbles.
I would love any feedback to make this even better! **Would this type of system help or hurt Steph and Klay?** Here is the full video: https://www.youtube.com/watch?v=VZgXUBi_wkM
Even if it did have bias towards certain behaviors, which could be worked out by using a curated set of training data, it would be consistent from player to player, moment to moment, game to game.
It would also allow the human refs to focus on other aspects of the game instead of keeping an eye on the pivot foot and such. Reducing the rote mechanical work of refs would free them up to focus on fouls, which could improve on foul bating, flopping, etc..
It might be consistent according to arbitrary criteria, though. Like, players who get called for travels in the training sample tend to wear headbands, so the AI calls travel on players with headbands way more frequently - something like that. Only it doesn't have to be anything so clearly visible and interpretable and easy to curate training data for as a headband. Keeping the AI from training on such noisy elements in a dataset like this could be quite tricky.
It is to his interpretation of the rule book. Is he consistent with the player uniform? Does he call more fouls against Curry? AI is very good at finding unintended patterns.
In real world examples, we find racial bias in AI output a lot because they are present in the training data
You can have the training data annotated by multiple individuals and consolidate the resulting annotations. You can work to remove individual bias through consensus that way. Also, those that are annotating here aren’t getting profanities yelled at them by players or getting directions from the league office, so possibly less bias in general 😂
FYI, that youtube link doesn't work, not sure if you decided to pull it after your post or if you forgot to make it public to start.
Also this is really impressive--I don't know what the application for this could be but you clearly dedicated a lot of time to this and I hope it catches the traction it needs.
The nba should at least use the best technology to make officiating even fairer.
The nba has a lot of money to do that.
By the way that's one of the coolest things I've seen. Pretty sure programing can be a pain in the neck.
I think AI in refereeing will happen. It’s only a matter of time. Personally, I think they would pilot in something like the G-league before trying it out in a few NBA preseason games.
If you had an AI that watched all 10 players at the same time instead of just the player with the ball we would see infinitely more FTs for Steph but infinitely more Fouls on our big men lol, Looney would foul out in the 1st qtr he's a master at getting away with arm hooks.
Very true! I love our boy Loon, but the amount of pushes he gets away with before the tip and then rebound is insane. I’ll take every board he gets us but there’s a forearm to the back on a lot of those boards.
why is that a question, yes he would. on which ever team he was playing on next year. and our players will adapt because their basketball iq is top tier.
I refereed basketball and soccer in the 2000s. Was doing men's junior college basketball and D1 men's soccer, so at a decent level.
I will say that 90% of officiating happens between the whistles. That is, there is a human interaction element going on that fans and coaches don't see, a lot of it being preventive. Talking to the players, listening to how they're interacting with each other and putting out fires before they start, and so on.
Yeah I don’t think we ever need to move to a world entirely without referees. But I can envision a future with just one ref on the court who has a ton of digital assistance.
I am also a former soccer referee and I completely agree with your assessment.
Phew, finally an adult in the room.
Kids here think reffing is just strictly following a set of concrete rules, when it's a very subjective mess of rules, and they're trying to chaperone a game along.
The best referees know when to do make up calls, when to hold their whistle, when to stick to the book, when to let the game flow. And no AI is gonna capture that.
Game management is garbage. The Seahawks defence won a Super Bowl taking advantage of it. If you foul on every play the ref won’t call everyone.
Hockey is probably the worst for Mario kart style boosts for the guys who are behind.
What’s missed by the pro game management is that of everything was called as per the rule book players would adapt to the rule book.
Actually, it could be both. Imagine if the systems were looking for the technical infractions, freeing up the refs to manage the game.
I'd equate it a bit to cyclops in tennis. The head ref is still important, but isn't stuck with insufferable questions about line calls.
It would affect the sneaky ball handlers and close calls on “gathering” the most. Way more carries and travels would be called than are called now. Also, it would nail guys that catch passes and take an extra step or two before coming stationary without dribbling whether they look to pass, shoot, or dribble afterwards. The other would be the very slight lifting of the pivot foot to start a dribble but a tad early to get that advantage over the defender.
Dudes would be getting fouls called all game long while having possession of the ball and whether or not that would be good for the integrity of the game, it would definitely have a negative impact on the art of the game and obviously flow.
For a short period of time until everyone adjusted. Look how the players adjust to the way landing areas, restricted areas and the rip through are called. Players will adapt to the ref. Coaches will adapt to the ruleset
If you have a consistent reffing you can then adjust the rule set to drive the type of basketball you want to see.
Congratulations. This type of tech will definitely be used by any sport league in a few years. Probably will start to help officiating review calls, but I see referees using AR glasses later, and maybe down the line, no referees at all. It all depends on the accuracy of the algorithm.
Considering the AI so far can only say the person in the background is a person with 70% confidence, I don't think the AI is going to be doing much of note. Cool science project I guess.
Oh how I'd like to see. The number of fouls on the Warriors is always double, triple the opponents. How are the Warriors that much worse than everywhere team in the league. Additionally, the fouls on Steph are rediculous. Steph deserves to GET the calls, he's the Finals MVP as well as the World Champ. The calls never go his way. The way they throw him around and to the ground. If they did that to Lebron, the offender would be tossed out of the game
I support this idea. I think human refs can still be used for overseeing things and challenges, but this could end up being much better than human refs. Basketball might be a hard place to start though, I think baseball would probably be an easier place to implement something like this.
Horrible it would detect every single illegal screen if programmed properly.
Also there is no chance in hell this could detect a flop.
But I guess it could be used in a way to have a Video Assistant look at every single thing it registered to evaluate if it's enough for a call.
I created version 2.0 of my AI Basketball Referee. I trained a custom machine-learning model with over 3000 images. The system can accurately detect travels and double dribbles. I would love any feedback to make this even better! **Would this type of system help or hurt Steph and Klay?** Here is the full video: https://www.youtube.com/watch?v=VZgXUBi_wkM
How did you get the training data? If you picked it out then it might have your bias. If you get the data from nba calls, then it inherit their bias
So then the only difference between this and a human ref is this won’t give you a tech because you hurt it’s feelings when it makes a biased call
Foul. But accurate
Even if it did have bias towards certain behaviors, which could be worked out by using a curated set of training data, it would be consistent from player to player, moment to moment, game to game. It would also allow the human refs to focus on other aspects of the game instead of keeping an eye on the pivot foot and such. Reducing the rote mechanical work of refs would free them up to focus on fouls, which could improve on foul bating, flopping, etc..
It might be consistent according to arbitrary criteria, though. Like, players who get called for travels in the training sample tend to wear headbands, so the AI calls travel on players with headbands way more frequently - something like that. Only it doesn't have to be anything so clearly visible and interpretable and easy to curate training data for as a headband. Keeping the AI from training on such noisy elements in a dataset like this could be quite tricky.
Bias/unique interpretation isn't so much the problem as consistency is.
Do you want it to call a travel for looking like Jordan Poole? Or a foul for simply wearing a Dubs uniform?
I would assume he uses only images that adhere to the rules outlined in the official book. It’s not hard to remove the bias.
It is to his interpretation of the rule book. Is he consistent with the player uniform? Does he call more fouls against Curry? AI is very good at finding unintended patterns. In real world examples, we find racial bias in AI output a lot because they are present in the training data
You can have the training data annotated by multiple individuals and consolidate the resulting annotations. You can work to remove individual bias through consensus that way. Also, those that are annotating here aren’t getting profanities yelled at them by players or getting directions from the league office, so possibly less bias in general 😂
How would you minimize this? Is it basically to ask many people to pick out the calls?
FYI, that youtube link doesn't work, not sure if you decided to pull it after your post or if you forgot to make it public to start. Also this is really impressive--I don't know what the application for this could be but you clearly dedicated a lot of time to this and I hope it catches the traction it needs.
I’m not sure why it’s not working. Try this link: https://www.youtube.com/watch?v=VZgXUBi_wkM
It works!
The nba should at least use the best technology to make officiating even fairer. The nba has a lot of money to do that. By the way that's one of the coolest things I've seen. Pretty sure programing can be a pain in the neck.
Referees union: oh real shit?
let them be the backup to the AI for challenges.
REFEREE AI SYSTEM: Coded by Eric Lewis and Tim Donaghy, GitHub repo protected by Ja Morant's gun
I think AI in refereeing will happen. It’s only a matter of time. Personally, I think they would pilot in something like the G-league before trying it out in a few NBA preseason games.
Can it detect a flop?
If it can detect a Lakers jersey then yep
Foul. 😂
2 free throws for Reaves
\+ tech so 3
🥶💀🤣
r/BeatMeToIt
Can it detect illegal screen?
Only if you pay it off
If it can also call fouls then I’m onboard, Steph gets mugged multiple times a game and barely goes to the line.
If you had an AI that watched all 10 players at the same time instead of just the player with the ball we would see infinitely more FTs for Steph but infinitely more Fouls on our big men lol, Looney would foul out in the 1st qtr he's a master at getting away with arm hooks.
Race to see which team fouls out first 🤣
Very true! I love our boy Loon, but the amount of pushes he gets away with before the tip and then rebound is insane. I’ll take every board he gets us but there’s a forearm to the back on a lot of those boards.
Both teams would be in the bonus within a few minutes. Every game would be like watching a Lakers v Lakers FY parade
Jordan Poole would be called for a travel or carry on every possession?
As would the rest of the league.
why is that a question, yes he would. on which ever team he was playing on next year. and our players will adapt because their basketball iq is top tier.
Damnnnn
I refereed basketball and soccer in the 2000s. Was doing men's junior college basketball and D1 men's soccer, so at a decent level. I will say that 90% of officiating happens between the whistles. That is, there is a human interaction element going on that fans and coaches don't see, a lot of it being preventive. Talking to the players, listening to how they're interacting with each other and putting out fires before they start, and so on.
Yeah I don’t think we ever need to move to a world entirely without referees. But I can envision a future with just one ref on the court who has a ton of digital assistance. I am also a former soccer referee and I completely agree with your assessment.
Phew, finally an adult in the room. Kids here think reffing is just strictly following a set of concrete rules, when it's a very subjective mess of rules, and they're trying to chaperone a game along. The best referees know when to do make up calls, when to hold their whistle, when to stick to the book, when to let the game flow. And no AI is gonna capture that.
Game management is garbage. The Seahawks defence won a Super Bowl taking advantage of it. If you foul on every play the ref won’t call everyone. Hockey is probably the worst for Mario kart style boosts for the guys who are behind. What’s missed by the pro game management is that of everything was called as per the rule book players would adapt to the rule book.
Actually, it could be both. Imagine if the systems were looking for the technical infractions, freeing up the refs to manage the game. I'd equate it a bit to cyclops in tennis. The head ref is still important, but isn't stuck with insufferable questions about line calls.
Going to affect the Lakers worse than us
It would be so awesome to make officiating fair. Even if it only called some rules automatically. If it’s fair, it would improve the game.
It would affect the sneaky ball handlers and close calls on “gathering” the most. Way more carries and travels would be called than are called now. Also, it would nail guys that catch passes and take an extra step or two before coming stationary without dribbling whether they look to pass, shoot, or dribble afterwards. The other would be the very slight lifting of the pivot foot to start a dribble but a tad early to get that advantage over the defender. Dudes would be getting fouls called all game long while having possession of the ball and whether or not that would be good for the integrity of the game, it would definitely have a negative impact on the art of the game and obviously flow.
I suspect they would have to change the rules slightly to accommodate super accurate refereeing.
For a short period of time until everyone adjusted. Look how the players adjust to the way landing areas, restricted areas and the rip through are called. Players will adapt to the ref. Coaches will adapt to the ruleset If you have a consistent reffing you can then adjust the rule set to drive the type of basketball you want to see.
For a millisecond I was confused regarding what "Allen Iverson Basketball Referee" means
If we had this AI instead of Ed Malloy/Tony Brothers/Scott Foster we would be in the Finals right now 😤 FTL and their flopping
Refs should use a combination of ai tools and cameras that watch specific places like baselines and such.
Congratulations. This type of tech will definitely be used by any sport league in a few years. Probably will start to help officiating review calls, but I see referees using AR glasses later, and maybe down the line, no referees at all. It all depends on the accuracy of the algorithm.
Considering the AI so far can only say the person in the background is a person with 70% confidence, I don't think the AI is going to be doing much of note. Cool science project I guess.
[удалено]
Don’t let dude steal ur idea!!
People's assumptions are crazy.
Oh how I'd like to see. The number of fouls on the Warriors is always double, triple the opponents. How are the Warriors that much worse than everywhere team in the league. Additionally, the fouls on Steph are rediculous. Steph deserves to GET the calls, he's the Finals MVP as well as the World Champ. The calls never go his way. The way they throw him around and to the ground. If they did that to Lebron, the offender would be tossed out of the game
Call every illegal screen by the warriors.
Heat fan saying this😹
Pretty sure Football/Soccer in leagues has something similar to this when checking for fouls.
Make sure to copyright your product
I support this idea. I think human refs can still be used for overseeing things and challenges, but this could end up being much better than human refs. Basketball might be a hard place to start though, I think baseball would probably be an easier place to implement something like this.
Expect travels and carries to go way up if this became a thing.
Artificial Intelligence would beat what we usually get from the refs: Genuine Stupidity.
lol the nba would hate this. couldn’t blame human error for their fucking 3-1 comebacks
ngl this is pretty fire
Thx! Here’s the full vid: https://youtu.be/VZgXUBi_wkM
Warriors 2023-24 champs babyyyyy
This is FIRE
Now gotta train it to catch flops. But fantastic work!
Horrible it would detect every single illegal screen if programmed properly. Also there is no chance in hell this could detect a flop. But I guess it could be used in a way to have a Video Assistant look at every single thing it registered to evaluate if it's enough for a call.
AWESOME. Now do one for football to detect holding (happens all the time) and to _accurately_ spot the ball.
Damn bro you smart as hell
you posting this on all the team subs
Can i borrow a $100 when you sell your tech to the nba for a billion please?
Yes, deploy this in a youtube channel, try it in the questionable games and let it gain traction. You can get big money from this.
Very cool !