BBO Robot Hands Why does BBO insist they are completely random
#1
Posted 2015-January-17, 20:36
#2
Posted 2015-January-17, 20:39
tx10s, on 2015-January-17, 20:36, said:
Prove this. To start with, please specify
1. A sampling methodology for hands yet to be dealt
2. The test of statistical statistical significant you feel to be appropriate
3. What confidence intervals you are using
#3
Posted 2015-January-18, 04:48
tx10s, on 2015-January-17, 20:36, said:
Psyche (pron. sahy-kee): The human soul, spirit or mind (derived, personification thereof, beloved of Eros, Greek myth).
Masterminding (pron. mstr-mnding) tr. v. - Any bid made by bridge player with which partner disagrees.
"Gentlemen, when the barrage lifts." 9th battalion, King's own Yorkshire light infantry,
2000 years earlier: "morituri te salutant"
"I will be with you, whatever". Blair to Bush, precursor to invasion of Iraq
#4
Posted 2015-January-19, 09:11
http://www.bridgebas...__1#entry794169
Even if we didn't insist we're not doing this, why would we WANT to do this? What would BBO gain from players losing finesses more often than real life?
#5
Posted 2015-January-19, 12:02
1eyedjack, on 2015-January-18, 04:48, said:
My testing method was to look at the previous 20 tournaments I played, nine different times. The finesse split in those nine different sets was:38.9%, 41.4%, 39.2%. 41.0%, 40.6%, 40.1%, 40.4%, 39.8%, and 38.3%, overall average 40.0% for 2522 finesses.(I eliminated a partial set of 8 tournaments from these statistics, which if included would lower the overall average to39.7%.) That is an average of 281 finesses per set. The odds of not getting more than 40% of the finesses in 280 is about 4000 to 1. I leave it to you to calculate that happening 9out of 9 times if the dealing was totally random. Other observed statistics, players got 4-0, 5-0 and 6-0 spits 5.9% of the time whereas the robots got the same bad splits 3.2% of the time. Players got 3-2 splits 66% of the time (close to the normal 67.8% of the time, yet the robots got 3-2 splits 80% of the time (96 out of 120), a long way from normal, and about 1 chance in 500 of occurring in totally random deals.
Posting the entire set of spreadsheet is rather difficult, but I would be willing to E-mail it to you if you really want to see it.
#6
Posted 2015-January-19, 14:05
tx10s, on 2015-January-19, 12:02, said:
tx10s, on 2015-January-19, 12:02, said:
I could go on, but the reality is that I am probably not the right person to validate your findings (although there will be plenty of readers of this forum who would be capable of doing so, and I hope that one of them steps up to the plate). If your method is sound, it would be a bit of a bombshell.
I have a few hundred tax returns to complete between now and the end of the month, so I will certainly not be looking at any data before then. I have downloaded into pbn all of the hands that you played since 02 Dec 2014, all of which seem to have been in robot tournaments. 354 hands in December and 382 (to date) in January. What I can do with this data I am not quite sure. I might send it to Bob Richardson to see if he has time to play with it.
As for sharing the data, it should be fairly trivial to upload a spreadsheet to dropbox or google drive - certainly no harder than emailing, and that way you open it up to peer review by a load of individuals, not just me.
Psyche (pron. sahy-kee): The human soul, spirit or mind (derived, personification thereof, beloved of Eros, Greek myth).
Masterminding (pron. mstr-mnding) tr. v. - Any bid made by bridge player with which partner disagrees.
"Gentlemen, when the barrage lifts." 9th battalion, King's own Yorkshire light infantry,
2000 years earlier: "morituri te salutant"
"I will be with you, whatever". Blair to Bush, precursor to invasion of Iraq
#7
Posted 2015-January-19, 14:36
1eyedjack, on 2015-January-19, 14:05, said:
tx10s, on 2015-January-19, 12:02, said:
It seems pretty clear that OP, on 9 different occasions, possibly separated by several weeks, looked at his most recent 20 tournaments, then aggregated the data for those 180 tournaments.
#8
Posted 2015-January-19, 14:48
Psyche (pron. sahy-kee): The human soul, spirit or mind (derived, personification thereof, beloved of Eros, Greek myth).
Masterminding (pron. mstr-mnding) tr. v. - Any bid made by bridge player with which partner disagrees.
"Gentlemen, when the barrage lifts." 9th battalion, King's own Yorkshire light infantry,
2000 years earlier: "morituri te salutant"
"I will be with you, whatever". Blair to Bush, precursor to invasion of Iraq
#9
Posted 2015-January-19, 15:58
barmar, on 2015-January-19, 09:11, said:
http://www.bridgebas...__1#entry794169
Even if we didn't insist we're not doing this, why would we WANT to do this? What would BBO gain from players losing finesses more often than real life?
I do not know why it is the way it is, just that it is. My guess is whoever wrote your randomizer dealing program put the bias in and did not tell anyone. That being said, the data is very conclusive that there is bias in your "random" dealing program.
#10
Posted 2015-January-19, 16:01
1eyedjack, on 2015-January-19, 14:05, said:
I could go on, but the reality is that I am probably not the right person to validate your findings (although there will be plenty of readers of this forum who would be capable of doing so, and I hope that one of them steps up to the plate). If your method is sound, it would be a bit of a bombshell.
I have a few hundred tax returns to complete between now and the end of the month, so I will certainly not be looking at any data before then. I have downloaded into pbn all of the hands that you played since 02 Dec 2014, all of which seem to have been in robot tournaments. 354 hands in December and 382 (to date) in January. What I can do with this data I am not quite sure. I might send it to Bob Richardson to see if he has time to play with it.
As for sharing the data, it should be fairly trivial to upload a spreadsheet to dropbox or google drive - certainly no harder than emailing, and that way you open it up to peer review by a load of individuals, not just me.
I looked at all cases of what would be considered standard finesses, like is the K in from or behind the AQ, is the A in front or behind a K, is the Q in from or behind an AKJ, etc. I did not count cases where a Q could be finessed either way, just those cases where the finesse or open ending could only be finesses from one direction.
#11
Posted 2015-January-19, 16:04
1eyedjack, on 2015-January-19, 14:05, said:
I could go on, but the reality is that I am probably not the right person to validate your findings (although there will be plenty of readers of this forum who would be capable of doing so, and I hope that one of them steps up to the plate). If your method is sound, it would be a bit of a bombshell.
I have a few hundred tax returns to complete between now and the end of the month, so I will certainly not be looking at any data before then. I have downloaded into pbn all of the hands that you played since 02 Dec 2014, all of which seem to have been in robot tournaments. 354 hands in December and 382 (to date) in January. What I can do with this data I am not quite sure. I might send it to Bob Richardson to see if he has time to play with it.
As for sharing the data, it should be fairly trivial to upload a spreadsheet to dropbox or google drive - certainly no harder than emailing, and that way you open it up to peer review by a load of individuals, not just me.
BTW, I only looked at Robot hands. I do not play pairs that often, and identifying the best hand and evaluating finesses is even more time consuming for pairs games than the ridiculous amount of time I have spent already.
#12
Posted 2015-January-19, 16:06
Psyche (pron. sahy-kee): The human soul, spirit or mind (derived, personification thereof, beloved of Eros, Greek myth).
Masterminding (pron. mstr-mnding) tr. v. - Any bid made by bridge player with which partner disagrees.
"Gentlemen, when the barrage lifts." 9th battalion, King's own Yorkshire light infantry,
2000 years earlier: "morituri te salutant"
"I will be with you, whatever". Blair to Bush, precursor to invasion of Iraq
#13
Posted 2015-January-19, 16:23
hrothgar, on 2015-January-17, 20:39, said:
1. A sampling methodology for hands yet to be dealt
2. The test of statistical statistical significant you feel to be appropriate
3. What confidence intervals you are using
If you read the post, the sampling was done on hands that were already dealt. The fact that the finesse split ranged between 38.9% and 41% for sets of twenty tournaments averaging 281 finesses/ open endings with an overall average of 40.0% I felt was significant enough
I do not understand question 3 Are you asking my confidence that it is exactly 40%? I make that assumption as writing a bias of 40.2% or 39.8% would be overdoing it, but I can not say that for sure.
#14
Posted 2015-January-19, 16:32
1eyedjack, on 2015-January-19, 16:06, said:
Sadly, my computer programming skills are insufficient to develop an automated method, so the analysis was done by hand. To further clarify my previous explanation, I evaluated finesses irrespective of who the bidder was. (I did keep records by who was declarer, but since that could vary for the same hand, I felt the only reliable statistic was finesses not regarding declarer.) In other words, for example, if there was an AQ in either direction, I credited the finesse to the robot if the K favored the robot and credited the finesse to the player if is favored the player. It is pretty straight forward identifying finesses, so I feel my statistics are reasonable. BTW, the nine sets of 20 tournaments are spaces over the past 4 years.
There seems to be a lot of negative push back from BBO. I have no ax to grind other that hoping the randomizer could become truly random. My concern also has nothing to do with my success rate in the game. I am currently averaging scoring master points over 70% of the time, which actually surprises me as being that high.
#15
Posted 2015-January-20, 10:00
The way this works is that we first deal all the hands normally and calculate each hand's HCP. If South doesn't have the best hand, we simple swap his hand with the one that does. If there's a tie for the best hand among the other seats, we pick one of them at random.
I don't see how this could result in a finesse bias, though.
#16
Posted 2015-January-20, 10:05
#17
Posted 2015-January-20, 11:20
barmar, on 2015-January-20, 10:05, said:
tx10s, on 2015-January-19, 16:01, said:
Psyche (pron. sahy-kee): The human soul, spirit or mind (derived, personification thereof, beloved of Eros, Greek myth).
Masterminding (pron. mstr-mnding) tr. v. - Any bid made by bridge player with which partner disagrees.
"Gentlemen, when the barrage lifts." 9th battalion, King's own Yorkshire light infantry,
2000 years earlier: "morituri te salutant"
"I will be with you, whatever". Blair to Bush, precursor to invasion of Iraq
#19
Posted 2015-January-20, 21:55
On those 105 hands, you had 49 opportunities to finesse for a missing Ace (when you had the K but not the Q of the suit in question). 28 of the 49 Aces were onside.
On those 105 hands, you had 51 opportunities to finesse for a missing King. Sometimes you held AQJ of the suit between the two hands (in which case "onside" meant in front of the Ace) and sometimes you held A in one and Q in the other without the J (in which case "onside" meant in front of the Q. 31 of the 51 missing Kings were onside.
On those 105 hands, you had one-way finesses for missing Queens 36 times, and the missing Queen was onside 13 times.
So, on those 105 hands you had 136 opportunities to finesse for missing A/K/Q (not that you took all those finesses, or even that it was a good idea to do so) and the missing honor was onside 72 times (53%).
#20
Posted 2015-January-20, 22:01