BBO Discussion Forums: GIB vs Ben vs Humans: Latest Robot Performance Stats - BBO Discussion Forums

Jump to content

  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic

GIB vs Ben vs Humans: Latest Robot Performance Stats Robot Rankings Hub

#21 User is offline   lorserker 

  • PipPipPipPip
  • Group: Full Members
  • Posts: 113
  • Joined: 2007-November-26

Posted 2024-November-23, 03:39

View Posthrothgar, on 2024-November-22, 09:29, said:

Thanks very much for posting how well GIB / Ben do in the various events

If possible, it would be interesting to see the Standard Deviation in addition to the means.

To me, the most interesting result is how much worse GIB does in the Zenith daylong than any other event...

Are the conditions of contest significantly different?


Zenith has 120 instances.
If we look at how the 120 MP-percentages of the instances are distributed, the standard deviation is about 7.
The score of an instance could be anywhere between 40% and 70%, but is mostly in the low 50s. And the distribution is a bit skewed towards higher scores.

The reason why GIB is a bit weaker on Zenith is because GIB's strength is declarer play and GIB's weakness is bidding, especially competitive bidding.
In Zenith there is less declaring and more competitive bidding (because the boards are random, not best hand) and this disadvantages GIB.

In my opinion, when users get an impression of how robots play, subjectively declarer play doesn't count as much. Because in a typical best hand tournament the robot rarely declares.
What the user is most exposed to is bidding with the robot, and some defense. With bidding being the weak spot (very much for BasicGIB), the impression is that the robot is much worse than it is.
2

#22 User is offline   barmar 

  • PipPipPipPipPipPipPipPipPipPipPipPip
  • Group: Admin
  • Posts: 21,628
  • Joined: 2004-August-21
  • Gender:Male

Posted 2025-January-15, 14:27

While GIB may have some flaws in its logic, where it excels compared to humans is in its memory. How many times have you gotten a poor result because you (or partner) didn't notice someone show out in a suit, couldn't remember which spot cards were played, or forgot something from the auction? Computers never make these kinds of silly mistakes.

I think I've even read examples of such mistakes in high-level tournament reports, although they're obviously very rare among champions. But they're not infrequent among average players.

Just getting these basics right all the time gives the robots a significant edge.

#23 User is offline   benellis58 

  • Pip
  • Group: Members
  • Posts: 7
  • Joined: 2022-July-07

Posted 2025-January-18, 21:42

GIB doesn't revoke, doesn't lead out of turn, and doesn't forget cards. Those are its good points. Everything else is wretched. Its system is pathetic, its leads are horrible, its logic is non-existent, its defence is disgustingly bad, and even its declarer play isn't very good. Furthermore, most of its definitions are poorly written, often illogical, often incorrect, and often ridiculously inconsistent. GIB should have been replaced or at least improved long ago. The ineptitude of the GIB robots removes a huge amount of pleasure that BBO otherwise provides.
1

#24 User is offline   mycroft 

  • Secretary Bird
  • PipPipPipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 7,560
  • Joined: 2003-July-12
  • Gender:Male
  • Location:Calgary, D18; Chapala, D16

Posted Yesterday, 12:21

Again, then why, when GIB plays with GIB in a club field, do they regularly come third or fourth with a 54% game (even playing against people whose system they can't understand)?

I treat GIB as I do the games I play (have to play?) as fill-in director with life Cs who know how they play bridge, do not want to learn anything (*), and will not read my signals anyway. At least some of which, frankly, you are going to get with any pickup partner, even ones much better than you. My job is to make their life as easy as possible, playing their way as much as I can so they can play their best so I can get the best score possible(**).

I actually hate GIB on defence. If there's ever a situation where "I'm good unless they find the switch", if GIB's on lead, I'm going down at least twice as often as if it's a human. Sure and I intensely dislike defending with GIB, too, but still.

If you don't like robot games, Don't Play Them™.

Oh, and if you're upset with no advancement, go to the BEN page and sign up. Maybe that's better for you!

I don't like the Permanent Pickup Pool on BBO because it is concentrated with players nobody would voluntarily partner (due to skill, inflexibility, attitude, ethics, ...) because the ones who can, get regular partners and get out of there. So I don't play pickup on BBO (unless the partner is vouched by someone I do know).

I try not to play against pickups on BBO, either, because I so rarely play the One True Bidding System, and not playing OTBS annoys pickups no end, so the average lifespan of a partnership is 3-4 hands.

That does limit my use of the product (as does the fact that one of my regular partners hates playing online). I don't gripe about it, because it is a great solution for many many people who *don't have my issues* with that; and they help support the parts of BBO that I like.

(*) You don't want to try teaching them anything, not during that pickup game, either. All that will happen is that they think so hard on that thing they don't understand that the rest of their bridge game will go downhill. I'm talking about the weeks and weeks before where others are pointing out the holes and they wall up.
(**)I know, wrong order. Edits. Why do I seem to be channelling Simon so much this week? Third time? Fourth? If you don't know how to play with Mrs. Guggenheim, you don't know how to play with (or against) GIB.
When I go to sea, don't fear for me, Fear For The Storm -- Birdie and the Swansong (tSCoSI)
0

#25 User is online   pescetom 

  • PipPipPipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 8,178
  • Joined: 2014-February-18
  • Gender:Male
  • Location:Italy

Posted Yesterday, 16:19

View Postmycroft, on 2025-January-19, 12:21, said:

Again, then why, when GIB plays with GIB in a club field, do they regularly come third or fourth with a 54% game (even playing against people whose system they can't understand)?


Yet again, I dispute this claim in a club field where the dominant system is even moderately different from GIB's system.
My experience in a (not very strong) club field playing mainly Italian variants of 2/1 is that GIB-GIB initially scored 58% but then slid down to 45% or slightly less.
Some of that difference is due to GIB grossly misunderstanding 2 Multi, but only about a quarter of our pairs played that.
Perhaps more is that the players did not understand the often misleading explanations offered.
I am curious to know what would happen in a club in Poland :)
0

  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic

2 User(s) are reading this topic
0 members, 2 guests, 0 anonymous users