Issues · google/BIG-bench

google / BIG-bench Public

Notifications
Fork 294
Star 532

Code
Issues 23
Pull requests 11
Actions
Projects
Security
Insights

Code
Issues
Pull requests
Actions
Projects
Security
Insights

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

23 Open 53 Closed

Author

Filter by author

Label

Filter by label

Use alt + click/return to exclude labels

or ⇧ + click/return for logical OR

Projects

Filter by project

Milestones

Filter by milestone

Assignee

Filter by who’s assigned

Sort

Sort by

Newest Oldest Most commented Least commented Recently updated Least recently updated

Most reactions

[suggestion] Confidence interval for random baseline

#777 opened Apr 15, 2022 by Randl

interpretability difficulties for list_functions task

#770 opened Apr 14, 2022 by joshrule

Recomputing results on Context Definition Alignment Task

#767 opened Apr 12, 2022 by lksenel

[suggestion] Analysis of bias-related tasks

#762 opened Apr 9, 2022 by Randl

Human evaluation on arc?

#761 opened Apr 8, 2022 by Randl

[suggestion] Analysis of task "hardness" vs. "solvability"

#739 opened Apr 4, 2022 by Randl

Preferred metric should be defined per subtask

#737 opened Apr 4, 2022 by Randl

[Paper] Increase figure font sizes, change colors

#736 opened Apr 4, 2022 by Randl

Human evaluation: Details unclear

#728 opened Mar 30, 2022 by niklasdeckers

[Paper] Papers to cite draft edit submission

PR proposing an edit to the BIG-bench paper

#713 opened Mar 24, 2022 by StellaAthena

[suggestion] Add a list of papers with evaluation results draft edit submission

PR proposing an edit to the BIG-bench paper

#671 opened Dec 11, 2021 by RomanPlusPlus

Other big LM authors personal invitation draft edit submission

PR proposing an edit to the BIG-bench paper

#619 opened Nov 20, 2021 by Randl

movie_dialog_same_or_different has inaccuracies

#563 opened Oct 7, 2021 by ramasesh

Difficulty Adding New HF Models

#551 opened Sep 14, 2021 by StellaAthena

Incorrect BLEU score calculation for human model

#462 opened Jun 21, 2021 by guygurari

A suggestion to add "human-baseline-not-applicable" keyword for some tasks

#290 opened May 18, 2021 by RomanPlusPlus