The Wayback Machine - https://web.archive.org/web/20220111143722/https://github.com/topics/jax
Skip to content
#

jax

Here are 249 public repositories matching this topic...

transformers
ikergarcia1996
ikergarcia1996 commented Dec 10, 2021

🚀 Feature request

Fast Tokenizer for DeBERTA-V3 and mDeBERTa-V3

Motivation

DeBERTa V3 is an improved version of DeBERTa. With the V3 version, the authors also released a multilingual model "mDeBERTa-base" that outperforms XLM-R-base. However, DeBERTa V3 currently lacks a FastTokenizer implementation which makes it impossible to use with some of the example scripts (They require a Fa

jax
gianlucadetommaso
gianlucadetommaso commented Dec 16, 2021

It would be great if you could add the JAX equivalent of scipy.stats.mode, which is currently unavailable.

A use case may be a ML classification task with ensembles, where multiple models give different predictions, and we are interested in finding the most common one.

As an example, consider predictions to be a two-dimensional DeviceArray of predictions, with
shape = (number of model

fgolemo
fgolemo commented Sep 28, 2021

Dear Brax team,

Since Brax is fully differentiable, I thought it'd be possible to use it like DiffTaichi or GradSim for system identification (e.g. determining the mass of an object from a trajectory and known force) but I couldn't find any example for this.
Do you happen to have any demo or tips for this?

From the top of my head I would do something like this:
Let's say the task is to es

fabianp
fabianp commented Nov 24, 2021

when running the deep learning examples (say) deep_learning/flax_image_classif.py , the GPU utilization is never above 5%, while for the equivalent flax example the GPU utilization is around 90%, and the example runs more than 20x faster.

My guess is that there's a crucial @jax.jit directive missing somewhere.

Improve this page

Add a description, image, and links to the jax topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the jax topic, visit your repo's landing page and select "manage topics."

Learn more