Skip to content

PERF: improves performance in remove_unused_categories #11643

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

PERF: improves performance in remove_unused_categories #11643

wants to merge 1 commit into from

Conversation

@behzadnouri
Copy link
Contributor

on master:

In [1]: np.random.seed(2718281)

In [2]: n = 1 << 20

In [3]: ix = tm.makeCategoricalIndex(n, n // 10)

In [4]: %timeit ix.remove_unused_categories()
1 loops, best of 3: 527 ms per loop

on branch:

In [4]: %timeit ix.remove_unused_categories()
1 loops, best of 3: 216 ms per loop
@jreback jreback added Performance Memory or execution speed performance Categorical Categorical Data Type labels Nov 19, 2015
@jreback jreback added this to the 0.17.1 milestone Nov 19, 2015
@jreback
Copy link
Contributor

jreback commented Nov 19, 2015

merged via 7031e5f

thanks you sir!
@jreback jreback closed this Nov 19, 2015
@behzadnouri behzadnouri deleted the cat-rm-unused branch November 21, 2015 21:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Categorical Categorical Data Type Performance Memory or execution speed performance

2 participants

@behzadnouri @jreback