multidimensional boolean array indexing in numpy

Question

I have a two 2D arrays, one of numbers and one of boolean values:

x = 
array([[ 0.,  0.,  0.,  0.,  0.,  0.,  0.,  0.,  0.,  0.],
       [ 1.,  1.,  1.,  1.,  1.,  1.,  1.,  1.,  1.,  1.],
       [ 2.,  2.,  2.,  2.,  2.,  2.,  2.,  2.,  2.,  2.],
       [ 3.,  3.,  3.,  3.,  3.,  3.,  3.,  3.,  3.,  3.],
       [ 4.,  4.,  4.,  4.,  4.,  4.,  4.,  4.,  4.,  4.],
       [ 5.,  5.,  5.,  5.,  5.,  5.,  5.,  5.,  5.,  5.],
       [ 6.,  6.,  6.,  6.,  6.,  6.,  6.,  6.,  6.,  6.],
       [ 7.,  7.,  7.,  7.,  7.,  7.,  7.,  7.,  7.,  7.],
       [ 8.,  8.,  8.,  8.,  8.,  8.,  8.,  8.,  8.,  8.],
       [ 9.,  9.,  9.,  9.,  9.,  9.,  9.,  9.,  9.,  9.]])

idx = 
array([[False, False, False, False, False, False, False, False, False, False],
       [False,  True,  True,  True,  True,  True, False, False, False, False],
       [False,  True,  True,  True,  True,  True, False, False, False, False],
       [False,  True,  True,  True,  True,  True, False, False, False, False],
       [False, False, False,  True,  True,  True,  True, False, False, False],
       [False, False, False, False,  True,  True,  True, False, False, False],
       [False, False, False, False, False, False,  True, False, False, False],
       [False, False, False, False, False, False, False,  True, False, False],
       [False, False, False, False, False, False, False, False, False, False],
       [False, False, False, False, False, False, False, False, False, False]], dtype=bool)

When I index the array it returns a 1D array:

x[idx]
array([ 1.,  1.,  1.,  1.,  1.,  2.,  2.,  2.,  2.,  2.,  3.,  3.,  3.,
    3.,  3.,  4.,  4.,  4.,  4.,  5.,  5.,  5.,  6.,  7.])

How do I index the array and return a 2D array with the expected output:

x[idx]
array([[ 1.,  1.,  1.,  1.,  1.],
       [ 2.,  2.,  2.,  2.,  2.],
       [ 3.,  3.,  3.,  3.,  3.],
       [ 4.,  4.,  4.,  4.],
       [ 5.,  5.,  5.],
       [ 6.],
       [ 7.]])

tktk · Accepted Answer · 2014-10-09 18:27:48Z

4

Your command returns a 1D array since it's impossible to fulfill without (a) destroying the column structure, which is usually needed. e.g., the 7 in your requested output originally belonged to column 7, and now it's on column 0; and (b) numpy does not, afaik, support high dimensional array with different sizes on the same dimension. What I mean is that numpy can't have an array whose first three rows are of length 5, 4th row of length 4, etc. - all the rows (same dimension) need to have the same length.

I think the best result you could hope for is an array of arrays (and not a 2D array). This is how I would construct it, though there are probably better ways I don't know of:

In [9]: from itertools import izip
In [11]: array([r[ridx] for r, ridx in izip(x, idx) if ridx.sum() > 0])
Out[11]: 
array([array([ 1.,  1.,  1.,  1.,  1.]), array([ 2.,  2.,  2.,  2.,  2.]),
       array([ 3.,  3.,  3.,  3.,  3.]), array([ 4.,  4.,  4.,  4.]),
       array([ 5.,  5.,  5.]), array([ 6.]), array([ 7.])], dtype=object)

edited Oct 9, 2014 at 18:27

answered Oct 9, 2014 at 18:10

tktk

11.8k8 gold badges60 silver badges75 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

asdflkjwqerqwr Over a year ago

Close, but no cigar, I figured it out though.

tktk Over a year ago

@camdenl What you have is an array of lists, not a 2D numpy array, as requested in the question. In any case, I think it's much more readable using array([r[ridx].tolist() for r, ridx in izip(x, idx) if ridx.sum() > 0]) instead of enumerate.

asdflkjwqerqwr Over a year ago

You're right, but I have to have the structure as a 2D numpy array, so I don't think either is the correct solution.

asdflkjwqerqwr Over a year ago

Which I just realized you said isn't possible, so I think either solution presented would be valid depending on the use.

asdflkjwqerqwr · Accepted Answer · 2014-10-09 18:32:48Z

0

EDIT:This creates an array of lists

np.array([val[idx[i]].tolist() for i,val in enumerate(x) if len(val[idx[i]].tolist()) > 0])

array([[1.0, 1.0, 1.0, 1.0, 1.0], 
   [2.0, 2.0, 2.0, 2.0, 2.0],
   [3.0, 3.0, 3.0, 3.0, 3.0], 
   [4.0, 4.0, 4.0, 4.0], 
   [5.0, 5.0, 5.0],
   [6.0], 
   [7.0]], dtype=object)

edited Oct 9, 2014 at 18:32

answered Oct 9, 2014 at 18:17

asdflkjwqerqwr

1,2004 gold badges21 silver badges36 bronze badges

1 Comment

tktk Over a year ago

This is a 1D array of lists, and not a 2D array as requested. So it's not "working", but a workaround.

Collectives™ on Stack Overflow

multidimensional boolean array indexing in numpy

2 Answers 2

4 Comments

1 Comment

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

1 Comment

Linked

Related