Python list transpose and fill [duplicate]

Question

I have a list of lists such that the length of each inner list is either 1 or n (assume n > 1).

>>> uneven = [[1], [47, 17, 2, 3], [3], [12, 5, 75, 33]]

I want to transpose the list, but instead of truncating the longer list (as with zip) or filling the shorter lists with None, I want to fill the shorter lists with their own singular value. In other words, I'd like to get:

>>> [(1, 47, 3, 12), (1, 17, 3, 5), (1, 2, 3, 75), (1, 3, 3, 33)]

I can do this with a couple of iterations:

>>> maxlist = len(max(*uneven, key=len))
>>> maxlist
4
>>> from itertools import repeat
>>> uneven2 = [x if len(x) == maxlist else repeat(x[0], maxlist) for x in uneven]
>>> uneven2
[[1, 1, 1, 1], [47, 17, 2, 3], [3, 3, 3, 3], [12, 5, 75, 33]]
>>> zip(*uneven2)
[(1, 47, 3, 12), (1, 17, 3, 5), (1, 2, 3, 75), (1, 3, 3, 33)]

But is there a better approach? Do I really need to know maxlist in advance to accomplish this?

You could simulate itertools.izip_longest, just using the last value of the sequence instead of a fillvalue when the sequence is exhausted. — Chris Morgan
– Chris Morgan, Commented May 16, 2012 at 0:24
@ChrisMorgan is right have saw this link docs.python.org/library/itertools.html maybe you could also use some other functions from there. — Christopher Pelayo
– Christopher Pelayo, Commented May 16, 2012 at 0:35

HYRY · Accepted Answer · 2012-05-16 00:29:08Z

7

You can repeat one element list forever:

uneven = [[1], [47, 17, 2, 3], [3], [12, 5, 75, 33]]

from itertools import repeat

print zip(*(repeat(*x) if len(x)==1 else x for x in uneven))

answered May 16, 2012 at 0:29

HYRY

97.8k28 gold badges197 silver badges192 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

kojiro Over a year ago

This was very helpful because the n=1 inner lists were manufactured. Now I've refactored so the list is [repeat(1), [47, 17, 2, 3], repeat(3), [12, 5, 75, 33]] and I can just do zip(*uneven).

srgerg · Accepted Answer · 2012-05-16 00:30:14Z

4

You could use itertools.cycle() instead:

>>> from itertools import cycle
>>> uneven3 = [x if len(x) != 1 else cycle(x) for x in uneven]
>>> zip(*uneven3)
[(1, 47, 3, 12), (1, 17, 3, 5), (1, 2, 3, 75), (1, 3, 3, 33)]

That means you don't need to know maxlist ahead of time.

answered May 16, 2012 at 0:30

srgerg

19.4k4 gold badges59 silver badges40 bronze badges

Comments

kojiro · Accepted Answer · 2012-06-25 12:29:52Z

I really liked @chris-morgan's idea of simulating itertools.izip_longest, so when I finally had the inspiration, I wrote an izip_cycle function.

def izip_cycle(*iterables, **kwargs):
    """Make an iterator that aggregates elements from each of the iterables.
    If the iterables are of uneven length, missing values are filled-in by cycling the shorter iterables.
    If an iterable is empty, missing values are fillvalue or None if not specified.
    Iteration continues until the longest iterable is exhausted.
    """
    fillvalue = kwargs.get('fillvalue')
    counter = [len(iterables)]
    def cyclemost(iterable):
        """Cycle the given iterable like itertools.cycle, unless the counter has run out."""
        itb = iter(iterable)
        saved = []
        try:
            while True:
                element = itb.next()
                yield element
                saved.append(element)
        except StopIteration:
            counter[0] -= 1
            if counter[0] > 0:
                saved = saved or [fillvalue]
                while saved:
                    for element in saved:
                        yield element
    iterators = [cyclemost(iterable) for iterable in iterables]
    while iterators:
        yield tuple([next(iterator) for iterator in iterators])

print list(izip_cycle([], range(3), range(6), fillvalue='@'))

Collectives™ on Stack Overflow

Python list transpose and fill [duplicate]

3 Answers 3

1 Comment

Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

Comments

Linked

Related