beam

The problem

The current implementation of processElement

1. Check if cache existence for input
2. If the cache returns value return it
3. otherwise, aquire a semaphore
4. call asyncLookup and pass it input. It return a future: F
5. Maintain a list of the currently executing futures
6. release a semaphore at the end each future execution
7. make sure all the future are com

In v0.9.0 we started offering --keep_intermediate_avro_files. Avro files are a great candidate for long term storage of variant data for several reasons, mainly because they can be loaded into BigQuery fast and free.

The only missing data is information in VCF header. Storing them with AVRO files will enable us to recov

We need to add a communications section to the community page. This second would consist of sub-sections such as (but not limited to) :

• slacks
• irc
• mailing lists
• forums

Any other ideas?