Pyper

Pyper is a flexible framework for concurrent and parallel data-processing, based on functional programming patterns. Used for ETL Systems, Data Microservices, and Data Collection.

Key features:

• Intuitive API: Easy to learn, easy to think about. Implements clean abstractions to seamlessly unify threaded, multiprocessed, and asynchronous work.
• Functional Paradigm: Python functions are the building blocks of data pipelines. Lets you write clean, reusable code naturally.
• Safety: Hides the heavy lifting of underlying task execution and resource clean-up. No more worrying about race conditions, memory leaks, or thread-level error handling.
• Efficiency: Designed from the ground up for lazy execution, using queues, workers, and generators.
• Pure Python: Lightweight, with zero sub-dependencies.

Pyper provides an elegant abstraction of the execution of each task, allowing you to focus on building out the logical functions of your program.