Open Source in Israel (10 min.)

#spark
#Infrastructure
October 16, 201715:10

Elior Malul

A framework for composing displaying testing and debuggining complex Spark computation flows.

Graph computation framework for SPARK

A python framework that provides the ability to compose computation data flows as DAG. This modular DAG representation currently enables (but not restricted to) reuse for computation logics, visualization of the computation graph and unit testing for specific computation nodes in a potentially complex computation flow.

The package also enables users to add more DAG operation on the top of the ones mentioned above (e.g., a light-weight process for dynamic type-check of the data going in and out of computation nodes). The package is open-sourced, and may be found at https://github.com/yodasco/computation_dag.

Reversim

About Reversim

Reversim (רברס עם פלטפורמה) is a Hebrew podcast by Ori Lahav and Ran Tavory which brings together software developers and product, with over 300 recorded episodes and a few thousands listeners.

The summit is our intention to create a conference for developers by developers. Like in the podcast, we bring you the content we are interested in, and we hope you will be too.

All Rights Reserved © 2017