Paulo Valente

Paulo Valente

Elixir enthusiast, Nx maintainer and SWE at TV Labs

Paulo is an Electronics and Computer Engineer with a passion for coding and for music which always sparked an interest in DSP and Machine Learning.

Having worked with Elixir for over 7 years now, being able to contribute to the Machine Learning and Numerical Calculus front of Elixir and the BEAM is a dream come true.

Talk:
Handoff - a new Nx-compatible library for distributed DAGs

This talk presents Handoff, a library that let’s the user represent functions that depend on each other, creating a Directed Acyclic Graph (DAG) that can be executed to obtain results at each node.

We will talk about how Handoff DAGs can specify requirements for each function, such as the cost for a given function, or node allocation requirements when running in a distributed BEAM environment.

In this, we will learn how to specify things like as “run this function in the same node as that one” or “run this function on this node”.

We will see how this is applicable to Nx, Nerves or general data dependecy coordination problems.

Key Takeaways:

  • The audience will learn the basics of how to use the Handoff library.

  • We will briefly discuss how this enables distributed Nx, but the focus is on the Handoff library itself.

Target Audience:

  • Elixir developers in general.

  • This library is suited for anyone that works with complex asynchronous and possibly branched data processing pipelines.