Data Processing Evolved: OpenLineage with Willy Lulciuc

Willy Lulciuc (@wslulciuc) is a pioneer in data engineering and one of the creators of OpenLineage, the open-source framework for data lineage collection and analysis. It enables consistent collection of lineage metadata, giving engineers a better perspective on how data is produced and used, so they can better solve complex problems. Join us to learn about the evolution of data processing, the role of AI, and the future of data engineering.

Subscribe to Contributor on Substack for email notifications!

In this episode we discuss:

• Willy’s journey from WeWork to oleander

• The role of AI in data engineering

• Challenges in data processing and observability

• A vision for the future of data platforms

Links:

• OpenLineage

• oleander

People mentioned:

• Julien Le Dem (@J_)