← Volver a NERDflix

Apache Iceberg: An Architectural Look Under the Covers

Protagonista: Alex Merced
Año: 2025
País: España
Género: Misterio
Track: Data Science / Ai
Idioma: Inglés

Data Lakes have been built with a desire to democratize data - to allow more and more people, tools, and applications to make use of data. A key capability needed to achieve it is hiding the complexity of underlying data structures and physical data storage from users. The de-facto standard has been the Hive table format, released by Facebook in 2009 that addresses some of these problems, but falls short at data, user, and application scale. So what is the answer? Apache Iceberg. Apache Iceberg table format is now in use and contributed to by many leading tech companies like Netflix, Apple, Airbnb, LinkedIn, Dremio, Expedia, and AWS. Watch Alex Merced, Developer Advocate at Dremio, for this webinar to learn the architectural details of why the Hive table format falls short and why the Iceberg table format resolves them, as well as the benefits that stem from Iceberg’s approach. You will learn: The issues that arise when using the Hive table format at scale, and why we need a new table format How a straightforward, elegant change in table format structure has enormous positive effects The underlying architecture of an Apache Iceberg table, how a query against an Iceberg table works, and how the table’s underlying structure changes as CRUD operations are done on it The resulting benefits of this architectural design

data-science-ai

Apache Iceberg: An Architectural Look Under the Covers

Sobre Alex Merced

Alex Merced

Co-Author of O'Reilly's "Apache Iceberg: The Definitive Guide"

Alex Merced is Head of DevRel for Dremio and co-author of "Apache Iceberg: The definitive guide" from O'reilly and has worked as a developer and instructor for companies like GenEd Systems, Crossfield Digital, CampusGuard and General Assembly. Alex is passionate about technology and has put out tech content on outlets such as blogs, videos and his podcasts Datanation and Web Dev 101. Alex Merced has contributed a variety of libraries in the Javascript & Python worlds including SencilloDB, CoquitoJS, dremio-simple-query and more.

𝕏 Twitter LinkedIn