Whereas Iceberg solves this downside, open requirements are wanted in different areas as effectively. We’re now seeing a brand new battlefield rising within the space of knowledge catalogs, which play a essential function in a multi-engine structure. Catalogs make operations on tables dependable by supporting atomic transactions. Because of this knowledge engineers and the pipelines they construct can modify tables concurrently, and queries on these tables produce correct outcomes. To perform this, all Iceberg-table learn and write operations, even from completely different engines, are routed by means of a catalog.
SaaS suppliers and hyperscalers can use the catalog as a approach to create buyer stickiness, however enterprises are getting clever to this. They perceive that, simply as Iceberg gives a standard format for tables, an open catalog normal will allow them to select the perfect instrument for the job and maximize the worth of their knowledge.
Open requirements are good for enterprise, good for purchasers, and good for the broader ecosystem. Enterprises have advanced knowledge architectures, and open requirements enable them to make use of knowledge throughout these platforms with out incurring further price and governance challenges. Open requirements additionally promote innovation, as a result of they power firms to compete on an implementation and permit prospects to decide on between them.
