Introduction At AWS re:Invent 2024, AWS introduced Amazon S3 Tables, a purpose-built solution for managing tabular data at scale, built on the Apache Iceberg standard. AWS S3 Tables represent a…
While leading data platform Architecture at Hilti and 10+ years of extensive experience working with data, I’ve witnessed numerous technological shifts in our field. But none have been as transformative…
Introduction While some industry voices suggest that data teams are predisposed to failure, this perspective overlooks a crucial reality: many teams simply lack proper setup and leadership guidance from the…
The AI data infrastructure landscape is undergoing a significant transformation. I see six critical areas that will define the future of AI infrastructure As leading AI architecture at Hilti, I…
KPIs for Data Platforms: Maintaining Data Quality, Monitoring, Observability, FinOps, and GreenOps A robust data engineering platform is crucial for organizations to leverage the power of their data. This platform…