AI Production Secrets – From Failed POC to Live System
I am coming back with my quality writing after long period of pause, my last post was about Federated data in analytics platforms and today I am focusing on the…
How Semantic Metadata Transforms Federated Analytics: An Expert Perspective
Having spent several years as an AI and Data Platform Architect, I’ve noticed that building federated analytics initiatives can feel a lot like organizing a family reunion—you desperately want everyone…
Why Agentic AI Matters: Amazing Innovations for Data Platform Efficiency
Agentic AI is the new focus in the evolving world of AI. Since agentic AI systems are independent agents that can reason, they are quite different compared to traditional AI…
AWS S3 Tables & Apache Iceberg: The Future of Data Storage
Introduction At AWS re:Invent 2024, AWS introduced Amazon S3 Tables, a purpose-built solution for managing tabular data at scale, built on the Apache Iceberg standard. AWS S3 Tables represent a…
AI Data Engineering: As A Data Engineer, You Really Need to Learn AI!
While leading data platform Architecture at Hilti and 10+ years of extensive experience working with data, I’ve witnessed numerous technological shifts in our field. But none have been as transformative…
The Future AI Infrastructure: A Leader’s Perspective
The AI data infrastructure landscape is undergoing a significant transformation. I see six critical areas that will define the future of AI infrastructure As leading AI architecture at Hilti, I…
Advanced Data Strategies for Large Language Models: A Technical Deep Dive
Enhance LLMs with advanced data integration for powerful, context-aware applications! Introduction In the rapidly evolving field of artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools for natural…
Why Your Data Architecture Needs FAIR Principles: A Proven Framework for Success
Why FAIR principles? The amount of data we generate continues to explode at an unprecedented rate. Estimates suggest that in 2023, a staggering 120 zettabytes of data were created, captured,…
Data Ownership and Data Stewardship: Critical Roles in Complex Data Architectures
In modern, decentralized data landscapes, understanding and effectively implementing the concepts of Data Ownership and Data Stewardship are paramount. While these roles are often conflated, they possess distinct responsibilities that…
Managing the Trust -Estimating “Blast Radius” in Data Quality: A Strategic Approach
Data has become the lifeblood of organizations, driving critical business decisions and strategies. However, the utility of these data are fundamentally dependent on its quality. With studies indicating that one-third…
