Databricks
With larger volume and more real-time data stored in data lake, it becomes more complex to manage these data and serve analytics and applications. With different service interfaces, data caliber, performance bias on different scenarios, the business users begin to suffer low confidence on quality and efficiency to get insight from data.
Based on Apache Kylin, Apache Spark and other technology, Dong Li will introduce a cloud-native architecture, building unified semantic layer over data lake, to simplify data management and analytics over data lake. With data virtualization, single data-as-a-service API is provided to unify different sources and connect data silos. With unified semantic layer, data relations, lifecycle and logics are centrally managed to provide single source of truth for multiple applications. With cloud-native infrastructure, resources are allocated elastically to save TCO, and performance is boosted with enhanced distributed cache above separated computation and storage.
In this topic, Dong Li will outline the architecture and deep dive the techniques, and also real cases in top global bank in Europe who switched from traditional data warehouse options.
About:
Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform
See all the previous Summit sessions: https://databricks.com/sparkaisummit/north-america/sessions
Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks/
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner