跳至主要内容
扩音器图标

GitHub Universe on the Road

GitHub Universe is going on the road. Find a stop near you and join the experience.

Better Together: Elasticsearch and the Dremio Lakehouse

七月 16, 2024 | 12:30 - 2:30 上午 (UTC) 协调世界时

准备好开始使用 AI 和最新技术了吗? Microsoft Reactor 提供活动、培训和社区资源,帮助开发人员、企业家和初创公司利用 AI 技术等。 快加入我们吧!

Better Together: Elasticsearch and the Dremio Lakehouse

七月 16, 2024 | 12:30 - 2:30 上午 (UTC) 协调世界时

准备好开始使用 AI 和最新技术了吗? Microsoft Reactor 提供活动、培训和社区资源,帮助开发人员、企业家和初创公司利用 AI 技术等。 快加入我们吧!

返回

Better Together: Elasticsearch and the Dremio Lakehouse

七月 16, 2024 | 12:30 - 2:30 上午 (UTC) 协调世界时

位置: Redmond

地址: Redmond Reactor 3709 157th Ave NE, Redmond, WA 98052

  • 形式:
  • alt##In person亲自 (Redmond)
  • alt##Livestream直播

主题: 新式数据和分析

语言: 英语

Join us on Monday, July 15th, for a Seattle Elastic User Group meetup with Dremio. Alex Merced (Developer Advocate at Dremio) and Justin Castilla (Sr. Developer Advocate at Elastic) will present, followed by networking, light bites, and refreshments.

Agenda:

  • 5:30 pm: Doors open; say hi, grab a seat, and eat some food.
  • 6:00 pm: Better Together: Elasticsearch and the Dremio Lakehouse - Alex Merced (Developer Advocate at Dremio)
  • 6:30 pm: Talk # 2 - details coming soon! - Justin Castilla (Sr. Developer Advocate at Elastic)
  • 7:00-7:30 pm: Networking & refreshments
  • 7:30 pm: Event ends

Talk Abstracts:

Better Together: Elasticsearch and the Dremio Lakehouse - Alex Merced (Developer Advocate at Dremio)

The synergy between Elasticsearch and the Dremio Lakehouse emerges as a transformative approach for analytics. This talk, titled "Better Together: Elasticsearch and the Dremio Lakehouse," delves into the innovative integration of Elasticsearch as a dynamic source within Dremio's platform. By harnessing Elasticsearch's powerful search capabilities alongside Dremio's efficient data lakehouse architecture, organizations can achieve a seamless, high-performance analytics environment.

The integration supports Elasticsearch versions 6.x and 7.x, with Dremio. This collaboration enables users to plan and execute queries efficiently by leveraging Elasticsearch's rich metadata, including dataset discovery and details for enhanced query planning and execution.
Furthermore, Dremio's elastic connector provides a user-friendly perspective of Elasticsearch indices and mappings, simplifying data access and analysis.

Key highlights include exposing data through Elastic aliases, support for synthetic tables via wildcards, and the parallelization of queries to optimize data retrieval speeds.
The talk will cover Dremio's list promotion rules, special handling for geoshape data types, and how it maintains mapping consistency through schema learning and automatic discovery of new fields. Additionally, we will explore the extensive pushdown capabilities that allow for efficient query execution directly in Elasticsearch, reducing data movement and accelerating insights.

This session aims to provide attendees with practical knowledge on configuring and optimizing the Elasticsearch source within Dremio, ensuring a unified and efficient analytical platform. We will also touch on the technical considerations for integrating Elasticsearch with Dremio, including configuration specifics, debugging, logging, and working with Elasticsearch and x-pack.

By the end of the talk, participants will be well-equipped to leverage the combined strengths of Elasticsearch and Dremio, creating a robust foundation for their data lakehouse analytics endeavors.

相关活动

你也可能对以下活动感兴趣。 请务必访问我们的 Reactor 主页 查看所有可用活动。

本页面的部分内容可能是机器翻译或人工智能翻译.