ClickHouse

ClickHouse Cloud: Now in public beta on Microsoft #Azure! Read the blog to get more information, or sign-up today to try it out. https://lnkd.in/eGkWSZfG

ClickHouse 24.9 was released last week, and we have some fun features for you to play with. 🛠️ First up is APPEND support for refreshable materialized views. When configured, the materialized view’s query will append results to the end of the destination table rather than replacing everything. This is useful if you want to capture snapshots of data from other tables or poll data from an external API and store it in ClickHouse. This release also made response headers available when using the url table function, automatic inference of the Variant data type, and aggregate functions to query the new JSON data type. Enjoy! 😎 https://lnkd.in/eWR75Dra

We're #hiring a new Field Marketing Manager - EMEA in United Kingdom. Apply today or share this post with your network.

My favourite quip of the day was from Tanya Bragin talking about ClickHouse database performance returning query results so fast it makes you wonder if something is broken. I can empathise with the speed being unsettling. It was a wholesome day of learning from great speakers including Joe Reis and Chip Huyen. This was a really informative conference by (and for) leading data practitioners. One to diarise next year for fellow data engineers.

Rain lets up in beautiful Auckland, New Zealand ☀️ just in time for the last stop of the DataEngBytes tour! Can't wait for my keynote tomorrow about open alternatives to data warehouses - register here: https://lnkd.in/gXSYmStM

💫 One week to go! Mark your calendars for Tyler Hannan's keynote at Big Data & AI World Asia 2024: 📅 Thursday, October 10 ⏰ 10:50 AM 📍 Keynote Theatre @ Marina Bay Sands Convention Centre 👉🏼 https://lnkd.in/ex6ruPBU @bdwasia

DoubleCloud is winding down, and we know migrating your production workloads before a rapidly approaching cut-off date is challenging. We’re here to help -- Contact us today for free migration services, plus additional trial credits for qualified migrations. 👇

Apache Arrow has become the de facto standard for high-volume data transfer. But did you know that ClickHouse can stream results in Arrow over HTTP! This makes it simple to integrate with high-performance visualization libraries like Perspective to stream real-time data. Using Apache Arrow, our latest demo efficiently transmits data from ClickHouse directly to the browser, delivering smooth visualizations in just 100 lines of code! 📊🚀 - ⚡ Arrow for efficiency: Apache Arrow minimizes the data transferred and enables smooth data streams from ClickHouse to Perspective. - ⏱️ Real-time streaming: Forex data streamed into a browser is updated every 30-50ms, showcasing ClickHouse's capability to serve hundreds of queries per second. We can even stream the entire 60GB dataset in minutes to the browser! - 🔄 Seamless integration: Built with performance in mind, Perspective handles millions of data points in the browser with real-time pivoting, filtering, and transformations. Curious? Check out the full blog to explore more or just play with the demo. https://lnkd.in/e8E_y4vS

Who is one of the world's leading blockchain analytics platforms? Nansen And what is at the center of their data Infrastructure? ClickHouse Check out the article to learn more about their migration, implementation, and plans for the future. https://lnkd.in/dXGNS9Wv

The Lens Protocol decentralized social network recently migrated from Rockset to ClickHouse Cloud. It was a significant upgrade, and our latest post explores the story of the migration, including: 🤷♂️ Why the news of OpenAI acquiring Rockset wasn’t a major blow to the team: They’d already been struggling with Rockset and were looking for a better alternative. ⚡ Overcoming Rockset’s limitations: Data ingestion latency and limited query concurrency were significant issues with Rockset that the Lens Protocol team needed to solve. 🔄 Using PeerDB for CDC: They quickly set up a proof of concept, using PeerDB to stream updates between Postgres and ClickHouse. It only took a day or two to get everything up and running. 💥 Super-fast data ingestion: The transition to ClickHouse Cloud has enabled near-instantaneous data processing. Ingestion that used to take 24 hours with Rockset now takes 1-2 hours with PeerDB and ClickHouse. 🚀 Scaling ML operations: ClickHouse handles a high volume of concurrent queries with performance degradation, which has allowed the Lens Protocol team to scale their machine learning operations. Read more in the blog post! https://lnkd.in/eWMH9_xy