Tags: azat/chdig
Tags
Fix slow/last queries view (disable analyzer as a workaround for now)
The problem:
azat.local$ select ProfileEvents.Names from system.query_log
SELECT ProfileEvents.Names
FROM system.query_log
Query id: 6036f039-3b9b-4cd3-a853-b6d5d24bf92b
Elapsed: 0.006 sec.
Received exception from server (version 24.10.1):
Code: 44. DB::Exception: Received from localhost:9000. DB::Exception: Invalid column type for ColumnUnique::insertRangeFrom. Expected String, got LowCardinality(String). (ILLEGAL_COLUMN)
Will be fixed separately.
v24.3.1: global time intervals, faster and better logs view, faster s… …ummary and others Highlights ========== - Global time intervals (for logs, trace logs) - #42, #44 - Instructions for brew package - Significantly improve logs view - previously it renders everything in one line (ignoring new lines), now it respect new lines and also has a wrap mode to wrap long lines into terminal width (optional, use --wrap for this) - Add g/G bindings for log view Performance Highlights ====================== - Make queries to obtain information for finished queries faster - Speedup query to obtain summary information (do not query system.parts) - Significantly improve performance of logs view - yes, it is not less(1), but is way more better, at least now it is possible to render 1'000'000 rows, thought it requires too much memory - 1GiB, so be aware
v24.1.1: rustls, clippy, time navigation, backward compatibility, sco… …op package Highlights ========== - rustls - remove extra dependency (libssl/libcrypto) - Time navigation in last/slow queries (C-T/C-t for 10 min seek) - Advanced time navigation, that prompts for number of minutes (M-T/M-t, by @Dolso) - Massive ClickHouse backward compatibility - remove WINDOW functions, PSQL CAST operator (::), and other workarounds and now it works on 21.2+ at least - scoop package - Support skip_verify option (by @chhetripradeep) Bug Fixes ========= - Fix filters for last/slow query logs (by @Dolso) Internal ======== - fix clippy warnings and add it into CI (along with other linters) - fix "flexi_logger has to work with UTC rather than with local time, caused by IndeterminateOffset" warning - Finally CalVer over SemVer (SemVer is almost useless for chdig)
v0.5.0: flameshow, single binary, pipelines, editor, aur New features ============ - Use flameshow instead of tfg (more modern and feature reach) - Use pyoxidizer instead of pyinstaller - Single static binary (embed flameshow into the chdig) - Add ability to edit (spawns editor) and execute query - Add ability to open EXPLAIN PIPELINE in web browser Improvements ============ - Improve disk/network summary statistics - Proper metric deltas (by taking into account update interval) - Also search through query_id/query Fixes ===== - Fix updating summary view after view changes - Do not limit queries only SELECTs for last/slow view Other ===== - Also now there are multiple aur packages: - https://aur.archlinux.org/packages/chdig-latest-bin - https://aur.archlinux.org/packages/chdig-git - https://aur.archlinux.org/packages/chdig-bin And I hope that there will be macos packages available in the nearest time!
v0.4.0: multi-selection, static binary, better focus, pause/refresh, … …EXPLAIN SYNTAX New features ============ - Per-screen scroll (previously PgDown works as scroll 5 entries down, which was annoying and very inconvenient) - Autocompletion for bash - Add ability to pause updates - useful to concentrate on concrete thing - Add ability to proactively refresh view - Add EXPLAIN SYNTAX action (and print all changed SETTINGS in the EXPLAIN SYNTAX, useful to copy query with all the settings and paste into the client) - Add multi selection (and various actions, like looking logs and flamegraphs supports showing them for multiple queries) - Fully static binaries (requires switching from ncurses to termios) - package for aur archlinux registry Improvements ============ - Add thread_id into logs (useful to understand how many threads involved) - Support clickhouse-client configs in YAML - Show full error trace on Enter in system.errors - Better color scheme for summary bar, and so now that if you see something *red*, this is likely requires some attention - Add replicated fetches/queue into summary bar - Add system.dictionaries support - Improve how focus works (before chdig always tries to select the first query by defualt, which was not that convenient, since sometimes you want to look at the top CPU usage, so now if you do not select anything chdig will show queries sorted, but switch to following query once you select something, and you can get back using Home key) Fixes ===== - Fix chdig with non default user/password in config.xml/env vars - Do not omit queries without initial query with grouping
v0.3.0: filter queries, search in query logs, utilization columns, pe… …rformance New features: ============= - Filter queries (by client_hostname/os_user/user/initial_user/client_name) (/) - Search in query logs (/) - View traces in speedscope (more enhanced UI) - Support connections_credentials from clickhouse-client config.xml - Separate column for uncompressed reads - IO - Add CPU utilizations columns - Handle CLICKHOUSE_USER/CLICKHOUSE_PASSWORD env variables - Add support for EXPLAIN PLAN indexes=1 Performance improvements: ========================= - Speedup queries for extracting logs/processors_profile_log/... significantly (by adding proper filters for event_date/event_time) - Speedup queries for obtaining queries (slow and last) ~10x - Fix performance of chdig in a slow networks by enabling compression ~10x Fixes: ====== - Handle query errors gracefully - Fix EXPLAIN for non qualified table names (i.e. when database was missing) - Fix triggering actions from fuzzy search (C-p)
v0.2.0 Lots of views: - Query view (`system.processes`) - Slow query log (`system.query_log`) - Last queries (`system.query_log`) - Processors (`system.processors_profile_log`) - Views (`system.query_views_log`) - Merges view (`system.merges`) - Mutations view (`system.mutations`) - Replicas (`system.replicas`) - Replication queue view (`system.replication_queue`) - Fetches (`system.replicated_fetches`) - Backups (`system.backups`) - Errors (`system.errors`) UI rework, I don't even remember what was in the v0.01 version (BTW the tag was wrong), at first I used menubar, but it does not allow to use shortcuts correctly, so I've switched to select from the left (like in csysdig) + header with all possible global shortcuts. Plus now shortcuts are generated automatically from one place, instead of being duplicated 3 times before.
PreviousNext