Randomly MYSQL consumes the whole memory and stops. #552
Description
Below are logs that I generated through MySQLTuner-Perl:
-------- Log file Recommendations ------------------------------------------------------------------
[OK] Log file /opt/bitnami/mysql/logs/mysqld.log exists
[--] Log file: /opt/bitnami/mysql/logs/mysqld.log(20K)
[OK] Log file /opt/bitnami/mysql/logs/mysqld.log is not empty
[OK] Log file /opt/bitnami/mysql/logs/mysqld.log is smaller than 32 Mb
[OK] Log file /opt/bitnami/mysql/logs/mysqld.log is readable.
[!!] /opt/bitnami/mysql/logs/mysqld.log contains 41 warning(s).
[!!] /opt/bitnami/mysql/logs/mysqld.log contains 1 error(s).
[--] 21 start(s) detected in /opt/bitnami/mysql/logs/mysqld.log
[--] 1) 2021-04-28T06:12:52.342664Z 0 [System] [MY-010931] [Server] /opt/bitnami/mysql/bin/mysqld: ready for connections. Version: '8.0.23' socket: '/opt/bitnami/mysql/tmp/mysql.sock' port: 3306 Source distribution.
[--] 2) 2021-04-28T06:12:52.219074Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /tmp/mysqlx.sock
[--] 3) 2021-04-27T18:34:56.915742Z 0 [System] [MY-010931] [Server] /opt/bitnami/mysql/bin/mysqld: ready for connections. Version: '8.0.23' socket: '/opt/bitnami/mysql/tmp/mysql.sock' port: 3306 Source distribution.
[--] 4) 2021-04-27T18:34:56.786159Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /tmp/mysqlx.sock
[--] 5) 2021-04-27T10:22:00.897144Z 0 [System] [MY-010931] [Server] /opt/bitnami/mysql/bin/mysqld: ready for connections. Version: '8.0.23' socket: '/opt/bitnami/mysql/tmp/mysql.sock' port: 3306 Source distribution.
[--] 6) 2021-04-27T10:22:00.757394Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /tmp/mysqlx.sock
[--] 7) 2021-04-26T17:14:54.012867Z 0 [System] [MY-010931] [Server] /opt/bitnami/mysql/bin/mysqld: ready for connections. Version: '8.0.23' socket: '/opt/bitnami/mysql/tmp/mysql.sock' port: 3306 Source distribution.
[--] 8) 2021-04-26T17:14:53.563767Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /tmp/mysqlx.sock
[--] 9) 2021-04-24T17:48:37.971635Z 0 [System] [MY-010931] [Server] /opt/bitnami/mysql/bin/mysqld: ready for connections. Version: '8.0.23' socket: '/opt/bitnami/mysql/tmp/mysql.sock' port: 3306 Source distribution.
[--] 10) 2021-04-24T17:48:37.204921Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /tmp/mysqlx.sock
[--] 5 shutdown(s) detected in /opt/bitnami/mysql/logs/mysqld.log
[--] 1) 2021-04-28T06:11:33.005013Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld: Shutdown complete (mysqld 8.0.23) Source distribution.
[--] 2) 2021-04-24T11:00:29.094483Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld: Shutdown complete (mysqld 8.0.23) Source distribution.
[--] 3) 2021-04-24T10:54:13.574344Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld: Shutdown complete (mysqld 8.0.23) Source distribution.
[--] 4) 2021-04-24T09:31:03.209520Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld: Shutdown complete (mysqld 8.0.23) Source distribution.
[--] 5) 2021-04-24T09:30:46.552791Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld: Shutdown complete (mysqld 8.0.23) Source distribution.
-------- Storage Engine Statistics -----------------------------------------------------------------
[--] Status: +ARCHIVE +BLACKHOLE +CSV -FEDERATED +InnoDB +MEMORY +MRG_MYISAM +MyISAM +PERFORMANCE_SCHEMA
[--] Data in InnoDB tables: 2.8M (Tables: 61)
[OK] Total fragmented tables: 0
-------- Analysis Performance Metrics --------------------------------------------------------------
[--] innodb_stats_on_metadata: OFF
[OK] No stat updates during querying INFORMATION_SCHEMA.
-------- Security Recommendations ------------------------------------------------------------------
[--] Skipped due to unsupported feature for MySQL 8
-------- CVE Security Recommendations --------------------------------------------------------------
[--] Skipped due to --cvefile option undefined
-------- Performance Metrics -----------------------------------------------------------------------
[--] Up for: 2h 9m 34s (317K q [40.792 qps], 641 conn, TX: 588M, RX: 53M)
[--] Reads / Writes: 99% / 1%
[--] Binary logging is enabled (GTID MODE: OFF)
[--] Physical Memory : 3.9G
[--] Max MySQL memory : 2.8G
[--] Other process memory: 0B
[--] Total buffers: 296.0M global + 17.1M per thread (151 max threads)
[--] P_S Max memory usage: 72B
[--] Galera GCache Max memory usage: 0B
[OK] Maximum reached memory usage: 416.0M (10.54% of installed RAM)
[OK] Maximum possible memory usage: 2.8G (73.10% of installed RAM)
[OK] Overall possible memory usage with other process is compatible with memory available
[OK] Slow queries: 0% (0/317K)
[OK] Highest usage of available connections: 4% (7/151)
[OK] Aborted connections: 0.62% (4/641)
[--] Query cache have been removed in MySQL 8
[OK] Sorts requiring temporary tables: 0% (0 temp sorts / 45K sorts)
[!!] Joins performed without indexes: 27
[OK] Temporary tables created on disk: 0% (0 on disk / 29 total)
[OK] Thread cache hit rate: 98% (7 created / 641 connections)
[OK] Table cache hit rate: 93% (1K open / 1K opened)
[OK] table_definition_cache(2000) is upper than number of tables(384)
[OK] Open file limit used: 0% (6/65K)
[OK] Table locks acquired immediately: 100% (12 immediate / 12 locks)
[OK] Binlog cache memory access: 100.00% (450 Memory / 450 Total)
-------- Performance schema ------------------------------------------------------------------------
[--] Memory used by P_S: 72B
[--] Sys schema is installed.
-------- ThreadPool Metrics ------------------------------------------------------------------------
[--] ThreadPool stat is disabled.
-------- MyISAM Metrics ----------------------------------------------------------------------------
[--] MyISAM Metrics are disabled on last MySQL versions.
-------- InnoDB Metrics ----------------------------------------------------------------------------
[--] InnoDB is enabled.
[--] InnoDB Thread Concurrency: 0
[OK] InnoDB File per table is activated
[OK] InnoDB buffer pool / data size: 256.0M/2.8M
[!!] Ratio InnoDB log file size / InnoDB Buffer pool size (37.5 %): 48.0M * 2/256.0M should be equal to 25%
[OK] InnoDB buffer pool instances: 1
[--] Number of InnoDB Buffer Pool Chunk : 2 for 1 Buffer Pool Instance(s)
[OK] Innodb_buffer_pool_size aligned with Innodb_buffer_pool_chunk_size & Innodb_buffer_pool_instances
[OK] InnoDB Read buffer efficiency: 99.95% (2827050 hits/ 2828334 total)
[!!] InnoDB Write Log efficiency: 31.47% (2735 hits/ 8691 total)
[OK] InnoDB log waits: 0.00% (0 waits / 5956 writes)
-------- Aria Metrics ------------------------------------------------------------------------------
[--] Aria Storage Engine not available.
-------- TokuDB Metrics ----------------------------------------------------------------------------
[--] TokuDB is disabled.
-------- XtraDB Metrics ----------------------------------------------------------------------------
[--] XtraDB is disabled.
-------- Galera Metrics ----------------------------------------------------------------------------
[--] Galera is disabled.
-------- Replication Metrics -----------------------------------------------------------------------
[--] Galera Synchronous replication: NO
[--] No replication slave(s) for this server.
[--] Binlog format: ROW
[--] XA support enabled: ON
[--] Semi synchronous replication Master: Not Activated
[--] Semi synchronous replication Slave: Not Activated
[--] This is a standalone server
-------- Recommendations ---------------------------------------------------------------------------
General recommendations:
Control warning line(s) into /opt/bitnami/mysql/logs/mysqld.log file
Control error line(s) into /opt/bitnami/mysql/logs/mysqld.log file
MySQL was started within the last 24 hours - recommendations may be inaccurate
We will suggest raising the 'join_buffer_size' until JOINs not using indexes are found.
See https://dev.mysql.com/doc/internals/en/join-buffer-size.html
(specially the conclusions at the bottom of the page).
Before changing innodb_log_file_size and/or innodb_log_files_in_group read this: https://bit.ly/2TcGgtU
Variables to adjust:
join_buffer_size (> 256.0K, or always use indexes with JOINs)
innodb_log_file_size should be (=32M) if possible, so InnoDB total log files size equals to 25% of buffer pool size.