At least three operators have experienced recently that node panics with errors like this:
Message: Encountered a storage error while committing a block: Custom(CustomError(Custom(CustomError(DBError("IO error: While open a file for appending: /opt/namada/data/9458078.sst: Too many open files"))))) 7 Location: crates/node/src/shell/mod.rs:823
This is a representative log from a community member posted in discord: https://mclo.gs/i95I9rr
The error seems to appear even with a relatively high limitNOFILE (typically around 65k) parameter set in service file, and also when running not as a service. Suspect open file handles not being closed.
At least three operators have experienced recently that node panics with errors like this:
Message: Encountered a storage error while committing a block: Custom(CustomError(Custom(CustomError(DBError("IO error: While open a file for appending: /opt/namada/data/9458078.sst: Too many open files"))))) 7 Location: crates/node/src/shell/mod.rs:823This is a representative log from a community member posted in discord: https://mclo.gs/i95I9rr
The error seems to appear even with a relatively high limitNOFILE (typically around 65k) parameter set in service file, and also when running not as a service. Suspect open file handles not being closed.