mastodon 4.4.1

nick

mergy Hi there, I pinged your past related support ticket with more details.

querkmachine

I'm getting this error when running bundle install

[user@server mastodon]$ bundle install
Fetching gem metadata from https://rubygems.org/........
Installing llhttp-ffi 0.5.1 with native extensions
Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

    current directory: /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/llhttp-ffi-0.5.1/ext
/opt/ruby32/bin/ruby -rrubygems /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/exe/rake
RUBYARCHDIR\=/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/extensions/x86_64-linux/3.2.0/llhttp-ffi-0.5.1
RUBYLIBDIR\=/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/extensions/x86_64-linux/3.2.0/llhttp-ffi-0.5.1
rake aborted!
LoadError: cannot load such file -- ffi_c (LoadError)
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:160:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:160:in `rescue in require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:40:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi.rb:5:in `rescue in <top (required)>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi.rb:2:in `<top (required)>'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:149:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:149:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-compiler-1.3.2/lib/ffi-compiler/compile_task.rb:4:in `<top (required)>'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:160:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:160:in `rescue in require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:40:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/llhttp-ffi-0.5.1/ext/Rakefile:3:in `<top (required)>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/exe/rake:27:in `<main>'

Caused by:
LoadError: cannot load such file -- ffi_c (LoadError)
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi.rb:5:in `rescue in <top (required)>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi.rb:2:in `<top (required)>'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:149:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:149:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-compiler-1.3.2/lib/ffi-compiler/compile_task.rb:4:in `<top (required)>'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:160:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:160:in `rescue in require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:40:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/llhttp-ffi-0.5.1/ext/Rakefile:3:in `<top (required)>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/exe/rake:27:in `<main>'

Caused by:
LoadError: /lib64/libc.so.6: version `GLIBC_2.27' not found (required by /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/3.2/ffi_c.so) -
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/3.2/ffi_c.so (LoadError)
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi.rb:3:in `<top (required)>'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:149:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:149:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-compiler-1.3.2/lib/ffi-compiler/compile_task.rb:4:in `<top (required)>'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:160:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:160:in `rescue in require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:40:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/llhttp-ffi-0.5.1/ext/Rakefile:3:in `<top (required)>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/exe/rake:27:in `<main>'

Caused by:
LoadError: cannot load such file -- ffi-compiler/compile_task (LoadError)
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
<internal:/opt/ruby32/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/llhttp-ffi-0.5.1/ext/Rakefile:3:in `<top (required)>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/exe/rake:27:in `<main>'
(See full trace by running task with --trace)

rake failed, exit code 1

Gem files will remain installed in /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/llhttp-ffi-0.5.1 for inspection.
Results logged to /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/extensions/x86_64-linux/3.2.0/llhttp-ffi-0.5.1/gem_make.out

  /opt/ruby32/lib/ruby/3.2.0/rubygems/ext/builder.rb:119:in `run'
  /opt/ruby32/lib/ruby/3.2.0/rubygems/ext/rake_builder.rb:30:in `build'
  /opt/ruby32/lib/ruby/3.2.0/rubygems/ext/builder.rb:187:in `build_extension'
  /opt/ruby32/lib/ruby/3.2.0/rubygems/ext/builder.rb:221:in `block in build_extensions'
  /opt/ruby32/lib/ruby/3.2.0/rubygems/ext/builder.rb:218:in `each'
  /opt/ruby32/lib/ruby/3.2.0/rubygems/ext/builder.rb:218:in `build_extensions'
  /opt/ruby32/lib/ruby/3.2.0/rubygems/installer.rb:846:in `build_extensions'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/rubygems_gem_installer.rb:111:in `build_extensions'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/rubygems_gem_installer.rb:30:in `install'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/source/rubygems.rb:220:in `install'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/installer/gem_installer.rb:55:in `install'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/installer/gem_installer.rb:17:in `install_from_spec'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/installer/parallel_installer.rb:133:in `do_install'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/installer/parallel_installer.rb:124:in `block in worker_pool'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/worker.rb:62:in `apply_func'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/worker.rb:57:in `block in process_queue'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/worker.rb:54:in `loop'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/worker.rb:54:in `process_queue'
  /home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bundler-2.6.9/lib/bundler/worker.rb:90:in `block (2 levels) in create_threads'

An error occurred while installing llhttp-ffi (0.5.1), and Bundler cannot continue.

In Gemfile:
  http was resolved to 5.3.1, which depends on
    llhttp-ffi

sean

querkmachine I've added a few commands to the procedure that should fix that error. Start over at the second section, starting at "Next, restart your shell session...". Be sure to start with a fresh shell!

querkmachine

sean Thanks for the update!

It's successfully running bundle install now, but the same package seems to now be causing problems when running RAILS_ENV=production bundle exec rails assets:precompile instead. 😓

[user@server mastodon]$ RAILS_ENV=production bundle exec rails assets:precompile
I, [2025-09-27T23:26:37.993278 #108051]  INFO -- : [dotenv] Loaded .env.production
bin/rails aborted!
LoadError: Could not open library 'vips.so.42': vips.so.42: cannot open shared object file: No such file or directory. (LoadError)
Could not open library 'libvips.so.42': libvips.so.42: cannot open shared object file: No such file or directory.
Searched in <system library path>
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2/lib/ffi/dynamic_library.rb:94:in `load_library'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2/lib/ffi/library.rb:95:in `block in ffi_lib'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2/lib/ffi/library.rb:94:in `map'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ffi-1.17.2/lib/ffi/library.rb:94:in `ffi_lib'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ruby-vips-2.2.4/lib/vips.rb:46:in `<module:Vips>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/ruby-vips-2.2.4/lib/vips.rb:43:in `<main>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bootsnap-1.18.6/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/zeitwerk-2.7.3/lib/zeitwerk/core_ext/kernel.rb:34:in `require'
/home/user/apps/my_social/mastodon/config/initializers/vips.rb:6:in `<main>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/engine.rb:693:in `load'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/engine.rb:693:in `block in load_config_initializer'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/activesupport-8.0.2/lib/active_support/notifications.rb:212:in `instrument'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/engine.rb:692:in `load_config_initializer'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/engine.rb:646:in `block (2 levels) in <class:Engine>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/engine.rb:645:in `each'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/engine.rb:645:in `block in <class:Engine>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/initializable.rb:32:in `instance_exec'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/initializable.rb:32:in `run'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/initializable.rb:61:in `block in run_initializers'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/initializable.rb:50:in `each'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/initializable.rb:50:in `tsort_each_child'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/initializable.rb:60:in `run_initializers'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/application.rb:440:in `initialize!'
/home/user/apps/my_social/mastodon/config/environment.rb:7:in `<main>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bootsnap-1.18.6/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/zeitwerk-2.7.3/lib/zeitwerk/core_ext/kernel.rb:34:in `require'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/application.rb:416:in `require_environment!'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/application.rb:567:in `block in run_tasks_blocks'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:281:in `block in execute'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:281:in `each'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:281:in `execute'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:219:in `block in invoke_with_call_chain'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:199:in `synchronize'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:199:in `invoke_with_call_chain'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:243:in `block in invoke_prerequisites'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:241:in `each'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:241:in `invoke_prerequisites'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:218:in `block in invoke_with_call_chain'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:199:in `synchronize'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:199:in `invoke_with_call_chain'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/task.rb:188:in `invoke'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/application.rb:188:in `invoke_task'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/application.rb:138:in `block (2 levels) in top_level'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/application.rb:138:in `each'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/application.rb:138:in `block in top_level'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/application.rb:147:in `run_with_threads'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/application.rb:132:in `top_level'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/commands/rake/rake_command.rb:27:in `block (2 levels) in perform'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/application.rb:214:in `standard_exception_handling'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/commands/rake/rake_command.rb:27:in `block in perform'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/commands/rake/rake_command.rb:44:in `block in with_rake'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/rake-13.3.0/lib/rake/rake_module.rb:59:in `with_application'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/commands/rake/rake_command.rb:41:in `with_rake'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/commands/rake/rake_command.rb:20:in `perform'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/command.rb:150:in `invoke_rake'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/command.rb:67:in `block in invoke'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/command.rb:143:in `with_argv'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/command.rb:63:in `invoke'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/railties-8.0.2/lib/rails/commands.rb:18:in `<main>'
/home/user/apps/my_social/mastodon/vendor/bundle/ruby/3.2.0/gems/bootsnap-1.18.6/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'
Tasks: TOP => assets:precompile => environment
(See full trace by running task with --trace)

sean

querkmachine I've just installed the missing vips package on your server. Please give it another go.

querkmachine

sean Alright, I've managed to complete all the steps now. A few times it did output the same errors that @mergy was having in this comment, however, and it seems like Redis is also failing to start when running any of the start/restart commands for me as well.

I've spun it up manually by running redis-server /home/user/apps/my_social/mastodon/redis.conf and things seem happy for now.

querkmachine

Something definitely seems unhappy now. The Redis process seems to die every hour or two and requires manually restarting.

querkmachine

querkmachine It indeed seems that something Redis or Mastodon is doing is causing RAM usage to spike, which leads to the server killing the process and supervisord seemingly being unable to restart it.

Is there a way of throttling that, perhaps?

sean

querkmachine Please try adding the following line to supervisor.conf at the beginning of the environment settings (just above RAILS_ENV) for program:puma and program:sidekiq (ie you will add the line in 2 different places):

LD_PRELOAD=/usr/lib64/libjemalloc.so.1,

After you've modified the file, stop the app then kill supervisor like so:

pkill -f supervisor

... then restart the app.

querkmachine

sean Back up and running for the time being, will keep an eye on it to see if it lasts!

Thanks for all the help at weird hours of the day!

querkmachine

querkmachine Well it managed about three days before another RAM spike briefly took it 0.07 MB over the limit and seemingly killed supervisord.

Inconvenient, but at least manageable, and the restart scripts work to get it going again.

« Previous Page