Power8 LE: LoadError Unsupported platform: unknown-linux: Logstash-indexer

[Antonio Rosales]

(Per mbruzek testing)

Logstash is a subcomponent of ElasticSearch and can not identify the architecture of the power system.

We have a charm named logstash-indexer in Juju but it does not run on the Power8 LE hardware. Logstash deployed, but while checking if logstash was running the 'test logstash' command was entered the following error was seen:
  LoadError Unsupported platform: unknown-linux

We need some deeper investigation on why the platform is unknown and what can be done to resolve this error that seems to be related to the architecture.

Here is the Java command to run logstash and the resulting stack trace.

ubuntu@ubuntu-local-mbruzek-machine-2:~$ java -jar logstash-1.2.1-flatjar.jar agent -f logstash-simple.conf
Exception in thread "LogStash::Runner" org.jruby.exceptions.RaiseException: (LoadError) Unsupported platform: unknown-linux
        at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:1054)
        at RUBY.require(jar:file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/custom_require.rb:36)
        at RUBY.require(file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/logstash/JRUBY-6970.rb:22)
        at RUBY.(root)(jar:file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/META-INF/jruby.home/lib/ruby/shared/ffi/ffi.rb:69)
        at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:1054)
        at RUBY.(root)(jar:file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/custom_require.rb:1)
        at RUBY.require(jar:file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/custom_require.rb:36)
        at RUBY.require(file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/logstash/JRUBY-6970.rb:22)
        at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:1054)
        at RUBY.(root)(jar:file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/META-INF/jruby.home/lib/ruby/shared/ffi.rb:1)
        at RUBY.(root)(jar:file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/custom_require.rb:1)
        at RUBY.require(jar:file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/custom_require.rb:36)
        at RUBY.require(file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/logstash/JRUBY-6970.rb:22)
        at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:1054)
        at RUBY.LibC(file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/logstash/util/prctl.rb:3)
        at RUBY.(root)(file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/logstash/util/prctl.rb:2)
        at RUBY.(root)(jar:file:/home/ubuntu/logstash-1.2.1-flatjar.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/custom_require.rb:1)
        at logstash.runner.main(logstash/runner.rb:60)
        at logstash.runner.(root)(logstash/runner.rb:230)

--------

Also the latest logstash (1.4.1) was tested, and the "unknown-linux" errors is still seen:

re-tested logstash on IBM power system with the latest logstash version 1.4.1 and I still see the "unknown-linux" error as with the previous release.

root@ubuntu-power-machine-1:~/logstash-1.4.1# bin/logstash
LoadError: Unsupported platform: unknown-linux
  require at org/jruby/RubyKernel.java:1085
  require at file:/home/ubuntu/logstash-1.4.1/vendor/jar/jruby-complete-1.7.11.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55
   (root) at file:/home/ubuntu/logstash-1.4.1/vendor/jar/jruby-complete-1.7.11.jar!/META-INF/jruby.home/lib/ruby/shared/ffi/ffi.rb:69
  require at org/jruby/RubyKernel.java:1085
   (root) at file:/home/ubuntu/logstash-1.4.1/vendor/jar/jruby-complete-1.7.11.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1
  require at file:/home/ubuntu/logstash-1.4.1/vendor/jar/jruby-complete-1.7.11.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55
  require at org/jruby/RubyKernel.java:1085
   (root) at file:/home/ubuntu/logstash-1.4.1/vendor/jar/jruby-complete-1.7.11.jar!/META-INF/jruby.home/lib/ruby/shared/ffi.rb:1
   (root) at file:/home/ubuntu/logstash-1.4.1/vendor/jar/jruby-complete-1.7.11.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1
  require at file:/home/ubuntu/logstash-1.4.1/vendor/jar/jruby-complete-1.7.11.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55
  require at org/jruby/RubyKernel.java:1085
     LibC at /home/ubuntu/logstash-1.4.1/lib/logstash/util/prctl.rb:4
   (root) at /home/ubuntu/logstash-1.4.1/lib/logstash/util/prctl.rb:3
     main at /home/ubuntu/logstash-1.4.1/lib/logstash/runner.rb:79
   (root) at /home/ubuntu/logstash-1.4.1/lib/logstash/runner.rb:215

-thanks,
Antonio

[Jorge Castro (jorge)]

This is upstream bug: https://logstash.jira.com/browse/LOGSTASH-2234

[Matt Bruzek (mbruzek)]

After talking with logstash developers in #logstash on Freenode.net, we determined the unsupported platform problem is coming from the jruby library that logstash uses.

I also opened a bug against jruby for the unsupported platform problem here:

https://github.com/jruby/jruby/issues/1753

This appears to be the root cause of logstash not working on power systems. Any assistance, or attention we can get to the jruby issue would help toward getting logstash running on IBM Power systems.

[Antonio Rosales (arosales)]

IBM is actively pursing a fix in logstash, and should resolve this issue. IBM will post a comment when a version with Power support is available.

-thanks,
Antonio