Directional network performance issue

[Dmitry Teselkin]

I was able to reproduce https://bugs.launchpad.net/neutron/+bug/1252900 on FUEL 5.1 environment.

Version:
{"build_id": "2014-09-17_21-40-34", "ostf_sha": "64cb59c681658a7a55cc2c09d079072a41beb346", "build_number": "11", "auth_required": true, "api": "1.0", "nailgun_sha": "eb8f2b358ea4bb7eb0b2a0075e7ad3d3a905db0d", "production": "docker", "fuelmain_sha": "8ef433e939425eabd1034c0b70e90bdf888b69fd", "astute_sha": "f5fbd89d1e0e1f22ef9ab2af26da5ffbfbf24b13", "feature_groups": ["mirantis"], "release": "5.1", "release_versions": {"2014.1.1-5.1": {"VERSION": {"build_id": "2014-09-17_21-40-34", "ostf_sha": "64cb59c681658a7a55cc2c09d079072a41beb346", "build_number": "11", "api": "1.0", "nailgun_sha": "eb8f2b358ea4bb7eb0b2a0075e7ad3d3a905db0d", "production": "docker", "fuelmain_sha": "8ef433e939425eabd1034c0b70e90bdf888b69fd", "astute_sha": "f5fbd89d1e0e1f22ef9ab2af26da5ffbfbf24b13", "feature_groups": ["mirantis"], "release": "5.1", "fuellib_sha": "d9b16846e54f76c8ebe7764d2b5b8231d6b25079"}}}, "fuellib_sha": "d9b16846e54f76c8ebe7764d2b5b8231d6b25079"}

We saw huge network performance degradation, almost the same as described in http://www.gossamer-threads.com/lists/openstack/dev/31628#31628

Lab schema included.

Env configuration:
1x controller - Multi-node, no HA, GRE.
1x compute - KVM

I was able to fix that with the commands
# ethtool --offload eth0 gro off
# ethtool --offload eth1 gro off
executed on the controller node only, as proposed in https://bugs.launchpad.net/neutron/+bug/1252900/comments/30

[Alexander Ignatov (aignatov)]

It has a workaround in Icehouse. See item 5 in the following doc
http://docs.openstack.org/icehouse/install-guide/install/apt/content/neutron-network-node.html

It describes the same way Dmitry fixed this issue by the following command "ethtool --offload eth0 gro off"

Not sure if need to add this command to manifests and trigger it during the deployment stage.

[Dmitry Teselkin (teselkin-d)]

Then it must be described in "known issues" or similar topic. Although it's not critical bug, but wasn't easy to find how to fix it.
We spent a day trying to fix that.

[Alexander Ignatov (aignatov)]

Moved to Medium since it's performance issue