We can only create kuryr local network in docker swarm 1.13

Bug #1668486 reported by Liping Mao
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kuryr-libnetwork
In Progress
High
Liping Mao

Bug Description

Environment:
RHEL + Docker 1.13.1

Reproduce steps:
1. build docker cluster in swarm mode.
2. Create kuryr network in one node, kuryr network will be created as local scope, and we can't see it in other nodes.

[root@limaonew-1 ~]# docker network create --driver=kuryr --ipam-driver=kuryr --subnet 10.225.18.128/26 --gateway 10.225.18.129 --ip-range 10.225.18.128/26 -o neutron.net.uuid=5b231d26-edd8-4536-90e6-be446530b86e limao_input
09e526fb654c119fa27b38ef302b84088442ca57de8e793aafac30045c638c6e
[root@limaonew-1 ~]# docker network ls
NETWORK ID NAME DRIVER SCOPE
2b3ad1da7716 bridge bridge local
5107a04d5722 docker_gwbridge bridge local
e00cfceecd74 host host local
imaapjuh3iy0 ingress overlay swarm
09e526fb654c limao_input kuryr local
7fc4c8ab228c none null local

[root@limaonew-2 ~]# docker network ls
NETWORK ID NAME DRIVER SCOPE
f7c6ca2ca6ba bridge bridge local
10d47c92eb61 docker_gwbridge bridge local
1ec28a86071b host host local
imaapjuh3iy0 ingress overlay swarm
747dfd34ce12 none null local

When we run kuryr as global scope, there is the following error:
Error response from daemon: rpc error: code = 3 desc = legacy plugin kuryr of type NetworkDriver is not supported in swarm mode

I see comments in https://github.com/docker/docker/issues/24569.
Looks like only plugin v2 works in swarm mode.

Liping Mao (limao)
description: updated
Changed in kuryr-libnetwork:
assignee: nobody → Liping Mao (limao)
Revision history for this message
Irena Berezovsky (irenab) wrote :

Based on the comments is https://github.com/docker/docker/issues/24569, kuryr must be implemented as managed plugin

Revision history for this message
Liping Mao (limao) wrote :

Hi Irena,

Yes, I'm trying to see how to make kuryr-libnetwork works as a managed plugin.
https://docs.docker.com/engine/extend/#developing-a-plugin

Thanks.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kuryr-libnetwork (master)

Fix proposed to branch: master
Review: https://review.openstack.org/449038

Changed in kuryr-libnetwork:
status: New → In Progress
Revision history for this message
Liping Mao (limao) wrote :

@irenab

I tried docker swarm with pluginv2, it can work with local scope, but still can't work with global scope. Open the following issue in libnetwork to trace this:
https://github.com/docker/libnetwork/issues/1699

Changed in kuryr-libnetwork:
importance: Undecided → High
Revision history for this message
Liping Mao (limao) wrote :

Currently Kuryr-libnetwork will not work with swarm mode:
https://github.com/docker/docker/issues/32604

From aboch:
At swarm network creation, the pool allocation, from the IPAM driver's default global address space will be done by the swarm allocator.
When the network will be created on the node, the pool allocation will be requested on the node from the IPAM driver's default local address space.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to kuryr-libnetwork (master)

Reviewed: https://review.openstack.org/449038
Committed: https://git.openstack.org/cgit/openstack/kuryr-libnetwork/commit/?id=0dd2ad15af4fa7fd9e3ef1803f2e1bfe2a787d7a
Submitter: Jenkins
Branch: master

commit 0dd2ad15af4fa7fd9e3ef1803f2e1bfe2a787d7a
Author: Liping Mao (limao) <email address hidden>
Date: Thu Mar 23 18:05:34 2017 +0800

    Kuryr-libnetwork Docker managed plugin

    This patch add a script to create v2plugin rootfs.
    1. use local unix socket for v2plugin
    2. add config.json for v2plugin
    3. Add scripts to build v2plugin rootfs
    4. Update devstack to use v2plugin

    Change-Id: I91d352a963840f33d1d2f9cea17ab6ac777d22bc
    Related-Bug: #1668486
    Partially-Implements: BP docker-v2plugin

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.