Juniper Openstack

Bug #1751124
Comment #4

Comment 4 for bug 1751124

Revision history for this message

Michael Henkel (mhenkel-3) wrote on 2018-03-02: Re: [Bug 1751124] Re: DPDK Compute cannot communicate to the gateway in datapath- cannot ping the gateway

no;)

Regards,
Michael

> Am 02.03.2018 um 12:31 schrieb Vinod Nair <email address hidden>:
>
> AFAIK this is more of a provision issue.. Agent.conf should have the
> vhost ip
>
> --
> You received this bug notification because you are a bug assignee.
> https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.launchpad.net_bugs_1751124&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=IIpdzrKFE-fFt447an76T47XLh_Zf5gZoVC_UG0ewoQ&m=C_KdVG2J0hJUm69MtFYfTFmEzWs75xiT4fX_dQQQVBk&s=zo-MX6gEu9LxcPaAuRagTtKLwWb4yutSr0O7l710114&e=
>
> Title:
> DPDK Compute cannot communicate to the gateway in datapath- cannot
> ping the gateway
>
> Status in Juniper Openstack:
> New
> Status in Juniper Openstack r4.1 series:
> New
> Status in Juniper Openstack trunk series:
> New
>
> Bug description:
> During RHOPS10 + Contrail 4.1 deployment ,
>
> The DPDK compute is unable to ping the gateway in datapath.
>
> ip a
>
> <none>
> [root@overcloud-contraildpdk-1 ~]# ip a
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
> inet 127.0.0.1/8 scope host lo
> valid_lft forever preferred_lft forever
> inet6 ::1/128 scope host
> valid_lft forever preferred_lft forever
> 2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
> link/ether 0c:c4:7a:81:a4:a4 brd ff:ff:ff:ff:ff:ff
> inet 192.168.30.53/24 brd 192.168.30.255 scope global eno1
> valid_lft forever preferred_lft forever
> inet6 fe80::ec4:7aff:fe81:a4a4/64 scope link
> valid_lft forever preferred_lft forever
> 3: eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
> link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
> inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
> valid_lft forever preferred_lft forever
> 4: enp2s0f0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN qlen 1000
> link/ether 90:e2:ba:da:fa:30 brd ff:ff:ff:ff:ff:ff
> 5: enp2s0f1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN qlen 1000
> link/ether 90:e2:ba:da:fa:31 brd ff:ff:ff:ff:ff:ff
> 7: ens7f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
> link/ether 0c:c4:7a:b7:2c:fb brd ff:ff:ff:ff:ff:ff
> inet6 fe80::ec4:7aff:feb7:2cfb/64 scope link
> valid_lft forever preferred_lft forever
> 9: vhost0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN qlen 1000
> link/ether 0c:c4:7a:b7:2c:fa brd ff:ff:ff:ff:ff:ff
> inet 10.88.0.81/24 brd 10.88.0.255 scope global vhost0
> valid_lft forever preferred_lft forever
> inet6 fe80::ec4:7aff:feb7:2cfa/64 scope link
> valid_lft forever preferred_lft forever
> 10: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN qlen 1000
> link/ether c2:34:32:7d:ee:ce brd ff:ff:ff:ff:ff:ff
> 11: vlan213@eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
> link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
> inet 10.88.2.30/24 brd 10.88.2.255 scope global vlan213
> valid_lft forever preferred_lft forever
> inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
> valid_lft forever preferred_lft forever
> 12: vlan211@eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
> link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
> inet 10.88.1.29/24 brd 10.88.1.255 scope global vlan211
> valid_lft forever preferred_lft forever
> inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
> valid_lft forever preferred_lft forever
> 13: vlan215@eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
> link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
> inet 10.88.4.30/24 brd 10.88.4.255 scope global vlan215
> valid_lft forever preferred_lft forever
> inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
> valid_lft forever preferred_lft forever
> 14: vlan214@eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
> link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
> inet 10.88.3.32/24 brd 10.88.3.255 scope global vlan214
> valid_lft forever preferred_lft forever
> inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
> valid_lft forever preferred_lft forever
> [root@overcloud-contraildpdk-1 ~]#
>
>
> vif --list
>
> [root@overcloud-contraildpdk-1 ~]# vif --list
> Vrouter Interface Table
>
> Flags: P=Policy, X=Cross Connect, S=Service Chain, Mr=Receive Mirror
> Mt=Transmit Mirror, Tc=Transmit Checksum Offload, L3=Layer 3, L2=Layer 2
> D=DHCP, Vp=Vhost Physical, Pr=Promiscuous, Vnt=Native Vlan Tagged
> Mnp=No MAC Proxy, Dpdk=DPDK PMD Interface, Rfl=Receive Filtering Offload, Mon=Interface is Monitored
> Uuf=Unknown Unicast Flood, Vof=VLAN insert/strip offload, Df=Drop New Flows, L=MAC Learning Enabled
> Proxy=MAC Requests Proxied Always, Er=Etree Root, Mn=Mirror without Vlan Tag
>
> vif0/0 PCI: 0000:00:00.0 (Speed 10000, Duplex 1)
> Type:Physical HWaddr:0c:c4:7a:b7:2c:fa IPaddr:0.0.0.0
> Vrf:0 Mcast Vrf:65535 Flags:TcL3L2VpEr QOS:-1 Ref:16
> RX device packets:23236 bytes:3279686 errors:0
> RX port packets:10726 errors:0
> RX queue errors to lcore 0 0 0 0 0 0 0 0 0 0 0 0 0 0
> RX packets:10726 bytes:1529400 errors:0
> TX packets:3377 bytes:310706 errors:0
> Drops:3013
> TX port packets:3371 errors:6
> TX device packets:66412 bytes:8025938 errors:0
>
> vif0/1 PMD: vhost0
> Type:Host HWaddr:0c:c4:7a:b7:2c:fa IPaddr:0.0.0.0
> Vrf:0 Mcast Vrf:65535 Flags:L3DEr QOS:-1 Ref:14
> RX device packets:3235 bytes:304742 errors:0
> RX queue packets:3235 errors:0
> RX queue errors to lcore 0 0 0 0 0 0 0 0 0 0 0 0 0 0
> RX packets:3235 bytes:304742 errors:0
> TX packets:7713 bytes:1234126 errors:0
> Drops:0
> TX queue packets:7713 errors:0
> TX device packets:7713 bytes:1234126 errors:0
>
> vif0/2 Socket: unix
> Type:Agent HWaddr:00:00:5e:00:01:00 IPaddr:0.0.0.0
> Vrf:65535 Mcast Vrf:65535 Flags:L3Er QOS:-1 Ref:3
> RX port packets:142 errors:0
> RX queue errors to lcore 0 0 0 0 0 0 0 0 0 0 0 0 0 0
> RX packets:142 bytes:12212 errors:0
> TX packets:686 bytes:71344 errors:0
> Drops:0
>
> [root@overcloud-contraildpdk-1 ~]#
>
>
>
> [root@overcloud-contraildpdk-1 ~]# /opt/contrail/bin/dpdk_nic_bind.py --status
>
>
> Network devices using DPDK-compatible driver
> ============================================
> 0000:03:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=uio_pci_generic unused=ixgbe
>
> Network devices using kernel driver
> ===================================
> 0000:02:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' if=enp2s0f0 drv=ixgbe unused=uio_pci_generic
> 0000:02:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' if=enp2s0f1 drv=ixgbe unused=uio_pci_generic
> 0000:03:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' if=ens7f1 drv=ixgbe unused=uio_pci_generic
> 0000:04:00.0 'I350 Gigabit Network Connection' if=eno1 drv=igb unused=uio_pci_generic *Active*
> 0000:04:00.1 'I350 Gigabit Network Connection' if=eno2 drv=igb unused=uio_pci_generic
>
> Other network devices
> =====================
> <none>
> [root@overcloud-contraildpdk-1 ~]#
>
>
> [root@overcloud-contraildpdk-1 ~]# ps -aef | grep dpdk
> root 11009 10998 99 01:38 ? 1-06:30:35 /usr/bin/contrail-vrouter-dpdk --no-daemon --vdev eth_bond_bond0,mode=4,xmit_policy=l34,socket_id=0,mac=0c:c4:7a:b7:2c:fa,slave=0000:03:00.0 --socket-mem 1024 1024
> root 24342 24266 0 09:07 pts/0 00:00:00 grep --color=auto dpdk
> [root@overcloud-contraildpdk-1 ~]#
>
>
> [root@overcloud-contraildpdk-1 ~]# cat /etc/contrail/contrail-vrouter-agent.conf
> [DEFAULT]
> platform=dpdk
> physical_interface_address=0000:00:00.0
> physical_interface_mac=0c:c4:7a:b7:2c:fa
> physical_uio_driver=uio_pci_generic
> log_file=/var/log/contrail/contrail-vrouter-agent.log
> log_level=SYS_NOTICE
> log_local=1
> [VIRTUAL-HOST-INTERFACE]
> physical_interface=bond0
> name=vhost0
> gateway=10.88.0.254
> [SERVICE-INSTANCE]
> netns_command=/bin/opencontrail-vrouter-netns
> [root@overcloud-contraildpdk-1 ~]#
>
> To manage notifications about this bug go to:
> https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.launchpad.net_juniperopenstack_-2Bbug_1751124_-2Bsubscriptions&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=IIpdzrKFE-fFt447an76T47XLh_Zf5gZoVC_UG0ewoQ&m=C_KdVG2J0hJUm69MtFYfTFmEzWs75xiT4fX_dQQQVBk&s=SOHbHVXoezMNPcCrECAVGikcpYl_475tosgPvYbTazU&e=

no;)

Regards,
Michael

> Am 02.03.2018 um 12:31 schrieb Vinod Nair <vinodnair@juniper.net>:
> 
> AFAIK this is more of a provision issue.. Agent.conf should have the
> vhost ip
> 
> -- 
> You received this bug notification because you are a bug assignee.
> https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.launchpad.net_bugs_1751124&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=IIpdzrKFE-fFt447an76T47XLh_Zf5gZoVC_UG0ewoQ&m=C_KdVG2J0hJUm69MtFYfTFmEzWs75xiT4fX_dQQQVBk&s=zo-MX6gEu9LxcPaAuRagTtKLwWb4yutSr0O7l710114&e=
> 
> Title:
>  DPDK Compute cannot communicate to the gateway  in datapath- cannot
>  ping the gateway
> 
> Status in Juniper Openstack:
>  New
> Status in Juniper Openstack r4.1 series:
>  New
> Status in Juniper Openstack trunk series:
>  New
> 
> Bug description:
>  During RHOPS10 + Contrail 4.1 deployment ,
> 
>  The DPDK compute is unable to ping the gateway in datapath.
> 
>  ip a
> 
>  <none>
>  [root@overcloud-contraildpdk-1 ~]# ip a
>  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
>      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>      inet 127.0.0.1/8 scope host lo
>         valid_lft forever preferred_lft forever
>      inet6 ::1/128 scope host
>         valid_lft forever preferred_lft forever
>  2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
>      link/ether 0c:c4:7a:81:a4:a4 brd ff:ff:ff:ff:ff:ff
>      inet 192.168.30.53/24 brd 192.168.30.255 scope global eno1
>         valid_lft forever preferred_lft forever
>      inet6 fe80::ec4:7aff:fe81:a4a4/64 scope link
>         valid_lft forever preferred_lft forever
>  3: eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
>      link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
>         valid_lft forever preferred_lft forever
>  4: enp2s0f0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN qlen 1000
>      link/ether 90:e2:ba:da:fa:30 brd ff:ff:ff:ff:ff:ff
>  5: enp2s0f1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN qlen 1000
>      link/ether 90:e2:ba:da:fa:31 brd ff:ff:ff:ff:ff:ff
>  7: ens7f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
>      link/ether 0c:c4:7a:b7:2c:fb brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::ec4:7aff:feb7:2cfb/64 scope link
>         valid_lft forever preferred_lft forever
>  9: vhost0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN qlen 1000
>      link/ether 0c:c4:7a:b7:2c:fa brd ff:ff:ff:ff:ff:ff
>      inet 10.88.0.81/24 brd 10.88.0.255 scope global vhost0
>         valid_lft forever preferred_lft forever
>      inet6 fe80::ec4:7aff:feb7:2cfa/64 scope link
>         valid_lft forever preferred_lft forever
>  10: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN qlen 1000
>      link/ether c2:34:32:7d:ee:ce brd ff:ff:ff:ff:ff:ff
>  11: vlan213@eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
>      link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
>      inet 10.88.2.30/24 brd 10.88.2.255 scope global vlan213
>         valid_lft forever preferred_lft forever
>      inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
>         valid_lft forever preferred_lft forever
>  12: vlan211@eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
>      link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
>      inet 10.88.1.29/24 brd 10.88.1.255 scope global vlan211
>         valid_lft forever preferred_lft forever
>      inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
>         valid_lft forever preferred_lft forever
>  13: vlan215@eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
>      link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
>      inet 10.88.4.30/24 brd 10.88.4.255 scope global vlan215
>         valid_lft forever preferred_lft forever
>      inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
>         valid_lft forever preferred_lft forever
>  14: vlan214@eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
>      link/ether 0c:c4:7a:81:a4:a5 brd ff:ff:ff:ff:ff:ff
>      inet 10.88.3.32/24 brd 10.88.3.255 scope global vlan214
>         valid_lft forever preferred_lft forever
>      inet6 fe80::ec4:7aff:fe81:a4a5/64 scope link
>         valid_lft forever preferred_lft forever
>  [root@overcloud-contraildpdk-1 ~]#
> 
> 
>  vif --list
> 
>  [root@overcloud-contraildpdk-1 ~]# vif --list
>  Vrouter Interface Table
> 
>  Flags: P=Policy, X=Cross Connect, S=Service Chain, Mr=Receive Mirror
>         Mt=Transmit Mirror, Tc=Transmit Checksum Offload, L3=Layer 3, L2=Layer 2
>         D=DHCP, Vp=Vhost Physical, Pr=Promiscuous, Vnt=Native Vlan Tagged
>         Mnp=No MAC Proxy, Dpdk=DPDK PMD Interface, Rfl=Receive Filtering Offload, Mon=Interface is Monitored
>         Uuf=Unknown Unicast Flood, Vof=VLAN insert/strip offload, Df=Drop New Flows, L=MAC Learning Enabled
>         Proxy=MAC Requests Proxied Always, Er=Etree Root, Mn=Mirror without Vlan Tag
> 
>  vif0/0      PCI: 0000:00:00.0 (Speed 10000, Duplex 1)
>              Type:Physical HWaddr:0c:c4:7a:b7:2c:fa IPaddr:0.0.0.0
>              Vrf:0 Mcast Vrf:65535 Flags:TcL3L2VpEr QOS:-1 Ref:16
>              RX device packets:23236  bytes:3279686 errors:0
>              RX port   packets:10726 errors:0
>              RX queue errors to lcore 0 0 0 0 0 0 0 0 0 0 0 0 0 0
>              RX packets:10726  bytes:1529400 errors:0
>              TX packets:3377  bytes:310706 errors:0
>              Drops:3013
>              TX port   packets:3371 errors:6
>              TX device packets:66412  bytes:8025938 errors:0
> 
>  vif0/1      PMD: vhost0
>              Type:Host HWaddr:0c:c4:7a:b7:2c:fa IPaddr:0.0.0.0
>              Vrf:0 Mcast Vrf:65535 Flags:L3DEr QOS:-1 Ref:14
>              RX device packets:3235  bytes:304742 errors:0
>              RX queue  packets:3235 errors:0
>              RX queue errors to lcore 0 0 0 0 0 0 0 0 0 0 0 0 0 0
>              RX packets:3235  bytes:304742 errors:0
>              TX packets:7713  bytes:1234126 errors:0
>              Drops:0
>              TX queue  packets:7713 errors:0
>              TX device packets:7713  bytes:1234126 errors:0
> 
>  vif0/2      Socket: unix
>              Type:Agent HWaddr:00:00:5e:00:01:00 IPaddr:0.0.0.0
>              Vrf:65535 Mcast Vrf:65535 Flags:L3Er QOS:-1 Ref:3
>              RX port   packets:142 errors:0
>              RX queue errors to lcore 0 0 0 0 0 0 0 0 0 0 0 0 0 0
>              RX packets:142  bytes:12212 errors:0
>              TX packets:686  bytes:71344 errors:0
>              Drops:0
> 
>  [root@overcloud-contraildpdk-1 ~]#
> 
> 
> 
>  [root@overcloud-contraildpdk-1 ~]# /opt/contrail/bin/dpdk_nic_bind.py  --status
> 
> 
>  Network devices using DPDK-compatible driver
>  ============================================
>  0000:03:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=uio_pci_generic unused=ixgbe
> 
>  Network devices using kernel driver
>  ===================================
>  0000:02:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' if=enp2s0f0 drv=ixgbe unused=uio_pci_generic
>  0000:02:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' if=enp2s0f1 drv=ixgbe unused=uio_pci_generic
>  0000:03:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' if=ens7f1 drv=ixgbe unused=uio_pci_generic
>  0000:04:00.0 'I350 Gigabit Network Connection' if=eno1 drv=igb unused=uio_pci_generic *Active*
>  0000:04:00.1 'I350 Gigabit Network Connection' if=eno2 drv=igb unused=uio_pci_generic
> 
>  Other network devices
>  =====================
>  <none>
>  [root@overcloud-contraildpdk-1 ~]#
> 
> 
>  [root@overcloud-contraildpdk-1 ~]# ps -aef | grep dpdk
>  root     11009 10998 99 01:38 ?        1-06:30:35 /usr/bin/contrail-vrouter-dpdk --no-daemon --vdev eth_bond_bond0,mode=4,xmit_policy=l34,socket_id=0,mac=0c:c4:7a:b7:2c:fa,slave=0000:03:00.0 --socket-mem 1024 1024
>  root     24342 24266  0 09:07 pts/0    00:00:00 grep --color=auto dpdk
>  [root@overcloud-contraildpdk-1 ~]#
> 
> 
>  [root@overcloud-contraildpdk-1 ~]# cat /etc/contrail/contrail-vrouter-agent.conf
>  [DEFAULT]
>  platform=dpdk
>  physical_interface_address=0000:00:00.0
>  physical_interface_mac=0c:c4:7a:b7:2c:fa
>  physical_uio_driver=uio_pci_generic
>  log_file=/var/log/contrail/contrail-vrouter-agent.log
>  log_level=SYS_NOTICE
>  log_local=1
>  [VIRTUAL-HOST-INTERFACE]
>  physical_interface=bond0
>  name=vhost0
>  gateway=10.88.0.254
>  [SERVICE-INSTANCE]
>  netns_command=/bin/opencontrail-vrouter-netns
>  [root@overcloud-contraildpdk-1 ~]#
> 
> To manage notifications about this bug go to:
> https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.launchpad.net_juniperopenstack_-2Bbug_1751124_-2Bsubscriptions&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=IIpdzrKFE-fFt447an76T47XLh_Zf5gZoVC_UG0ewoQ&m=C_KdVG2J0hJUm69MtFYfTFmEzWs75xiT4fX_dQQQVBk&s=SOHbHVXoezMNPcCrECAVGikcpYl_475tosgPvYbTazU&e=