OpenStack Object Storage (swift)

Bug #1698207
Comment #1

Comment 1 for bug 1698207

Revision history for this message

Alistair Coles (alistair-coles) wrote on 2017-06-16:

On my SAIO I set max_file_size = 52428800 in swift.conf

$ swift-init main restart
$ swift upload c1 100MiB_file --segment-size 10485760
$ swift copy c1 100MiB_file
Object COPY failed: http://localhost:8080/v1/AUTH_test/c1/100MiB_file 413 Request Entity Too Large [first 60 chars of response] <html><h1>Request Entity Too Large</h1><p>The body of your r

...while watching the connections with

$ watch -n 0.5 'sudo netstat -ape --numeric-ports --tcp|grep python|grep swift'

and on master see object server connections pile up

```

Every 0.5s: sudo netstat -ape --numeric-ports --tcp|grep python|grep swift Fri Jun 16 11:04:38 2017

tcp 0 0 127.0.0.1:6040 tcp 0 0 127.0.0.1:6041 tcp 0 0 127.0.0.1:6010 tcp 0 0 127.0.0.1:6042 tcp 0 0 127.0.0.1:6011 tcp 0 0 127.0.0.1:6012 tcp 0 0 127.0.0.1:6020 tcp 0 0 127.0.0.1:6021 tcp 0 0 127.0.0.1:6022 tcp 0 0 127.0.0.1:6030 tcp 0 0 127.0.0.1:6031 tcp 0 0 127.0.0.1:6032 tcp 0 0 127.0.0.1:8080 tcp 0 3770878 127.0.0.1:6010 tcp 0 3568541 127.0.0.1:6030 tcp 0 0 127.0.0.1:57404 tcp 940182 0 127.0.0.1:36600 tcp 941228 0 127.0.0.1:38846 tcp 0 4037162 127.0.0.1:6030 tcp 0 4103157 127.0.0.1:6010 tcp 939670 0 127.0.0.1:53906 tcp 0 3460231 127.0.0.1:6010 tcp 0 3905044 127.0.0.1:6040 tcp 2031567 0 127.0.0.1:53786 tcp 945315 0 127.0.0.1:53758 tcp 944216 0 127.0.0.1:53942 tcp 0 3704243 127.0.0.1:6010 tcp 2106195 0 127.0.0.1:53926 tcp 0 3469959 127.0.0.1:6010 tcp 2064057 0 127.0.0.1:36786 0.0.0.0:* LISTEN swift 1169921 21598/python
0.0.0.0:* LISTEN swift 1169385 21590/python
0.0.0.0:* LISTEN swift 1169914 21595/python
0.0.0.0:* LISTEN swift 1169364 21594/python
0.0.0.0:* LISTEN swift 1169487 21587/python
0.0.0.0:* LISTEN swift 1169374 21591/python
0.0.0.0:* LISTEN swift 1169836 21596/python
0.0.0.0:* LISTEN swift 1169677 21588/python
0.0.0.0:* LISTEN swift 1169390 21592/python
0.0.0.0:* LISTEN swift 1169906 21597/python
0.0.0.0:* LISTEN swift 1169486 21589/python
0.0.0.0:* LISTEN swift 1169663 21593/python
0.0.0.0:* LISTEN swift 1169246 21586/python
127.0.0.1:53942 ESTABLISHED swift 1196190 21814/python
127.0.0.1:36786 ESTABLISHED swift 1196594 21805/python
127.0.0.1:11211 ESTABLISHED swift 1170263 21713/python
127.0.0.1:6030 ESTABLISHED swift 1170774 21713/python
127.0.0.1:6040 ESTABLISHED swift 1194938 21713/python
127.0.0.1:36600 ESTABLISHED swift 1170775 21805/python
127.0.0.1:53906 ESTABLISHED swift 1195324 21814/python
127.0.0.1:6010 ESTABLISHED swift 1195323 21713/python
127.0.0.1:53926 ESTABLISHED swift 1195799 21814/python
127.0.0.1:38846 ESTABLISHED swift 1194939 21817/python
127.0.0.1:6010 ESTABLISHED swift 1171302 21713/python
127.0.0.1:6010 ESTABLISHED swift 1170534 21713/python
127.0.0.1:6010 ESTABLISHED swift 1196189 21713/python
127.0.0.1:53758 ESTABLISHED swift 1170535 21814/python
127.0.0.1:6010 ESTABLISHED swift 1195798 21713/python
127.0.0.1:53786 ESTABLISHED swift 1171303 21814/python
127.0.0.1:6030 ESTABLISHED swift 1196593 21713/python

```

On my SAIO I set max_file_size = 52428800 in swift.conf

$ swift-init main restart
$ swift upload c1 100MiB_file --segment-size 10485760
$ swift copy c1 100MiB_file
Object COPY failed: http://localhost:8080/v1/AUTH_test/c1/100MiB_file 413 Request Entity Too Large  [first 60 chars of response] <html><h1>Request Entity Too Large</h1><p>The body of your r

...while watching the connections with

$ watch -n 0.5 'sudo netstat -ape --numeric-ports --tcp|grep python|grep swift'

and on master see object server connections pile up

```

Every 0.5s: sudo netstat -ape --numeric-ports --tcp|grep python|grep swift                                         Fri Jun 16 11:04:38 2017

tcp        0      0 127.0.0.1:6040          0.0.0.0:*               LISTEN      swift      1169921     21598/python
tcp        0      0 127.0.0.1:6041          0.0.0.0:*               LISTEN      swift      1169385     21590/python
tcp        0      0 127.0.0.1:6010          0.0.0.0:*               LISTEN      swift      1169914     21595/python
tcp        0      0 127.0.0.1:6042          0.0.0.0:*               LISTEN      swift      1169364     21594/python
tcp        0      0 127.0.0.1:6011          0.0.0.0:*               LISTEN      swift      1169487     21587/python
tcp        0      0 127.0.0.1:6012          0.0.0.0:*               LISTEN      swift      1169374     21591/python
tcp        0      0 127.0.0.1:6020          0.0.0.0:*               LISTEN      swift      1169836     21596/python
tcp        0      0 127.0.0.1:6021          0.0.0.0:*               LISTEN      swift      1169677     21588/python
tcp        0      0 127.0.0.1:6022          0.0.0.0:*               LISTEN      swift      1169390     21592/python
tcp        0      0 127.0.0.1:6030          0.0.0.0:*               LISTEN      swift      1169906     21597/python
tcp        0      0 127.0.0.1:6031          0.0.0.0:*               LISTEN      swift      1169486     21589/python
tcp        0      0 127.0.0.1:6032          0.0.0.0:*               LISTEN      swift      1169663     21593/python
tcp        0      0 127.0.0.1:8080          0.0.0.0:*               LISTEN      swift      1169246     21586/python
tcp        0 3770878 127.0.0.1:6010          127.0.0.1:53942         ESTABLISHED swift      1196190     21814/python
tcp        0 3568541 127.0.0.1:6030          127.0.0.1:36786         ESTABLISHED swift      1196594     21805/python
tcp        0      0 127.0.0.1:57404         127.0.0.1:11211         ESTABLISHED swift      1170263     21713/python
tcp   940182      0 127.0.0.1:36600         127.0.0.1:6030          ESTABLISHED swift      1170774     21713/python
tcp   941228      0 127.0.0.1:38846         127.0.0.1:6040          ESTABLISHED swift      1194938     21713/python
tcp        0 4037162 127.0.0.1:6030          127.0.0.1:36600         ESTABLISHED swift      1170775     21805/python
tcp        0 4103157 127.0.0.1:6010          127.0.0.1:53906         ESTABLISHED swift      1195324     21814/python
tcp   939670      0 127.0.0.1:53906         127.0.0.1:6010          ESTABLISHED swift      1195323     21713/python
tcp        0 3460231 127.0.0.1:6010          127.0.0.1:53926         ESTABLISHED swift      1195799     21814/python
tcp        0 3905044 127.0.0.1:6040          127.0.0.1:38846         ESTABLISHED swift      1194939     21817/python
tcp   2031567      0 127.0.0.1:53786         127.0.0.1:6010          ESTABLISHED swift      1171302     21713/python
tcp   945315      0 127.0.0.1:53758         127.0.0.1:6010          ESTABLISHED swift      1170534     21713/python
tcp   944216      0 127.0.0.1:53942         127.0.0.1:6010          ESTABLISHED swift      1196189     21713/python
tcp        0 3704243 127.0.0.1:6010          127.0.0.1:53758         ESTABLISHED swift      1170535     21814/python
tcp   2106195      0 127.0.0.1:53926         127.0.0.1:6010          ESTABLISHED swift      1195798     21713/python
tcp        0 3469959 127.0.0.1:6010          127.0.0.1:53786         ESTABLISHED swift      1171303     21814/python
tcp   2064057      0 127.0.0.1:36786         127.0.0.1:6030          ESTABLISHED swift      1196593     21713/python

```