config-perf: fallback to list with POST when query params too large in GET

Bug #1433851 reported by Hampapur Ajay
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Fix Committed
Medium
Hampapur Ajay
R1.1
Won't Fix
Medium
Hampapur Ajay
R2.0
Fix Committed
Medium
Hampapur Ajay
R2.1
Fix Committed
Medium
Hampapur Ajay

Bug Description

In scaled setup it was observed that neutron net-list issues a subnet-list(with 203 ids) with query-params exceeding the default 8192b in haproxy (keystone token size itself is significant).

To overcome this
1. python library should transparently fall-back to getting this list via a POST operation where body will have the 'query-params' content
2. api server should expose a POSTable URI to get bulk lists

Tags: config
Hampapur Ajay (hajay)
Changed in juniperopenstack:
assignee: nobody → Hampapur Ajay (hajay)
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : master

Review in progress for https://review.opencontrail.org/8462
Submitter: Hampapur Ajay (<email address hidden>)

tags: added: config
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/8462
Committed: http://github.org/Juniper/contrail-controller/commit/f31fddec8a8d8be47dfa9521e7df2472283023ae
Submitter: Zuul
Branch: master

commit f31fddec8a8d8be47dfa9521e7df2472283023ae
Author: Hampapur Ajay <email address hidden>
Date: Wed Mar 18 19:27:31 2015 -0700

config-perf: handle list with large query-param size with POST

api-library adds a resource_list method to query a collection.
This method GETs on type-specific URI if query-params is not too
large, else falls back to POST on generic URI.
api-server adds a list-bulk-collection action URI. Fixes the
BaseRequest size so large POST bodies can be handled.

Tests for querying by anchor of parent_id list, anchor of
back_ref_id list and obj_uuids list.

Change-Id: Ib99e0576128f40702c568e0fcf2b7edf3cad047d
Partial-Bug: #1433851

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : R2.1

Review in progress for https://review.opencontrail.org/8505
Submitter: Hampapur Ajay (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : R2.0

Review in progress for https://review.opencontrail.org/8507
Submitter: Hampapur Ajay (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/8507
Committed: http://github.org/Juniper/contrail-controller/commit/df2aac72a49a7bad7a3470482f9d2c9a9a82cb1c
Submitter: Zuul
Branch: R2.0

commit df2aac72a49a7bad7a3470482f9d2c9a9a82cb1c
Author: Hampapur Ajay <email address hidden>
Date: Wed Mar 18 19:27:31 2015 -0700

config-perf: handle list with large query-param size with POST

api-library adds a resource_list method to query a collection.
This method GETs on type-specific URI if query-params is not too
large, else falls back to POST on generic URI.
api-server adds a list-bulk-collection action URI. Fixes the
BaseRequest size so large POST bodies can be handled.

Tests for querying by anchor of parent_id list, anchor of
back_ref_id list and obj_uuids list.

Change-Id: Ib99e0576128f40702c568e0fcf2b7edf3cad047d
Partial-Bug: #1433851
(cherry picked from commit f31fddec8a8d8be47dfa9521e7df2472283023ae)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/8505
Committed: http://github.org/Juniper/contrail-controller/commit/c021b5c03e5e4ff7b13ee0f387f6a3ec8d4f3d37
Submitter: Zuul
Branch: R2.1

commit c021b5c03e5e4ff7b13ee0f387f6a3ec8d4f3d37
Author: Hampapur Ajay <email address hidden>
Date: Wed Mar 18 19:27:31 2015 -0700

config-perf: handle list with large query-param size with POST

api-library adds a resource_list method to query a collection.
This method GETs on type-specific URI if query-params is not too
large, else falls back to POST on generic URI.
api-server adds a list-bulk-collection action URI. Fixes the
BaseRequest size so large POST bodies can be handled.

Tests for querying by anchor of parent_id list, anchor of
back_ref_id list and obj_uuids list.

Change-Id: Ib99e0576128f40702c568e0fcf2b7edf3cad047d
Partial-Bug: #1433851
(cherry picked from commit f31fddec8a8d8be47dfa9521e7df2472283023ae)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : master

Review in progress for https://review.opencontrail.org/8766
Submitter: Hampapur Ajay (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : R2.1

Review in progress for https://review.opencontrail.org/8767
Submitter: Hampapur Ajay (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : R2.0

Review in progress for https://review.opencontrail.org/8768
Submitter: Hampapur Ajay (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/8766
Committed: http://github.org/Juniper/contrail-generateDS/commit/8e6e15722803321877d33fcb6a4ace6d5e1a4eb2
Submitter: Zuul
Branch: master

commit 8e6e15722803321877d33fcb6a4ace6d5e1a4eb2
Author: Hampapur Ajay <email address hidden>
Date: Tue Mar 31 06:26:12 2015 -0700

config-perf: autogen changes for list with large query param to POST

Complements controller repo change of f31fddec8a8d8be47dfa9521e7df2472283023ae

Change-Id: Iddde2e1da58eb03c03092cc681f9008570e946b2
Closes-Bug: #1433851

Changed in juniperopenstack:
status: New → Fix Committed
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/8768
Committed: http://github.org/Juniper/contrail-generateDS/commit/482b9e2a66f2c8888b7e18c6d92387c3824b352c
Submitter: Zuul
Branch: R2.0

commit 482b9e2a66f2c8888b7e18c6d92387c3824b352c
Author: Hampapur Ajay <email address hidden>
Date: Tue Mar 31 06:26:12 2015 -0700

config-perf: autogen changes for list with large query param to POST

Complements controller repo change of f31fddec8a8d8be47dfa9521e7df2472283023ae

Change-Id: Iddde2e1da58eb03c03092cc681f9008570e946b2
Closes-Bug: #1433851
(cherry picked from commit 8e6e15722803321877d33fcb6a4ace6d5e1a4eb2)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/8767
Committed: http://github.org/Juniper/contrail-generateDS/commit/62121f95e7572d55df628195d13522bec020aae7
Submitter: Zuul
Branch: R2.1

commit 62121f95e7572d55df628195d13522bec020aae7
Author: Hampapur Ajay <email address hidden>
Date: Tue Mar 31 06:26:12 2015 -0700

config-perf: autogen changes for list with large query param to POST

Complements controller repo change of f31fddec8a8d8be47dfa9521e7df2472283023ae

Change-Id: Iddde2e1da58eb03c03092cc681f9008570e946b2
Closes-Bug: #1433851
(cherry picked from commit 8e6e15722803321877d33fcb6a4ace6d5e1a4eb2)

Changed in juniperopenstack:
importance: Undecided → Medium
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R1.10

Review in progress for https://review.opencontrail.org/13943
Submitter: ?douard Thuleau (<email address hidden>)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.