Oidc-auth token retrieval fails intermitently because of dnslookup failures of WAD server

[ayyappa]

Brief Description
-----------------
The Token retrieval for the WAD user fails intermittently with the "internal server error"

Severity
--------
Minor

Steps to Reproduce
------------------
1)Deploy oidc-auth-apps
2)goto "https://128.224.151.228:30555" enter username/password and click enter
3)the dex server replies with "internal server error" and following logs appear on the dex pod

2020-04-13T14:55:08.522940803Z stderr F time="2020-04-13T14:55:08Z" level=info msg="login successful: connector \"ldap\", username=\"pvtest1\", email=\"pvtest1\", groups=[\"ENG\"]"
2020-04-13T14:55:08.662979772Z stderr F time="2020-04-13T14:55:08Z" level=error msg="Failed to get auth request: not found"
2020-04-13T14:56:13.749727171Z stderr F time="2020-04-13T14:56:13Z" level=error msg="Failed to login user: failed to connect: LDAP Result Code 200 \"Network Error\": dial tcp: lookup pv-windows-acti.cumulus.wrs.com on 10.96.0.10:53: no such host"

4)This is an intermittent issue

Expected Behavior
------------------
The token should be retrieved without any errors

Actual Behavior
----------------
Retrieval fails with "internal server error" sometimes

Reproducibility
---------------
Intermittent

System Configuration
--------------------
tested on all the following systems

standard system wcp_7_10,http,ipv4

Branch/Pull Time/Commit
-----------------------
2020-04-11

Last Pass
---------
intermittent issue

Timestamp/Logs
--------------
2020-04-13T14:56:13.749727171Z

Test Activity
-------------
Feature Automation

Workaround
----------
Try multiple times to get the token

[Ghada Khalil (gkhalil)]

stx.4.0 / medium priority - intermittent issue related to the active directory feature. Should be investigated/resolved for stx.4.0

[Ghada Khalil (gkhalil)]

Moving to stx.4.0 as this is an intermittent issue and a retry is typically successful

[Ghada Khalil (gkhalil)]

Correction: Moving to stx.5.0 as this is an intermittent issue and a retry is typically successful

[Ghada Khalil (gkhalil)]

Lowering the priority a this issue has not been seen in the last few months. I got this info from Ayyappa (the reporter).