STA/WL driver random connect

[KeithG]

I have:

0b:00.0 Network controller: Broadcom Corporation BCM4321 802.11a/b/g/n (rev 03)
 Subsystem: Dell Wireless 1500 Draft 802.11n WLAN Mini-card
 Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
 Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
 Latency: 0, Cache Line Size: 64 bytes
 Interrupt: pin A routed to IRQ 17
 Region 0: Memory at fe7fc000 (64-bit, non-prefetchable) [size=16K]
 Region 2: Memory at f0000000 (64-bit, prefetchable) [size=1M]
 Capabilities: <access denied>
 Kernel driver in use: b43-pci-bridge

When using the WL driver in 14.04 (installed from synaptic), I cannot connect to anything. It appears that the driver does not install correctly (wl does not show in lsusb)

If I compile the driver using the Broadcom instructions, I can 'see' networks, but only 2.5GHz ones. I can connect to my phone WiFi hotspot using WPA2 encryption, but I cannot connect to my router using WPA2. I delete the profile and re-select it and I keep getting asked to input my password. (with B43 driver works every time). This is with the current kernel:
3.13.0-36-generic and as well with 3.17.0-rc5 (after I add a couple patches). It acts like the wpa_supplicant is broken and it cannot compare passwords.

Under Vista, this works with both 2.5 and 5GHz networks and has no problems.

Keith