Add meta-data to Import from NCUA

Bug #965789 reported by Joe Marraffino
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Data Commons
New
Wishlist
Unassigned

Bug Description

A robust contribution to find.coop is the scrape/pull from NCUA's public credit union directory

http://www.ncua.gov/Legal/GuidesEtc/Pages/CUDirectory.aspx
https://scraperwiki.com/scrapers/ncua-credit-union-directory-usa/

It would be useful if this import happened some additional data was added to each entry:
 - the organization type "credit union" (unlike some DSOs, this list has only one org type)
 - A DSO "authority" of NCUA were appended
 - the creation (import) date was appended

Revision history for this message
Benjamin Bradley (bbradley) wrote :

If NCUA is set up as a DSO, and they do the import through the DSO interface, then all imported entries will automatically be added to their data set.

when the DSO's import module is created (which will do the mapping between the scraper output format and the find.coop data format), we can have it automatically add the org type "credit union" to all entries.

all organizations already have a created_at and updated_at timestamp which are set/updated automatically (although I don't think this data is visible where expected -- so maybe that's the enhancement that is needed)

Revision history for this message
Paul Fitzpatrick (paulfitz) wrote :

Side-note: The scraper output format is under our control (I wrote it) so we can make it match find.coop as much as possible. My vague notion is to move as much work on scraper-writing to scraperwiki.com as possible, since they support multiple languages (python, ruby, php, js), and have decent documentation, so we'd have a shot at getting a tech person affiliated with a data-sharer to maintain the script. But that doesn't apply to NCUA, which we have no relationship with, they are "just" a great existing data source.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.