Overview#
Investigative Data Warehouse (IDW) is a searchable Government Data Store operated by the FBI created in 2004.
Investigative Data Warehouse has an unknown nature and scope of the as Government Data Store is classified.
The database is a centralization of multiple United States federal government and US States databases, including criminal records from various law enforcement agencies, the U.S. Department of the Treasury's Financial Crimes Enforcement Network (FinCEN), and public records databases.
According to Michael Morehart's testimony before the House Committee on Financial Services in 2006, the "IDW is a centralized, web-enabled, closed system repository for intelligence and investigative data. This system, maintained by the FBI, allows appropriately trained and authorized personnel throughout the country to query for information of relevance to investigative and intelligence matters.
Investigative Data Warehouse DataStore Sources#
Investigative Data Warehouse used many data sources. The FOIA documents from EFF are heavily redacted, but some of the sources are as follows:- FBI Automated Case Support system (ACS), subset of the Electronic Case File (ECF) system[16]
- Joint Intelligence Committee Investigation documents (JICI),[17] with OCR text [18]
- "Open Source News" (public websites, such as the Washington Post and others)[19]
- Secure Automated Messaging Network (SAMNet)[17]
- Violent Gang and Terrorist Organizing File (VGTOF)
- DARPA TIDES program ('Open Source news' that has been organized and collected)
- IntelPlus Filerooms, with OCR text[18]
- FBI National Crime Information Center (NCIC)[16]
- FBI Records Management Division (RMD), Document Laboratory (DocLab), FBIHQ
- MiTAP [20] (collects data from public sources, websites, etc.)
- SPT-Specific data sources (partial list, FOIA files have large parts redacted):
- Unified Name Index (UNI) extracts
- Financial Center (FinCen),[21] including Bank Secrecy Act data [22]
- "Various Sources", including the Transportation Security Administration[23]
- FBI Counterterrorism Division (CTD)
- Telephone numbers / addresses from ACS
- Case data from ACS
- Terrorist Watch List (TWL)[24]
- "Other NJTTF data"
- United States Department of State ... Lost/Stolen Passport data
- No Fly List, from TSA
- Selectee list, from TSA
- ACS/ECF with some case types excluded
- CIA non-TS/non-SCI Technical Discussions (TDs) and Intelligence Information Reports (IIRs) from 1978 to the May 2004[25]
- Open-source intelligence (OSINT)
Category#
Government Data Store
More Information#
There might be more information for this subject on one of the following:- [#1] - Investigative_Data_WarehouseContent unavailable! (broken link)https://ldapwiki.com/wiki/images/out.png - based on information obtained 2019-07-22