March 14, 2013
As a part of the Department of Justice’s Open Government Plan version 2.0 (PDF), the Office of Information Policy (OIP) announced that it would be partnering with the Civil Division, with the support of the Justice Management Division, on a digital-FOIA pilot program. Last month, OIP hosted a seminar to discuss the findings of this pilot program. With specific goals in mind, from streamlining conventional processes to improve efficiency and accuracy, to increasing timeliness for responding to requests, the pilot was designed to compare and contrast the processing of requests using both digital tools and conventional methods. Multiple FOIA requests of similar size and scope were selected by OIP for inclusion in this pilot, with some processed using OIP’s standard procedures, and others leveraging the Civil Division’s existing architecture of digital resources. The digital approach used automated and electronic procedures to process all aspects of a request, including the document search and collection, de-duplication, and initial review. At the conclusion of the pilot, the data was analyzed with extremely positive results. Most impressive was the speed and accuracy with which the digital approach collected, searched, and de-duplicated records. For the cases using the digital approach, 4.7 million documents were initially collected. Automatic de-duplication removed 1.1 million documents from this collection. Once date ranges and search terms were applied, 3,859 documents remained to be reviewed by OIP FOIA professionals for these requests. Two of the requests used in the pilot, one for each approach, had a similar number of individuals identified whose records needed to be searched. Using these two requests as a comparison, the pilot had the following findings:
- Decreased number of times that a search term had to be run – Using conventional methods, each search term had to be individually run for each custodian; using the digital approach, the records of multiple custodians could be searched with multiple terms at one time.
- Improved search time – The digital approach was able to complete a search for records in less than an hour, compared with conventional methods that required multiple work days to complete the search.
- Decreased time spent on de-duplication – Conventional methods required FOIA specialists to sort through records to locate multiple copies of the same record by hand, whereas digital tools allowed for this process to be automated which drastically reduced the time required on this necessary aspect of FOIA processing.
Related blog posts
May 1, 2012
Representatives from several Open Government organizations gathered with agency FOIA professionals at the latest FOIA Requester Roundtable held April 25, 2012, at OIP. There was a lively exchange of views that centered on the topic of document searches and the challenges that agencies often face in collecting and identifying material responsive to FOIA requests. While these seasoned FOIA requesters understood that the task of locating records responsive to a request was often not as simple as...
Updated August 6, 2014
February 11, 2013
On February 21st, the Office of Information Policy (OIP) will be hosting a seminar to discuss the use of digital tools in the administration of the FOIA. The panel session will bring together OIP Director Melanie Ann Pustay with representatives from the Justice Department’s Civil Division and the Commodity Futures Trading Commission to discuss the benefits that digital tools can bring to FOIA administration. As noted in the Justice Department’s Open Government Plan version 2.0 : One of the most...
Updated August 6, 2014
January 1, 1997
FOIA Update Vol. XVIII, No. 3 1997 OIP Guidance Guidelines for Agency Preparation and Submission of Annual FOIA Reports In enacting the Electronic Freedom of Information Act Amendments of 1996, Pub. L. No. 104-231, 110 Stat. 3048, Congress made major revisions to the part of the Freedom of Information Act, subsection (e), that pertains to the submission of annual reports by federal agencies on their administration of the Act. Congress revised the list of basic required elements for annual FOIA...
Updated August 13, 2014
Using Metadata in FOIA Documents Posted Online to Lay the Foundation for Building a Government-Wide FOIA Library On April 9, 2012, the Department of Justice released version 2.0 of its Open Government Plan which detailed the Department’s “ongoing and anticipated efforts to increase openness” and which announced new Department initiatives concerning the administration of the Freedom of Information Act (FOIA). A key FOIA initiative in the Department’s Open Government Plan is the development of...
Updated July 16, 2015
Updated August 6, 2014