Table of Contents for: Section C | Entire RFP

SECTION C

DESCRIPTION/SPECIFICATION/WORK STATEMENT


C.1 BACKGROUND

C.1.1 The Library of Congress and the National Digital Library Program

The central mission of the Library of Congress (Library or LC) is to assemble, preserve, and provide access to a universal collection representing human knowledge in order to serve the United States Congress and the American people. During the next several years, the provision of access to this collection will increasingly be accomplished via online networks and the Library of Congress will work cooperatively with other libraries and archives to establish a national digital library.

To support its growing role in online access, the Library has established the National Digital Library Program (NDLP), which has as its primary focus the conversion of historical collections to digital form. By the end of the year 2000, the Library plans to convert hundreds of thousands of its more than 100 million items. The material to be converted includes books and pamphlets, manuscripts, prints and photographs, motion pictures, and sound recordings.

As America's national library, the Library of Congress is committed to establishing and maintaining standards and practices that will support the development of the national digital library.

Table of Contents for: Section C | Entire RFP

C.2 SCOPE OF WORK

The Library requires the creation of digital images of pictorial collections and other visual media for the National Digital Library Program. These images will aid in the preservation of the information contained in the original items. After the images have been archived at the Library, a determination of their status in terms of copyright or other restrictions will be made and, for those items deemed appropriate, access to them will be provided via the Internet or other electronic means.

The delivered sets of images shall be coherently and logically named and/or numbered and shall be placed in delivery directories with prescribed characteristics. After the Library loads the images into the Library's retrieval system, the named images and directories will link the images to bibliographic records (computer catalog "cards") or to finding aids (not unlike the yellow pages in a telephone directory).

C.2.1 Workflow

Work shall be performed under either LOT 1 or LOT 2 requirements which may be awarded as one (1) or two (2) separate contracts. LOTS 1 and 2 are differentiated by image capture site. Many of the materials which shall be digitized are processed and currently available to the public. To minimize the removal of materials from use by patrons of the Library, the image capture of most collections shall be carried out on the premises of the three Library of Congress buildings on Capitol Hill under LOT 1. Work under LOT 2 shall include the Mead-Bateson photographs and, as an optional requirement historical maps scanned from microfiche, to be exercised pending availability of funding no later than December 31, 1998. The LOT 2 scanning shall be performed offsite at the contractor's facility.

Work under LOT 1 shall be performed as two (2) separate efforts at two (2) Library capture sites.

The delivery schedule and workflow requirements are provided in Section F.

C.2.2 Startup and Testing Phase

Work under both LOT 1 and LOT 2 shall begin with startup and testing activities designed to resolve various technical details and to confirm and finalize the definition of technical elements.

C.2.3 Representative Collections

The materials which shall be digitized vary. The following list enumerates a number of representative collections for which production planning is under way. The Library may add or substitute collections with similar technical requirements. Descriptions and specifications of some of the actual materials are included in the referenced Section J Attachments.

C.2.3.1 From the Prints & Photographs Division

Historic American Buildings Survey/Historic American Engineering Record (HABS/HAER) (170,000 items)--(Section J, Attachment 1)

Civil War Photographs/Prints from Reading Room Files (7,000 reflected-light items) (Section J, Attachment 3)

Baseball Card Collection (2,150 reflected-light items)--(Section J, Attachment 2)

High Demand Items/Copy Photographs (ca. 20,000 transmitted-light items)-- (Section J, Attachment 4)

Selected Presidents from Presidential File in Reading Room Files (13,000 reflected-light items)

Mead-Bateson Bali-New Guinea photographs (ca. 32,000 transmitted -light items)-- (Section J, Attachment 5)

Lomax Collection (ca. 350 reflected-light items)

C.2.3.2 From the American Folklife Center

Vance Randolph Collection (ca. 170 reflected-light items)

Todd-Sonkin Collection (ca. 30 reflected-light items)

Paterson, N.J. Field Project (ca. 200 transmitted-light items)

Nevada Field Project (ca. 200 transmitted-light items)

C.2.3.3 From Motion Picture, Broadcast, and Recorded Sound Division

Promotional movie stills (ca. 6,000 reflected-light items)

Biograph Company paper prints (ca. 70,000 reflected-light items)

C.2.3.4 From the Music Division

Leonard Bernstein Collection (ca. 25,000 reflected-light items)

Federal Theater Project negatives (ca. 9,000 transmitted-light items)

Edward and Marian MacDowell Collection (ca. 500 reflected-light items)

William Gottlieb Collection (ca. 1,500 transmitted-light items)

Gahan Opera Photographs (ca. 2,000 reflected-light items)

Miller Flute Collection photographs (ca. 2,000 transmitted-light items)

Moldenhauer Collection (ca. 1,000 reflected-light items)

Coolidge photographs (ca. 700 reflected-light items)

C.2.3.5 From the Serials Division

Pulp Fiction covers (ca. 2,000 reflected-light items)

C.2.3.6 From the Geography and Map Division - (OPTION)

Civil War maps on microfiche (ca. 3,000 transmitted-light items)--(Section J, Attachment 6)

Historical landownership maps on fiche (ca. 1,000 transmitted-light items)

The number of items indicated in the above list are approximate and represent the portion of each collection that may be digitized under this contract. Many of these collections contain other media types that will not be digitized or which may be digitized under other contracts.

Table of Contents for: Section C | Entire RFP

C.3 LIBRARY FURNISHED MATERIALS AND FACILITIES

The Library will furnish to the contractor the original materials to be scanned. Items in LOT 1 will be brought to the designated workspace(s) in the Library of Congress buildings (Madison and Adams) located on Capitol Hill. Items in LOT 2 will be packed for pickup/shipments to the contractor's facility.

The following terms describe portions or segments of materials to be digitized:

collection

A coherent group of materials as held by the Library and typically described as a unit in cataloging or finding aids. Example: the 7,000-picture Civil War photograph collection which occupies 16 vertical-file drawers.
batch
A block of materials within a collection that shall be treated as a production unit, i.e., task order and delivery requirements will be stated in terms of batches. Example: each four-drawer Civil War photograph file cabinet contains from 1,500-2,000 pictures which constitutes a batch for that collection.
scan group
A block of materials of a convenient size for Library personnel to deliver to the contractor and sufficiently large enough to provide work for one or two scanning sessions. Example: each drawer of Civil War photographs containing from 400-500 pictures constitutes a scan group for that collection.
C.3.1 LOT 1 - Work Space

For the scanning of the materials in LOT 1, the Library will provide work space, access to electrical outlets, and telephones. The work space for the LOT 1, HABS/HAER effort, will be located in the Prints and Photographs Division. This space is 5 x 25 feet and will be available for use by the contractor from 6:30 a.m. until 6:00 p.m., Monday through Friday. The workspace will include at least eight feet of shelf space with cabinet space below (see Section J, Attachment 8 for a floor plan of the workspace).

The work space for the second LOT 1 work effort will be located in the Library's Adams Building. This space will also be available for use by the contractor from 6:30 a.m. until 6:00 p.m., Monday through Friday.

C.3.2 LOT 1 - Original Items

LOT 1 materials shall be captured in scan groups. The items to be delivered to the contractor may be stored individually in various types of containers and also be stored as a group in various file drawers. The storage medium will vary from collection to collection.

Two illustrative examples are 1) the 4 x 5-inch HABS/HAER negatives which are stored in 5 x 8 x 4-inch boxes with as many as 50 of these boxes stored in a vertical file drawer; and 2) the mounted Civil War prints which are kept in vertical-file drawers, some of which are individually encased in mylar with approximately 400-500 prints per drawer.

The size of the scan group will depend upon the value of the original, its fragility, the availability of secure storage at the scanning site, and other factors. At a minimum, enough material for each day's scanning session will be provided.

For most collections of housed items, e.g., negatives in envelopes or prints in mylar, all handling and scanning labor shall be performed by contractor personnel which shall include removing items from storage containers one at a time, performing the scanning and associated record keeping, and replacing the items in the housing after capture has been completed. In some situations, such as with fragile or rare items, a Library technician will assist the operator by removing the item from the housing, handling the materials to be scanned at the time of image capture, and subsequently rehousing the original object. Task order instructions will be provided for specific collections.

Each original item furnished will be marked with a physical identification number. Prints typically have an identification number written on the back. Negatives typically have the negative number (the physical identification number for a negative) written on the storage envelope.

C.3.3 LOT 2 - Original Materials

C.3.3.1 Mead/Bateson Negatives

The Library will prepare and pack the negatives to be digitized for shipment to the contractor in batches and will notify the contractor's approved carrier when the shipments are ready. Each batch will be accompanied by an inventory that lists each original negative by negative and frame number along with the corresponding series code (unique identifier). The contractor shall validate each shipment upon receipt and return a Receipt of Materials Form (see Section J, Attachment 7). A written record shall be made of any other deviations, and the COTR shall be notified of such within 24 hrs. To minimize the potential for loss or damage to the original negatives, the Library will ship negatives in batches totaling approximately 1,400 frames at any one time. It is anticipated that no more than 4,320 negatives shall be on the contractor's premises at any one time. This will permit one incoming, one batch in production, and one batch in preparation for return. If a completed batch of digital images (shipment of 1,440) is rejected for any reason, the Library will halt further shipments to the contractor until corrections are made and the batch has been accepted.

C.3.3.2 Civil War Microfiche (Optional Requirement)

The Library will prepare and pack the fiche to be digitized for shipment to the contractor in batches and will notify the contractor's approved carrier when the shipment are ready. Each batch will be accompanied by an inventory that lists each original fiche. The contractor shall validate each shipment upon receipt and return a Receipt of Materials Form (see Section J, Attachment 7). A written record shall be made of any other deviations, and the COTR shall be notified of such within 24 hrs. To minimize the potential for loss or damage, the Library shall ship fiches in batches of about 500. It is anticipated that no more than 1,500 fische shall be on the contractor's premises at any one time. This will permit one incoming, one batch in production, and one batch in preparation for return. If a completed batch of digital images (shipment of 500) is rejected for any reason, the Library will halt further shipments to the contractor until corrections are made and the batch has been accepted.

Table of Contents for: Section C | Entire RFP

C.4 GENERAL IMAGING REQUIREMENTS

The contractor shall produce sets of digital images following both the general requirements included in Section C and also the collection specfic requirements included in the Section J, Attachments. All general requirements shall apply to both LOT 1 and LOT 2 unless indicated otherwise. Additional collection specific requirements not included will be provided as statements of work prior to issuance of task orders.

C.4.1 Mandatory Image Types--Format, Resolution, and Compression

With the exception of the cartographic images, the Library's mandatory requirement is that each original item shall be reproduced as a set of three digital images: (1) an uncompressed archival image (either 3000, 4000 or 5000 pixels--the specific type to be produced for a given collection will be stated in the task order), (2) a compressed reference image, and (3) a thumbnail image (See C.4.3.1, C.4.3.1.1, C.4.3.2, and C.4.3.3). The requirement for cartographic images is that each original item be produced as an archival image as specified in C.4.3.5 and a thumbnail image as specified in C.4.3.3.

C.4.2 Desirable Image Types

Based on an understanding that more of the information in an original item will be captured in a digital file with an extended tonal range and, additionally, that such images offer superior service as archival files and can provide publishers with better sources for printing plates, the Library has a two-part desirable requirement that involves the creation of four images instead of the three in the mandatory requirement. (There is no desirable requirement for the cartographic images.) The first part of the desirable requirement is for the creation of an archival image with a tonal range of 12 or more bits-per-pixel (36 or more bits for color) as specified in C.4.3.1.2. The second part of the desirable requirement is for the creation of a display image at the same spatial resolution as the archival image (3,000, 4,000, or 5,000 pixels) but with tonality reduced to 8 bits-per-pixel (24 bits for color) and JPEG compression applied (see C.4.3.4). This image shall serve end users who, after viewing a thumbnail (C.4.3.3) or compressed reference image (C.4.3.2), wish to view a higher resolution version of the picture, and for whom a compressed image will transmit efficiently over the Internet.

C.4.3 Image Format, Resolution, and Compression

Image requirements in terms of format, resolution, and compression for both the mandatory and desirable images are as specified below.

C.4.3.1 5UA, 4UA, or 3UA: 5000-, 4000-, or 3000-PIXEL UNCOMPRESSED ARCHIVAL IMAGES (Mandatory)

- Spatial resolution of approximately either 5,000 (5UA), 4000 (4UA), or 3,000 (3UA) pixels as specified on the image's long side--with the short side falling where it may. This resolution shall be the actual optical resolution of the capture (or a reduction therefrom) and shall not represent values achieved by interpolation.

- No sharpening or other enhancement

- Uncompressed

- "Intel" TIFF, with ver. 5.0 or 6.0 headers (content specified elsewhere in this Statement of Work)

- Must work in IBM-compatible environment

C.4.3.1.1 Mandatory Tonality

- Tonal (pixel-depth resolution): Color: 24 bits-per-pixel; black and white: 8 bits-per-pixel

C.4.3.1.2 Desirable Tonality

- Tonal (pixel-depth resolution): Color: 36 or more bits-per-pixel; black and white: 12 or more bits-per-pixel

C.4.3.2 CRI: COMPRESSED REFERENCE IMAGES (Mandatory)

- Spatial resolution approximately 640 pixels on the image's long side--with the short side falling where it may. This resolution shall be the actual optical resolution of the capture (or a reduction therefrom) and shall not represent values achieved by interpolation.

- Tonal (pixel-depth resolution): Color: 24 bits-per-pixel; black and white: 8 bits-per-pixel

- Sharpen or other enhancement shall be at a level as defined and determined during the contract startup and test activity

- JPEG compression to yield average compression of 10:1 for grayscale and 15:1 for color

- JFIF format/headers

- Must work in IBM-compatible environment

C.4.3.3 THM: THUMBNAIL IMAGES (Mandatory)

- Spatial resolution approximately 150 pixels on the image's long side--with the short side falling where it may.

- Tonal (pixel-depth resolution): 8 bits-per-pixel

- Palettes optimized (adaptive palettes) for each image

- Sharpen or other enhancement shall be at a level as defined and determined during the contract startup and test activity

- Uncompressed

- "Intel" TIFF, with ver. 5.0 or 6.0 headers (content specified elsewhere in this Statement of Work)

- Must work in IBM-compatible environment

C.4.3.4 5DI, 4DI, or 3DI: 5000-, 4000-, or 3000-PIXEL COMPRESSED DISPLAY IMAGES (Desirable)

- Spatial resolution of approximately of either 5,000 (5DI), 4000 (4DI), or 3,000 (3DI) pixels as specified on the image's long side--with the short side falling where it may. This resolution shall be the actual optical resolution of the capture (or a reduction therefrom) and shall not represent values achieved by interpolation.

- Tonal (pixel-depth resolution): Color: 24 bits-per-pixel; black and white: 8 bits-per-pixel

- Sharpen or other enhancement shall be at a level as defined and determined during the contract startup and test activity

- JPEG compression to yield average compression of 10:1 for grayscale and 15:1 for color

- JFIF format/headers

- Must work in IBM-compatible environment

C.4.3.5 CUA: CARTOGRAPHIC UNCOMPRESSED ARCHIVAL IMAGES (OPTION)

- Spatial resolution of 300 dpi as measured against the original paper map that has been copied onto a 105mm fiche (see Section J, Attachment 6). The scanning resolution applied to the fiche shall be high enough to yield 300 dpi when the fiche reduction ratio is considered and shall be the actual optical resolution of the capture and shall not represent values achieved by interpolation. Image-tile concatenation may be required to produce these images.

- Sharpen or other enhancement shall be at a level as defined and determined during the setup activity for this collection

- Uncompressed

- "Intel" TIFF, with ver. 5.0 or 6.0 headers (content specified elsewhere in this Statement of Work)

- Must work in IBM-compatible environment

- Tonal (pixel-depth resolution): Color: 24 bits-per-pixel; black and white: 8 bits-per-pixel

C.4.4 Image Tonal Range

The tonal range of the delivered digital images delivered shall be representative of the original scene or artifact or, in the case of images whose source is a photographic negative, of the expected representation of the original scene when the negative is reproduced as a positive print.

Providing images with acceptable tonal qualities shall require that the scanning operator exercise judgement when producing the images. The operator's judgement required to achieve the required outcome shall be especially critical when imaging color items. Utilization of general imaging industry standards and those as agreed to and established during the contract startup and testing phase shall be followed. Additionally, consultation

with Library staff may, when necessary, be required in order to ensure that appropriate operator judgements are made throughout the run of a particular batch or scan group.

C.4.4.1 Tonal Value (Mandatory)

Tonal value for all mandatory images and the desirable compressed display image shall be as follows:

C.4.4.2 Tonal Value (Desirable Archival Image)

The tonal value for the desirable archival images shall be as follows:

C.4.5 Deriving the Reference and Thumbnail Images

The requirements for tonal representation shall apply to all three (archival, reference and thumbnail) images. The reference and thumbnail images, however, shall be reduced in scale and shall be sharpened, compressed, and color-indexed as applicable. The methods or techniques to be used to provide this additional image processing shall minimize image degradation and also produce derivative images that maintain the general look and character of the archival images.

C.4.6 Requirements Subject to Measurement

The image-capture system used to produce the images shall meet certain requirements that pertain to spatial resolution, tonal distribution, and noise (signal to noise ratio; meaning how many bits of the stored file are actual image information and how many bits are random noise of the system). Spatial resolution is determined by measuring the modulation transfer function (MTF) of the capture system. This will enable the Library to ensure that the delivered files have the required resolution and were not sampled up from a lower resolution; for example, an image produced from an 8x10-inch photograph at 3,000-pixels shall have a spatial resolution that is truly 300 dpi and was not sampled up from a 200 dpi file. The measurement of tonal distribution (C.4.6.2) shall confirm that the capture system is capable of capturing images that have the full range of tones as specified in the requirements above. The measurement of noise (C.4.6.3) shall ensure that the capture system produces a signal that includes as much image information as possible.

C.4.6.1 Modulation Transfer Function

The measured MTF shall have values which fall within the ranges given in the following table, at the given spatial frequencies:
FrequencyMTF
10.90 to 1.0
20.80 to 1.0
30.70 to 1.0
40.60 to 1.0
50.50 to 1.0
60.40 to 1.0
80.30 to 1.0
100.20 to 1.0

C.4.6.2 Tonal Resolution

For mandatory images (8-bit grayscale), the digital values should be linear to the original density. The digital values for each area on the grayscale target shall not deviate by more than 10 from a linear least squares regression line fitted between the densities of the original target and the digital output values. A white area shall have values of r=243-250, g=243-250, and b=243-250, and a black area shall have values of r=5-12, g=5-12, and b=5-12. Care should be taken that no clipping (= loss of details) in either the highlights or the shadows occurs.

For desirable images the digital values should be linear to reflectance / or transmittance. A white area shall have values of r=4070-4086, g=4070-4086, and g=4070-4086, and a black area shall have values of r=5-15, g=5-15, and b=5-15. Care should be taken that no clipping (= loss of details) in either the highlights or the shadows occurs.

C.4.6.3 Baseline Values for Noise, Flare, and Geometry

Measurement of the evaluation benchmark test (Section M.2.2) of the target images (Section C.4.6.4) will establish baseline values for noise, flare, and scanner geometry. These baseline values shall not deterioriate during the period of performance, i.e., noise and flare shall not increase nor geometry be adversely affected.

As indicated in Section C.7.5.2, the contractor shall include newly scanned images of the target set with each batch of images delivered to the Library, for use in determining that the baseline values are maintained. The Library will notify contractors if the values are not maintained. The contractor shall then take steps to bring the values to the levels measured earlier.

C.4.6.4 Targets for Objective Measurement

The conformance of the contractor's system to the preceding requirements shall be determined by measuring images of the target sets described below. The target sets and the measurement tools have been provided by the Image Permanence
Institute (IPI) of Rochester, NY.

C.4.6.4.1 Transmitted light target set

The transmitted light target set will include the following elements:

  • Sine Patterns M-6-60, size 46 x 70 mm (for larger format originals, used for Lot 1 evaluation)

  • Sine Patterns M-7-60, size 21.5 x 30 mm (for smaller originals, used for Lot 2 evaluation)

    The Sine Pattern target contains four rows of patterns. The top row contains seven different transmittance density patches. The next two rows contain sine wave patterns with different spatial frequencies, and the bottom row contains seven additional different transmittance density patches. Each target is calibrated individually by the manufacturer.

  • Target consisting of 12 different gray density patches on a middle gray background (for digital cameras).

  • Target that includes a gray scale and a white, a gray, and a black area (for linear array scanners).

    C. An Additional target.

  • Knife-edge target for resolution measurement; this target will allow for an additional measurement of the spatial resolution using a different approach than the sine wave target. The target necessary consists of a slightly tilted sharp edge. The results can be compared to readings from the Sine Patterns targets (A. above); the knife edge target responds differently to image sharpening and improper resampling methods and helps determine if post-scan processing has been applied.

  • Additionally, the targets shall be evaluated for scanner noise, scanner geometry, and flare.

    C.4.6.4.2 Reflected light target set

    The reflected light target set will include the following elements:

  • Sine Patterns M-13-60 (1x), size 47x70 mm.

    The target contains four rows of patterns. The top row contains seven different reflectance density patches. The next two rows contain sine wave patterns with different spatial frequencies, and the bottom row contains seven additional different reflectance density patches. Each target is calibrated by the manufacturer.

    Same types as transmitted light target set above, except these are manufactured for reflected light readings.

    Same type as transmitted light target set above, except this has been manufactured

    for reflected light readings.

    DELETED

    C.4.7 TIFF Header Requirements

    TIFF version 5.0 shall be satisfactory; version 6.0 may be substituted as samples during project startup and is subject to acceptance by the Library. The Library uses the TIFF tags listed below. "Typical" or "expected" data are provided for most tags. Exceptions to the norm are noted in the comments column.

    Description Tag Comments
    NewSubfileType 254
    ImageWidth 256 actual pixel count
    ImageLength 257 actual pixel count
    BitsPerSample 258
    Compression 259
    PhotometricInterpretation 262
    DocumentName 269 collection identifier and filename* (Ex. bbc/0421ft.tif)
    StripOffsets 273
    SamplesPerPixel 277
    RowsPerStrip 278
    StripByteCounts 279
    XResolution 282 **
    YResolution 283 **
    ResolutionUnit 296 **
    DateTime 306 date and time scanned
    Artist 315 Library of Congress

    * Each collection identifier is a designation which shall also be used as part of the CD-ROM volume names (see C.9.2).

    ** At least two options exist for tags 282, 283, and 296, either one of which is acceptable:
    Option 1 (often used for full-size uncompressed images)
    Xresolution 282 actual pixel count
    YResolution 283 actual pixel count
    ResolutionUnit 296 1 (no unit specified)
    Option 2 (often used for thumbnail images)
    Xresolution 282 dots per inch
    YResolution 283 dots per inch
    ResolutionUnit 296 2 (inch)

    In order for the digital images to open in all software packages, the TIFF header tags shall be sorted into ascending numerical order.

    C.4.8 Cropping

    The Library wishes to provide researchers with a reproduction of the entire original item. Thus, images shall be framed and cropped to show the entire original item and beyond the item's edges. For negatives or other transmitted light items, each digital image shall reproduce that item's actual-image area, the border on the film that surrounds the image area, and a portion of the background (light box or scanner top) beyond the edge of the film. A similar approach shall be followed for reflected-light items; the whole print, whole mount, and a portion of the background (beyond the mount) shall be reproduced.

    In the delivered images, the amount shown beyond the edge of the item shall be no less than 1.5 percent of the dimension of the long side image. Thus, for a 3,000 x 2,000-pixel image, the border beyond the reproduction of the original item shall consist of approximately 35 pixels on all four sides; for a 640 x 480-pixel image, the border shall consist of approximately 10 pixels on all four sides.

    Exceptions to these requirements may be required for some collections as indicated in C.4.8.1 below and in Section J, Attachments 5 and 6 for LOT 2 collections.

    C.4.8.1 Cropping - Multiple Items on a Single Mount

    When multiple prints are mounted on a single board, e.g., eight Civil War portraits on one cardboard mount or three small prints mounted on a single scrapbook page, each image on a multiple-print mount shall be captured separately. Framing for each print shall extend beyond the image proper in a manner consistent with the cropping instructions in Section C.4.10. Specific task orders may additionally require the production of an image that captures the full physical item, i.e., a Civil War mount with eight portraits or a full scrapbook page with three prints.

    C.4.9 Concatenation in Civil War Maps (LOT 2 - Optional Requirement)

    In order to achieve the required spatial resolution of the Civil War maps (or other historical maps) to be scanned from microfiche in LOT 2, the contractor may have to capture tiles or segments of the map images on the fiche and concatenate (stitch or join) these segments when producing the digital images to be delivered to the Library. See Section J, Attachment 6 (6.4.2) for specific requirements regarding concatenated images of the Civil War maps.

    Table of Contents for: Section C | Entire RFP

    C.5 GENERAL NAMING REQUIREMENTS FOR FILENAMES, DIRECTORIES, AND ASSOCIATED DATABASES

    In the Library's retrieval system, each catalog record includes a collection identifier (also called an "aggregate name") and a digital item identifier for the picture therein described. Together, the two identifiers are used by the retrieval system to fetch the image from the server in which the image is stored. The identifiers are considered the beginning and ending levels in a UNIX pathname, and the Library has established a set of "naming rules" to identify one or more directories that form the intervening (middle) levels of the pathname.

    The delivered images will be loaded into the server by copying them en masse from the contractor's delivery disks. The contractor shall assign the correct name to each image and shall place sets of images into correctly named and organized directory structures in accordance with general specifications for determining the sets of identifiers and names outlined below and in accordance with detailed naming instructions to be provided for each collection.

    C.5.1 Image Filenames

    Excluding the images of the Civil War maps for which specific naming requirements are specified in Section J, Attachment 6, the filename assigned to each image, the first four to seven characters, shall consist of the digital item identifier. The final character before the "." shall indicate the image category (e.g., uncompressed archival version) and the filename extension shall indicate the image file format.

    For each set of images (uncompressed archival image, compressed reference image, and thumbnail image) that reproduces the same source item, the filenames shall end as follows:

    For the desireable images, the eighth character and extension shall be:

    The filenames for each image in a set shall begin with the same digital item identifier. For example, the digital item identifier for one of the negatives from the state of Alabama in the HABS/HAER collection is 414634p. The image files that reproduce this item shall be named 414634pu.tif (uncompressed archival image), 414634pv.jpg (desireable compressed display image, if offered), 414634pr.jpg (compressed reference image), and 414634pt.tif (thumbnail image).

    C.5.2 Image Directory Structures

    The directory structure which shall be created for the storage of the image files shall be as specified for each collection. For example, for the HABS/HAER collection, the directory path, al/al0800/al0897/photos, shall contain the image files associated with the digital item identifiers 414631p through 414640p. An explanation of the elements in the pathname follows:

    C.5.3 Databases or Computerized Inventories

    Naming instructions will specify whether a Library existing database shall be ungraded or a new database or computerized inventory is required. When naming instructions are provided for an existing database, new content shall be entered into the database. Section C.5.3.1 provides an illustrative example of such a database. Specific instructions will be provided for each collection.

    When naming instructions require the contractor to examine marked items, the contractor shall create a new database enumerating the items and numbers assigned. In this database, the contractor shall enter the number or other mark on the original item in one field of a given data record and enter the file identifier used to name the set of image files

    in another field. For some collections it may be required that these two data elements be linked to the identifier for the directory in which the images are stored.

    For either an existing or newly created database, the contractor shall record notes that pertain to the production work at hand, e.g., a note about the condition or characteristics of the items being captured, or any other type of record keeping that may be useful in the production process. All information recorded in the database shall be included in the version delivered to the Library with the images.

    Delivered databases shall be in a format capable of being loaded into common software, e.g., a comma-delimited ASCII file that can be loaded into Paradox or dBASE.

    C.5.3.1 LOT 1- Collections With Pre-existing Databases

    When the Library has a pre-existing database for the collection, it will be provided to the contractor in a format capable of being loaded into common software, e.g., a comma-delimited ASCII file that can be loaded into Paradox or dBase. Typically, the database will contain core information about the items or groups of items. The contractor shall add information to the database as images are captured, e.g., the names actually assigned to the files. As in the illustrative example below, some databases may contain single records that represent a group of item. In these cases, the contractor shall "clone" the record for each

    item actually captured before entering the identifier for that item (see notes for data elements 2, 3, and 7 in the example below).

    For illustration, the following outline lists the fields in the HABS/HAER database and indicates how data shall be entered.

    HABS/HAER Photograph Database
    Field Field Content

    1. Control number (directory identifier), e.g., AL0897
    In the database to be provided to the contractor. To be used by the contractor to name the directory for the images. The control number is unique in the database.

    2. HABS survey number, e.g., AL-889
    In the database to be provided to the contractor. Items to be scanned shall be marked with this number. See also number data element 7 below. The survey number is unique within this field of the database, but a survey number with the same value may appear as a HAER survey number also.

    In this collection, there are about 25,000 HABS surveys; the database as delivered to the contractor will contain 25,000 HABS-related data records.

    3. HAER survey number, e.g., MD-24
    In the database to be provided to the contractor. Items to be scanned shall be marked with this number. The survey number is unique within this field of the database, but a survey number with the same value may appear as a HABS survey number also.

    In this collection, there are about 10,000 HAER surveys; the database as delivered to the contractor will contain 10,000 HAER-related data records.

    4. Number of negatives
    In the database to be provided to the contractor. This is a net quantity for all sizes; no comparison of this number against the number of images actually captured can occur until all negative sizes have been scanned. This information may not be reliable and is being provided to the contractor for general guidance only.

    5. Number of 4x5-inch color transparencies
    In the database to be provided to the contractor. This information may not be reliable and is being provided to the contractor for general guidance only.

    6. Library of Congress shelflist number.
    All negatives and transparencies are sorted in shelflist order. The shelflist code will also appear on all negative sleeves and provides further item identification confirmation. The data will be sorted on this field to match the order of capture.

    7. Digital item identifier for link to the digital image filenames,
    e.g., 414634p. This identifier shall be used to assign the names
    to the files 414634pu.tif, 414634pr.jpg, and 414634pt.tif.
    Serial numbers shall assigned to each item by the contractor and added to the database. The identifier shall be established by and entered into the database by the contractor.

    The contractor shall clone a new data record for each new item. The database will contain about 35,000 records (25,000 HABS and 10,000 HAER) when delivered to the contractor. The collection contains nearly 200,000 items and the final database returned to the Library shall contain nearly 200,000 individual data records, each with a unique number entered as the item-level identifier.

    8. Item or photo number as written on negative or transparency
    storage sleeve, e.g., "2" from the full written entry "AL-889-2"
    Shall be added to the database by the contractor at time of image capture. These numbers may repeat; the data shall be entered as written.

    9. Note
    Field for contractor to note line negatives or other anomalies as well as to copy any written information on negative sleeves that pertains to rights or restrictions.

    10. Restrictions indicator field
    To be checked when restriction information is encountered.

    11. Color indicator field
    To be checked when color originals are scanned.

    C.5.3.2 LOT 1- No Existing Database

    The contractor shall refer to the physical identification number on each original item in order to determine the digital item identifier. The original items will be marked in some way with a unique number, e.g., files of negatives have numbers written on the envelopes or Civil War prints have numbers pencilled on the backs of the mounts. Instructions will be provided for the translation of the physical identification number into the digital item identifier which shall be completed at scan time. For example, for a copy negative in an envelope marked LC-USZ62-134356, the identifier will be 3c34356 and the three files to be created shall be named 3c34356u.tif, 3c34356r.jpg, and 3c34356t.tif. The rule for this

    example is that the last five digits of the physical identification number shall become the basis for the identifier, with a designated prefix to be added. Instructions will also be provided for naming directories to contain the files. For the above example, the contractor shall create the directory structure, 3c30000/3c34000/3c34300.

    Table of Contents for: Section C | Entire RFP

    C.6 GENERAL HANDLING AND SCANNING REQUIREMENTS

    C.6.1 LOT 1 - Photographic Negatives and Transparencies (transmitted-light items)

    For LOT 1, the format for the bulk of the black-and-white photographic negatives to be scanned is medium-format (4x5 and 5x7 inches) safety film. The scan groups to be provided for the HABS/HAER collection will not be completely sorted by size, see Section J, Attachment 1.2.1. Other negatives range in size from 35mm to 8 x 10 inches. A portion of the HABS/HAER collection negatives have nitrate and/or diacetate film bases. Work with nitrate based film shall be completed in accordance with the special handling rules and requirements in Section D.3, page D-1.

    Some of the 35mm strips of film are stored in PrintFile storage pages; and, in some cases, the entire PrintFile enclosure shall be scanned (plastic and negatives) to create a digital image that "looks like a contact sheet." Individual frames shall also be imaged, and these images shall be made through the plastic PrintFile material.

    Color transparencies and color negatives range in size from mounted 2 x 2-inch slides to 8 x 10-inch sheet films. Color film materials are typically housed in mylar jackets or sleeves within an additional paper sleeve. Color slides are often housed in 20-slide translucent plastic racks. In the racks, the slides are held in place along their edges; and the image is fully exposed to view from the top. In some cases, it may be required that the entire plastic slide rack be imaged "like a contact sheet." To accomplish this, some ambient lighting shall be applied as a supplement to the lighting from below, in order to make the identification numbers written on the slide mounts legible.

    All film-based materials, such as black-and-white photonegatives and color transparencies not in mylar sleeves shall be handled with cotton gloves and resleeved into their original housings. When rehousing, the emulsion side of film items shall face the non-sealed side (the side without an adhesive seam) of the sleeve or jacket.

    C.6.2 LOT 1 - Photographic Prints and Other Graphic Print Materials (Reflected-light Items)

    The established workflow shall be capable of accommodating item-to-item size variation.

    Collections of prints and other printed graphic materials include items with great variation in size. For LOT 1, the smallest items to be captured include baseball cards approximately

    1 x 2 inches and a pictorial button approximately 1-inch in diameter. No items larger than

    11 x 17 inches shall be scanned.

    Items in reflected-light collections are rarely grouped by size, i.e., there will often be considerable item-to-item size variation in a given collection. For example, in the Civil War prints, a 6 x 9-inch print on an 11 x 14-inch mount may be followed by eight 2.5 x 3.5-inch prints on a single 11 x 14-inch mount, followed by an unmounted 8 x 10-inch print in a mylar housing.

    C.6.2.1 Condition of Reflected-light Items

    Items identified as either fragile or having non-planar surface shall not (1) be flattened against or under glass or (2) turned face down for capture. The mounts are sometimes fragile and often non-planar, i.e., curved, cupped, or warped. The latter terms refer to deviations from a flat plane: Curved means that the mount is curved on one axis (the mount presents the appearance of a rocker in cross-section); cupped means the mount is curved on two axes; and warped means that the mount bears multiple or irregular distortions. Mounted stereographs, for example, are typically curved. The mounts may also be torn, broken, or brittle.

    C.6.3 LOT 1 - Handling and Scanning

    The capture device(s) to be utilized shall not cause harm to the materials being scanned. Harm may be caused by such factors as excessive handling, inversion of fragile items, flattening, surface abrasion, excessive illumination, and excessive heat.

    The prohibitions on flattening and inverting non-planar reflected-light original items eliminate the universal use of flatbed scanners and glass plates to flatten items. Although flatbed scanners may be acceptable for the capture of transmitted-light items (and some reflected-light items), alternatives such as digital cameras that offer sufficient depth of field to keep non-planar items in focus shall be utilized for significant portions of this project. In addition, many items will be housed in mylar sleeves and, in some case, shall not be removed for capture. Therefore, the scanning device shall be capable of capturing images through mylar.

    C.6.4 LOT 2 - Original Materials

    C.6.4.1 Mead/Bateson Negatives

    The Mead/Bateson materials consist of 3-foot strips of 35mm film, each containing from 30-40 individual negatives. A custom setup will be required to capture the individual frames on these strips. The requirements for handling are similar to those outlined for LOT 1.

    The capture device(s) shall not cause harm to the materials being scanned. Harm may be caused by such factors as excessive handling, inversion of fragile items, flattening, surface abrasion, excessive illumination, and excessive heat.

    C.6.4.2 Civil War Map Fiche (Option)

    The Civil War map fiche consists of 105mm color Cibachrome microfiche. The capture device(s) shall not cause harm to the materials being scanned. Harm may be caused by such factors as excessive handling, surface abrasion, excessive illumination and excessive heat.

    C.6.5 LOT 2 - Handling and Scanning

    C.6.5.1 Mead/Bateson Negatives

    The Mead/Bateson negatives require extreme care in shipping and handling (See D.3). Shipments to and from the Library shall be made via an accepted overnight carrier, or in a vehicle with an ambient temperature of between 65 and 70 degrees F if within a reasonable distance from the Library. If the latter conveyance is used, during transportation the materials shall be under the personal surveillance and in the custody of either 1) a representative of the contractor, or 2) under the custody and personal surveillance of a courier/delivery service which has been approved by the Library. The contractor shall be responsible for all shipping costs of pickup and return of Library materials and deliverables. Original negatives and their corresponding deliverables shall be transported in separate shipment for return to the Library. The replacement cost for each negative has been determined to be $150.00 per frame.

    C.6.5.2 Civil War Maps on Fiche (Optional Requirement)

    The Civil War map fiche require care in shipping and handling. Shipment to and from the Library shall be made via an accepted overnight or next-day carrier that has been approved by the Library. The contractor shall be responsible for all shipping costs of pickup and return of Library materials and deliverables. The replacement cost for each fiche has been determined to be $100.00.

    C.6.5.3 Contractor Facilities

    While on site at the contractor's facilities, the contractor shall store all Library property in a locked vault (except during periods of actual contractual work) and secure it from theft or damage.

    C.6.5.3.1 Special requirements for Mead/Bateson negatives

    The Mead/Bateson negatives shall be stored in vaults that are temperature and humidity controlled; the temperature shall be 55 to 70 degrees, +/- 5 degrees within a 24-hour period and the relative humidity between 30 and 50 percent, +/- 5 percent within 24 hours. Verification that these conditions exist must be certified and submitted in writing prior to startup of production. Thereafter, on a weekly basis and within 24 hours of obtaining this reading, the contractor shall provide to the COTR a written record of the daily high and low temperature and humidity reading in the storage area(s) for that period. Should any deviation from the required conditions arise, the contractor shall immediately initiate corrective measures to ensure the safety of the negatives, and notify the COTR and/or the Contracting Officer of the situation. Scheduled deliveries of original film negatives shall be delayed until environmental conditions have been restored to the stated temperature and humidity ranges discussed in this section.

    Table of Contents for: Section C | Entire RFP

    C.7 WORKFLOW AND PROJECT MANAGEMENT

    C.7.1 Contract Startup and Testing

    Because of the complexity of the requirements and the variation in the Library's original materials, a startup and testing phase shall be the first task to be performed under contracts for both LOT 1 and LOT 2. The startup and testing phase shall provide a time during which the contractor and NDLP staff shall work together to address and finalize a mutually agreed upon definition of particular matters related to technical requirements and to confirm this understanding through sample work. Technical elements include but are not limited to:

    C.7.2 LOT 1 - Startup and Testing Phase

    The HABS/HAER collection and the baseball cards will be used as representative examples of the types of materials from which digital images shall be produced. The following

    materials accompanied by instructions regarding the filenaming and directory structure to be employed will be provided to the contractor:

    1. 50 4x5-inch negatives from the HABS/HAER collection.

    2. 20 8x10-inch negatives from the HABS/HAER collection.

    3. 20 cards from the baseball cards collection.

    C.7.2.1 Actions

    The LOT 1 startup and testing phase shall include the following actions:
    Initial Meeting The COTR and other NDLP and Library staff members will meet with the contractor to discuss startup and testing activities and to present the 90 sample items.
    System setup The contractor shall set up and test the system(s) to be used for Lot 1. The time allotted for this setup shall be as proposed and agreed to prior to contract award.

    Weeks after completion of system setup and testing:
    Week 1 The contractor shall scan the 90 items, assigning names to files and placing them in directories as specified. The images shall be placed on a CD-ROM marked in accordance with delivery specifications. For the selections from the HABS/HAER, data shall be input into an existing database furnished by the Library.
    Week 2 The images and associated database shall be delivered to the Library.
    Week 3 The Library will complete quality review of the image samples and database and provide a brief preliminary written response concerning acceptability to the contractor.
    Week 4 The contractor project manager and other contractor designated staff shall meet with the Library COTR and other NDLP staff to discuss the samples provided and to resolve any questions that may remain.

    C.7.3 LOT 2 - Startup and Testing Phase

    Two (2) rolls of original Mead/Bateson negatives and one (1) roll of original Mead/Bateson interpositives (also called diapositives) will be provided to the contractor.

    C.7.3.1 Actions

    The LOT 2 startup and testing phase shall include the following actions:
    Activity start The Library will ship three (3) rolls of original materials and a copy of the database to the contractor.
    Week 1 after receipt The contractor shall examine the three rolls and meet with the COTR and other NDLP and Library staff members to discuss the various issues to be addressed during the startup and testing activities.
    System setup The contractor shall set up and test the system(s) to be used for LOT 2 in the time proposed and agreed upon prior to award.

    Weeks after completion of contractor system setup and testing
    Week 1 The contractor shall scan the 3 rolls, assigning names to files and placing them in directories in accordance with the specifications. The items shall be placed on a CD-ROM disk that is marked in accordance with the delivery specifications. The contractor shall input digital item identifiers into the supplied database.
    Week 2 The contractor shall ship the images and the database to the Library.
    Week 3 The Library will complete a review of the image samples and database and provide a brief preliminary written response concerning acceptability to the contractor.
    Week 4 The contractor's project manager and other contractor staff meet with COTR and NDLP and other Library staff members to discuss the samples provided and to resolve any questions that may remain.

    C.7.4 Task Orders

    The production of digital images shall be performed under task orders issued under this contract. Task orders may include one or more jobs, i.e., separate and distinct digitization activities. For example, a single task order may include two jobs: (1) the digitization of a set of negatives from one part of the Library and (2) the digitization of a set of magazine covers from another part. Each job will be all or part of a specific NDLP collection project and may consist of multiple batches (see C.3).

    C.7.4.1 Technical Preparation for Individual Task Order Jobs

    Each job shall treat a coherent body of material and may require a technical setup phase prior to the issuance of a task order. During this phase, the COTR and the contractor's project manager shall resolve any outstanding issues or technical matters pertaining to the effort and shall establish other requirements, including but not limited to, the period of performance, delivery dates, batch sizes for deliverables, and the details of the database for the project. In addition, the contractor may be required to prepare a database format and provide 10-20 sample digital images that display technical solutions and levels of quality for the Library's inspection. Reimbursement for the sample images and technical labor for database preparation shall be in accordance with the contract, Section B, Schedule of Pricing.

    C.7.5 Contractor Quality Control Program

    A quality control program in accordance with the requirements for accuracy and delivery shall be initiated, documented, and maintained throughout the life of this contract. The Library expects that the contractor shall perform quality control for 100 percent of deliverables. A specific quality control plan shall be implemented for each phase of contract performance beginning with capture of images and ultimate acceptance by the Library of all deliverables. In addition, the contractor shall be responsible for inspecting the accuracy of filenames and directories for all digital images produced under this contract. Inspection hardware and software shall be of appropriate quality, accuracy, and quantity to ensure that all requirements of this contract are met.

    The contractor shall document all quality control procedures, including actions taken to correct any problems, and submit a quality control report with or as a part of the database with each delivery to the Library. This quality control report must enumerate and describe actions taken.

    C.7.5.1 Contractor Quality Review: Imaging - LOT 1 and LOT 2

    Contractor quality review shall include, but is not limited to, the following types of activities:

    C.7.5.1.1 Image Quality

    Acceptance criteria shall include but not be limited to a review of the following:

    C.7.5.1.2 Other factors

    Other factors related to the performance of the contract specifications shall include:

    C.7.5.2 Objective Measurement - Test Targets

    The Image Permanence Institute of Rochester, NY, has created test target sets for the Library of Congress; these are described in Section C.4.6.4. In order to permit the objective evaluation of the capture system as a part of the contractor's quality control program and by the Library's quality review, the contractor shall provide a scanned image of the target set appropriate to the job at hand with each delivered batch of materials.

    C.7.5.3 Rework

    Rework means the scanning of replacements for unacceptable digital images. For rework, the contractor shall follow all contract specifications and specific task specifications as agreed to for the original scanning and for the filename/directory structure, unless otherwise directed by the Library's COTR. (See Section C.9.6)

    Table of Contents for: Section C | Entire RFP

    C.8 RELATED SERVICES

    C.8.1 Programming and Processing Activities

    The capability to provide different levels of technical expertise is required. It is anticipated that additional programming or processing steps associated with scanning or database requirements may be necessary. These tasks may require different levels of technical expertise which will be specified for task orders as applicable.

    In addition to the preproduction analysis, these activities will fall into two general categories:

    The contractor shall provide needed labor to carry out these related services by supplying a technician, computer programmer, or project leader as applicable.

    Table of Contents for: Section C | Entire RFP

    C.9 DELIVERABLES AND DELIVERY

    C.9.1 Types of Deliverables

    The work to be performed shall yield deliverables of the types listed below. These will vary slightly from collection to collection.

    The general types of deliverables shall include:

    C.9.2 Delivery Identification

    A disk name shall be assigned to each CD-ROM used to deliver images. The disk name shall be composed of the collection identifier (to be provided by the Library) and a three-digit serial number starting with 001. This disk name shall be assigned as the computer-

    encoded volume name for the disk (when the disk is formatted) and also written on the disk and its container with indelible ink. For example, disk/volume names for images in the Baseball Card Collection may be bbc001, bbc002, etc. and habshaer001, habshaer002, etc. for images in the HABS/HAER Collection

    C.9.3 Delivery Media

    Digital images shall be delivered on write-once CD-ROM disks compatible with all ISO 9660 specifications except that the Library requires the use of lower-case letters in directory and file names, in contravention of ISO 9660. Each CD-ROM and accompanying jewel case shall be labeled with the collection name, disk (volume) name, date completed, and the indicator Library of Congress.

    C.9.4 Delivery Filenames and Directories

    Each CD-ROM shall contain DOS files organized in DOS directories as indicated in the general guidelines in C.4 and the collection specific guidelines as provided.

    C.9.5 Main Delivery/Alpha Disks

    Delivery batches of one or more write-once CD-ROMs as the digital images are completed and written to CD-ROM, shall be shipped to the Library as alpha disks, defined as the first delivery of the image sets. The alpha disks will be retained by the Library.

    C.9.6 Delivery of Rework

    Unacceptable (rework) images shall be delivered on rework disks. If a rework batch consists of a small number of images, delivery may be on floppy disks or a new write-once CD-ROM. Separate floppy rework disks or rework CD-ROMS shall be produced for each collection (to facilitate archiving of the disks by the Library of Congress). Each rework disk shall be named and marked in a manner similar to that used for the main delivery disks, with the letter r added as the last character in the name and the word rework written on the disk label. Rework disks shall not contain any previously accepted image files.

    C.9.7 Shipment Documentation

    Each shipment of digital files on CD-ROMs shall be accompanied by directory and filename lists of the contents of each CD-ROM. The filename list shall contain file sizes and the date and time of creation information for each file.

    C.9.8 Return of Government Furnished Materials

    All products developed under this contract shall belong to the U.S. Government, including the proprietary rights therein. (See H.1, Release, Publication, and Use of Government Furnished Materials, page H-1) The contractor shall return to the Library all original materials in good condition.

    C.9.9 Replacement of Items

    For some collections, the Library will be furnishing the contractor the only or the best existing copy of a unique item. If the version furnished to the contractor is lost or destroyed, and if materials exist that can be used to prepare a replacement, the contractor shall pay the cost of having the Library's Photoduplication Service (or an equivalent provider) create a new copy of the best type possible, working from the best source version available to the Library, and also the cost of making an additional duplicate that will be provided to the contractor to complete the task of producing digital images.

    In other cases, the Library may already hold a copy color transparency or black-and-white negative. If so, and if the contractor loses or destroys the material originally furnished, the contractor shall pay the cost of having the Library's Photoduplication Service produce a suitable duplicate transparency or print from the copy on hand. This duplicate or print will then be furnished to the contractor for use in producing the digital image.

    C.9.10 Intermediate Production Formats and Duplicate Digital Files

    The contractor shall deliver to the Library any intermediate materials produced in the course of preparing the required images. This may include intermediate film copies, check prints, or other output. These intermediate materials shall be labeled in a systematic way. Documentation in the form of logs or inventory sheets shall be supplied.

    Although the contractor may retain copies of the digital scanned files created as working backups, at the end of the contract period, the contractor shall erase or destroy all backup or duplicate files and materials.


  • Table of Contents for: Entire RFP