Nils Nieuwejaar and David Kotz. Low-level Interfaces for High-level Parallel I/O. Technical Report PCS-TR95-253, Dartmouth Computer Science, March 1995. Revised 4/18/95 and appeared in IOPADS workshop at IPPS '95.

Abstract: As the I/O needs of parallel scientific applications increase, file systems for multiprocessors are being designed to provide applications with parallel access to multiple disks. Many parallel file systems present applications with a conventional Unix-like interface that allows the application to access multiple disks transparently. By tracing all the activity of a parallel file system in a production, scientific computing environment, we show that many applications exhibit highly regular, but non-consecutive I/O access patterns. Since the conventional interface does not provide an efficient method of describing these patterns, we present three extensions to the interface that support strided, nested-strided, and nested-batched I/O requests. We show how these extensions can be used to express common access patterns.

Keywords: parallel-IO, parallel computing, file system


PDF (293K)

Copyright © 1995 by the authors.

Identical to nieuwejaar:strided2.

See also earlier version nieuwejaar:strided.