ALMA SSR Requirements for the AIPS++ Benchmark Effort

ALMA SSR Requirements for the AIPS++ Benchmark E ort
Version: Aug 14, 2003
The ALMA Science Software Requirements (SSR) committed has identi ed four requirements re-
lating to benchmarking AIPS++ performance:
2.1.1 R4 - The performance of the Package shall be quanti able and commensurate with
the data processing requirements of ALMA output and the scienti c needs of users at a given
time. The timing and reproducibility of results for a ducial set of reduction tasks on speci ed
test data will be benchmarked and compared against other packages and a list of benchmark
speci cations shall be provided and maintained by the Project.
2.2.2 R1.1 - The GUI shall provide real-time feedback via standard compact displays. Win-
dow updating must be fast (less than 0.1s on same host).
2.3.2 R4 - The Package must be able to handle, e ciently and gracefully, datasets larger
than main memory of the host system.
2.7.2 R3 - The [display] plot update speed shall not be a bottleneck. Speed shall be bench-
marked, and should be commensurate with comparable plotting packages.
The development of a benchmark program requires close collaboration between the SSR and
AIPS++ developers. In particular, the SSR must provide guidelines for the benchmark process,
data sets to benchmark, comparison scripts in other packages, and oversight to ensure that pro-
cessing speed is adequate to meet ALMA requirements. The AIPS++ developers must provide
dedicated benchmark machines, run the scripts in each ...