you are describing my job security. I've had a career spanning 25 years speeding up other peoples scripts.
For example once $LARGE_BIOTECH retired its inhouse supercomputer (A TruCluster composed of multiple GS1280s, the epitome of classical UNIX power) and replaced it with Linux and NFS. The principal engineer noticed his pipeline never finished on Linux but how no idea where to start.
Within five minutes I noticed that GNU/Linux sort uses $TMPDIR for large sorts (multipass). They had pointed TMPDIR at an NFS mount and were doing a multipass sort over NFS. On TruCluster, tmp pointed to an ultrafast cluster diskl.
Comments
you are describing my job security. I've had a career spanning 25 years speeding up other peoples scripts.
For example once $LARGE_BIOTECH retired its inhouse supercomputer (A TruCluster composed of multiple GS1280s, the epitome of classical UNIX power) and replaced it with Linux and NFS. The principal engineer noticed his pipeline never finished on Linux but how no idea where to start.
Within five minutes I noticed that GNU/Linux sort uses $TMPDIR for large sorts (multipass). They had pointed TMPDIR at an NFS mount and were doing a multipass sort over NFS. On TruCluster, tmp pointed to an ultrafast cluster diskl.