HighLAND
Tips for processing all the ND280 data in highland

This page gives a quick-start guide for people who only need to process ND280 data through highland (rather than developing an analysis) and contains tips for ensuring the process runs smoothly.

The page is split into the following sections:

Instructions are printed in bold text; supporting information is in normal text.

Quick-start guide

You should also download the relevant flux tuning files from the internet. At the time of writing, the 11bTuned-v3.2 and 11bTuned-v3.2 (for Run4 full data) files were needed. Extract the tar files that are downloaded.

Creating lists of files

Processing oaAnalysis files takes a long time, so you will probably want to run several processing jobs in parallel on batch nodes. As an example, to process MC of 10 times the run 1-4 data POT will take 30 jobs approximately 8 hours each.

You should create a text file for each job you will submit, where each text file lists the oaAnalysis files to be processed, with one file path per line.

It is recommended that you keep separate T2K runs apart. That is, you may want a couple of lists of run 1 files, a couple of lists of run 2 air files, but no lists that contain a mixture of the two. This is because of the separate flux tunings that must be applied for each run (see below).

To help you decide how many MC files to process, you should note that each file contains 5e17 POT. The good data POT for each run is listed in the table below, along with the amount and type of MC needed to get 10x POT.

T2K runND280 runsGood data POT (x10^19)MC typeMC files for 10x POT
Run 1 4165—5115 1.67 2010-02-water/magnet/beama334
Run 2 (water) 6462—7663 4.28 2010-11-water/magnet/beamb856
Run 2 (air) 7664—7754 3.55 2010-11-air/magnet/beamb710
Run 3 b 8309—8453 2.14 2010-11-air/magnet/beamc428
Run 3 c 8550—8753 13.48 2010-11-air/magnet/beamc2696
Run 4 (water) 8995—9422 16.25 2010-11-water/magnet/beamc3250
Run 4 (air) 9423—9798 17.62 2010-11-air/magnet/beamc3524
Run 5 (water) 10252—10333 / 10519—10521 - - -
Run 5 (water antinu) 10334—10518 - - -
Run 6 (air antinu) 10954—11563 - - -

NOTE THAT THERE ARE NOT ENOUGH PRODUCTION 5 2010-11-air/magnet/beamc FILES TO HAVE 10x DATA POT! There are only 6028 files available, while the above table demands 6648. Depending on your analysis, it may be easiest to use some more water MC instead.

Specifying the flux tuning for each run

The beam group provides a separate flux tuning for each run. Due to the relatively large amount of bad ND280, the 'average' flux tunings (run1-4) should NOT be used. Instead, you should tell highland to use the right flux tuning for each job you submit.

You should create 'parameter override files' to specify which tuning to apply. These files only need to contain one parameter, as shown below. yourAnalysis should be replaced by the name of the analysis you are running (nueCCAnalysis, numuCCAnalysis, numuCCBANFFAnalysis etc). Create separate files for run1, run2, run3b, run3c and run4.

$ cat flux_run1.params.dat
< yourAnalysis.FluxWeighting.File = /path/to/flux/tuned11bv3.2/run1/nd5_tuned11bv3.2_11anom_run1.root >

Submitting jobs

In each job, execute a command like one of the following:

RunNueCCAnalysis.exe -p $PARAMS_FILE -o $OUTPUT_FILE $INPUT_FILE
RunNumuCCAnalysis.exe -p $PARAMS_FILE -o $OUTPUT_FILE $INPUT_FILE
RunNumuCCBANFFAnalysis.exe -p $PARAMS_FILE -o $OUTPUT_FILE $INPUT_FILE