Difference between revisions of "35t Data"

From DUNE
Jump to navigation Jump to search
 
(3 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 +
----
 +
----
 +
----
 +
----
 +
==<span style="background:yellow">This page has moved to the [https://wiki.dunescience.org/wiki/35ton DUNE wiki]</span>==
 +
----
 +
----
 +
----
 +
----
 +
 
Data is available from the 35t Prototype Detector.
 
Data is available from the 35t Prototype Detector.
  
Line 25: Line 35:
 
= Accessing Files =
 
= Accessing Files =
  
== XrootD =
+
== XrootD ==
 +
 
 +
PNFS (see below) paths may be accessed via Xrootd with URLs like:
 +
 
 +
root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/lbne/test-data/lbne/raw/00/18/90/51/lbne_r006837_sr01_20160112T213253.root
  
t.b.d.
+
See the topic on [[XrootD]] for more information on this access mechanism.
  
 
== PNFS ==
 
== PNFS ==

Latest revision as of 18:30, 8 December 2017





This page has moved to the DUNE wiki





Data is available from the 35t Prototype Detector.

Discovering Files

SAM

The "official" way to locate files is via SAM.

samweb -e lbne get-file-access-url lbne_r006837_sr01_20160112T213253.root

See the topic on SAM for more information.

Metadata Database

The conditions database contains some metadata about the files. Example code to access it can be found in this script in the duneutil package.

duneutil/dhtools/runsumdbquery.py 6837

Other

A possibly out of date generated file list:

http://dune-data.fnal.gov/data/35t/testfiles/filelist.txt

Accessing Files

XrootD

PNFS (see below) paths may be accessed via Xrootd with URLs like:

root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/lbne/test-data/lbne/raw/00/18/90/51/lbne_r006837_sr01_20160112T213253.root

See the topic on XrootD for more information on this access mechanism.

PNFS

On FNAL computers, if you know the path to a file you can find it in PNFS file system like:

/pnfs/lbne/pnfs/fnal.gov/usr/lbne/test-data/lbne/raw/00/18/90/51/lbne_r006837_sr01_20160112T213253.root

See the topic on PNFS for more information about this resource.

Grid FTP

If you have Grid tools available, PNFS can be accessed. The above path turns into

gsiftp://fndca1.fnal.gov:2811/pnfs/fnal.gov/usr/lbne/test-data/lbne/raw/00/18/90/51/lbne_r006837_sr01_20160112T213253.root

See the topic GSIFTP for more information about Grid FTP.

In transit

Experts may log in as lbnedaq@lbne35t-gateway02 and check

/data/lbnedaq/data/transferred_files/

On that machine, files can be copied to PNFS can be used, eg at

/pnfs/lbne/persistent/users/bv

Contact Tom Junk or other FNAL computing experts if you need your Kerberos principle added in order to log in to the lbnedaq account.

Other sources

Michelle has some ad-hoc placements here

/pnfs/dune/persistent/users/mstancar/

Using Files

t.b.d.