Difference between revisions of "Computing"

From DUNE
Jump to navigation Jump to search
 
(43 intermediate revisions by 4 users not shown)
Line 1: Line 1:
= Organization =
+
=ARCHIVE=
 +
<hr/>
 +
<hr/>
 +
<hr/>
 +
<hr/>
 +
<hr/>
 +
<hr/>
  
* See notes on LBNE [[Computing Effort Organization]]. In 2014, there are 3 active groups reporting to LBNE spokespersons:
+
=Important Note=
** [[Physics Tools]]
+
'''This is an archival area for a variety of documentation and design pages developed for the LBNE Collaboration which has since reorganized and became a part of DUNE Collaboration. This area is not actively maintained. There isn't any guarantee that the materials presented here are up-to-date or relevant - they are kept here for reference by the computing experts and managers.'''
** [[Software and Computing]]
 
** [[DAQ|Online and Data Acquisition]]
 
  
* [[Computing Planning Process]]
+
If you are looking for DUNE Computing, please access [[DUNE_Computing | this page here]].
  
* Computing Calendar
+
= Previous Priorities (LBNE Archive) =
** Standing meetings
+
Priorities for the software and computing work.
*** [http://lbne2-docdb.fnal.gov:8080/cgi-bin/ListBy?eventgroupid=15 List of important simulation and reconstruction meetings, including DAQ and 35t related topics]
+
* [[Zero Suppression]]
*** [https://indico.fnal.gov/categoryDisplay.py?categId=394 FNAL Indico Pages] for the biweekly Software and Computing conference call
+
* [[Software Infrastructure|LBNE Software Infrastructure]]: LBNE code build, validation and continuous integration
** Upcoming events
+
* [[LBNE Geometry Description and Model]]
*** HEP Software Foundation Meeting at SLAC: January 20-21 2015
+
* [[35t Test|35t prototype readiness]]
*** Upcoming LBNE Collaboration Meeting: January 22-25 2015 (links TBA)
+
* [[File Metadata Schema]]
*** [https://indico.cern.ch/event/330212/ XRootD workshop at SLAC]: January 27-29 2015
 
** Recent Events
 
*** Feb 2014 [https://indico.fnal.gov/conferenceDisplay.py?confId=7958 Software Workshop]
 
*** Collaboration Meetings: [https://indico.fnal.gov/conferenceDisplay.py?confId=7668 February 2014], [https://indico.fnal.gov/conferenceDisplay.py?confId=8125 July 2014]
 
  
= Priorities =
+
* Prototypes:
* [[Computing Priorities|General Priorities]]
+
** [[CERN_Prototype| "Full Scale Prototype Test"]] at CERN (2017)
* [[35t Test|Preparations for the 35t LArTPC Prototype Test]]
+
** [[35t Test| The 35t LArTPC Prototype Test]] at FNAL (2015)
  
= Software =
+
= Software Tools =
== Major Software Components and Tools ==
+
== LBNE Software ==
 +
* [https://cdcvs.fnal.gov/redmine/projects/lbnecode/wiki/Wiki The Far Detector "lbnecode" package - LArTPC] (Redmine Wiki)
 +
* [[LBNE Far Detector Software Releases|'''LBNE Far Detector SW releases (lbnecode)''']]
 +
 
 +
== Underlying Software Components and Tools ==
 
* [https://web.fnal.gov/project/ArtDoc/SitePages/Home.aspx ''art''], a ROOT-based suite of tools, libraries, and applications for processing detector events.
 
* [https://web.fnal.gov/project/ArtDoc/SitePages/Home.aspx ''art''], a ROOT-based suite of tools, libraries, and applications for processing detector events.
* [https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/LArSoftWiki ''LArSoft''], a art-based framework for simulating liquid argon drift detectors. As of Jan 24, 2014, LArSoft transitioned from svn/SRT to git/mrb/ups.
+
* ''LArSoft'', an art-based framework for simulating liquid argon drift detectors. As of Jan 24, 2014, LArSoft transitioned from svn/SRT to git/mrb/ups.
 +
** [https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/LArSoftWiki Redmine Wiki]
 +
** [https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/_Quick-start_guide_to_using_and_developing_LArSoft_code_ LArSoft Quick Start Guide]
  
 
== New Tools ==
 
== New Tools ==
 
* [https://github.com/brettviren/worch ''worch''], a meta-build orchestration system based on ''waf'' framework.
 
* [https://github.com/brettviren/worch ''worch''], a meta-build orchestration system based on ''waf'' framework.
 
* [https://github.com/brettviren/gegede ''GGD''], a Geometry Description system. Also see [[LBNE_Geometry_Description_and_Model| this dedicated geometry page]].
 
* [https://github.com/brettviren/gegede ''GGD''], a Geometry Description system. Also see [[LBNE_Geometry_Description_and_Model| this dedicated geometry page]].
 
+
* [[Building_in_Docker|"Building in Docker"]], our R&D for applying the [https://www.docker.com/whatisdocker/ Docker] platform to solve the problem of LBNE (and other) software packaging and distribution.
  
 
= Facilities =
 
= Facilities =
 
== FNAL ==
 
== FNAL ==
  
* [http://lbne2-docdb.fnal.gov:8080/cgi-bin/ShowDocument?docid=6971 Overview of Computing at FNAL]
+
* [http://lbne2-docdb.fnal.gov:8080/cgi-bin/ShowDocument?docid=6971 Overview of Computing at FNAL] (Slides)
* Central computing facility at FNAL: [http://fermigrid.fnal.gov/fermigrid-metrics.html Fermigrid]
+
* [https://fermi.service-now.com/kb_view.do?sys_kb_id=923e887930327040a5787ecb31e849c0&sysparm_language=&sysparm_nameofstack=&sysparm_kb_search_table=&sysparm_search= FNAL Accounts]
* Storage:[http://fndca.fnal.gov/ dCache status]
+
* Grid Monitoring
* Storage:[http://www-stken.fnal.gov/enstore/enstore_system.html Enstore status (mass storage)]
+
** [http://fermigrid.fnal.gov/fermigrid-metrics.html Fermigrid] (Central computing facility at FNAL)
 +
** [http://fifemon.fnal.gov/monitor "FIFEmon"]
 +
** [http://fermigrid.fnal.gov/scoreboard/ FNAL Grid Accounting scoreboard]
 +
** [http://fclweb.fnal.gov/ Fermicloud]
 +
** [https://cdcvs.fnal.gov/redmine/projects/ifront/wiki/Monitoring_Stats Garden variety of monitoring stats]
 +
* Storage
 +
** [http://fndca.fnal.gov/ dCache status], [http://fndca.fnal.gov/cgi-bin/space_usage.py dCache space usage]
 +
** [http://www-stken.fnal.gov/enstore/enstore_system.html Enstore status (mass storage)]
  
 
== BNL ==
 
== BNL ==
Line 46: Line 59:
 
* The RHIC and ATLAS Computing Facility: [https://www.racf.bnl.gov/ (RACF)]
 
* The RHIC and ATLAS Computing Facility: [https://www.racf.bnl.gov/ (RACF)]
 
* The US ATLAS: [https://www.racf.bnl.gov/experiments/usatlas Facilities Page (useful links)]
 
* The US ATLAS: [https://www.racf.bnl.gov/experiments/usatlas Facilities Page (useful links)]
 +
* BNL [https://www.google.com/search?q=+site%3Abnl.gov Google Search]
  
 
== Open Science Grid ==
 
== Open Science Grid ==
While not a facility or even an owner of a facility, the Open Science Grid [http://www.opensciencegrid.org/ (OSG)] Consortium, is an important component of the national Grid Computing infrastructure in the US and it facilitates access to High-Throughput Computing facilities for many research institutions and collaborations. LBNE enjoys the support of the OSG and has a ''Virtual Organization'' (VO) status with the Consortium.
+
While not a facility or even an owner of a facility, the Open Science Grid [http://www.opensciencegrid.org/ (OSG)] Consortium is an important component of the national Grid Computing infrastructure in the US as it facilitates access to High-Throughput Computing facilities for many research institutions and collaborations. LBNE enjoys the support of the OSG and has a ''Virtual Organization'' (VO) status with the Consortium.
  
 
* [http://gratiaweb.opensciencegrid.org/gratia/ ''Gratia''] monitoring tool which shows Open Science Grid resource utilization.
 
* [http://gratiaweb.opensciencegrid.org/gratia/ ''Gratia''] monitoring tool which shows Open Science Grid resource utilization.

Latest revision as of 20:23, 19 December 2017

ARCHIVE







Important Note

This is an archival area for a variety of documentation and design pages developed for the LBNE Collaboration which has since reorganized and became a part of DUNE Collaboration. This area is not actively maintained. There isn't any guarantee that the materials presented here are up-to-date or relevant - they are kept here for reference by the computing experts and managers.

If you are looking for DUNE Computing, please access this page here.

Previous Priorities (LBNE Archive)

Priorities for the software and computing work.

Software Tools

LBNE Software

Underlying Software Components and Tools

  • art, a ROOT-based suite of tools, libraries, and applications for processing detector events.
  • LArSoft, an art-based framework for simulating liquid argon drift detectors. As of Jan 24, 2014, LArSoft transitioned from svn/SRT to git/mrb/ups.

New Tools

Facilities

FNAL

BNL

Open Science Grid

While not a facility or even an owner of a facility, the Open Science Grid (OSG) Consortium is an important component of the national Grid Computing infrastructure in the US as it facilitates access to High-Throughput Computing facilities for many research institutions and collaborations. LBNE enjoys the support of the OSG and has a Virtual Organization (VO) status with the Consortium.

  • Gratia monitoring tool which shows Open Science Grid resource utilization.