| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| condor:home [2012/08/13 19:42] – [Condor Documentation] updated Condor to version 7.8.1 garrettheath4 | condor:home [2013/10/07 03:11] (current) – Condor -> HTCondor garrettheath4 |
|---|
| ====== Condor at Washington and Lee University ====== | ====== HTCondor at Washington and Lee University ====== |
| Condor is a high-throughput computing system that is made available to [[http://www.wlu.edu/|Washington and Lee]] students and faculty by the [[http://cs.wlu.edu/|Computer Science]] department. It is administered by [[kollerg14@mail.wlu.edu|Garrett Koller]] under the supervision of [[stoughj@wlu.edu|Dr. Joshua Stough]]. | HTCondor((formerly known as Condor)) is a high-throughput computing system that is made available to [[http://www.wlu.edu/|Washington and Lee]] students and faculty by the [[http://cs.wlu.edu/|Computer Science]] department. It is administered by [[kollerg14@mail.wlu.edu|Garrett Koller]] under the supervision of [[stoughj@wlu.edu|Dr. Joshua Stough]]. |
| |
| =====What is Condor?===== | =====What is HTCondor?===== |
| [[http://www.cs.wisc.edu/condor/|Condor]] is a high-throughput computing system. Similar to a high-performance computing system, which is the most typical kind of supercomputer, a "high-throughput computing system" is designed to process very large amounts of data with distributed computational resources. Since such programs are typically limited with respect to reading and writing the data, high performance is needed in the realm of data access and manipulation rather than in processing speed. In order to accomplish this, the system provides an efficient way to store and access data while providing computational resources that allow the data to be processed by many machines at once if the data permits.((Ideally, the data is organized in such a way that it can be processed in many independent segments that do not rely on other segments in order to make progress.)) | [[http://research.cs.wisc.edu/htcondor/|HTCondor]] is a high-throughput computing system. Similar to a high-performance computing system, which is the most typical kind of supercomputer, a "high-throughput computing system" is designed to process very large amounts of data with distributed computational resources. Since such programs are typically limited with respect to reading and writing the data, high performance is needed in the realm of data access and manipulation rather than in processing speed. In order to accomplish this, the system provides an efficient way to store and access data while providing computational resources that allow the data to be processed by many machines at once if the data permits.((Ideally, the data is organized in such a way that it can be processed in many independent segments that do not rely on other segments in order to make progress.)) |
| |
| =====How is Condor Used at W&L?===== | =====How is HTCondor Used at W&L?===== |
| {{ :condor:wlu_cs_logo.png?nolink&250|}} | {{ :condor:wlu_cs_logo.png?nolink&250|}} |
| ====Condor's Status==== | ====HTCondor's Status==== |
| Use [[http://condor.cs.wlu.edu/condorview/|CondorView]] to check the status of the Condor cluster at any given moment. You can even see which users are submitting the most jobs to Condor. | Use [[http://condor.cs.wlu.edu/condorview/|HTCondorView]] to check the status of the HTCondor cluster at any given moment. You can even see which users are submitting the most jobs to HTCondor. |
| | |
| | ====Benchmarking Statistics==== |
| | Check out [[https://docs.google.com/spreadsheet/ccc?key=0AkNyR8-zKS20dDdCMjdmMzZYbkx0VlNuam81ZEdpSkE|this spreadsheet]] to see HTCondor's benchmarking statistics, including how many CPU and GPU cores are on the cluster. |
| |
| ====Mapping the Universe==== | ====Mapping the Universe==== |
| When Condor isn't busy running user jobs, it intelligently runs what are called "Backfill" jobs. This means that when the computers in the Condor cluster aren't busy and Condor doesn't have any jobs to run, Condor participates in volunteer computing projects. Right now, Condor is participating in the [[http://milkyway.cs.rpi.edu/milkyway/|MilkyWay@home Project]], which is a project created and supported by [[http://www.rpi.edu/|Rensselaer Polytechnic Institute]] to model the 3D structures in our galaxy. | When HTCondor isn't busy running user jobs, it intelligently runs what are called "Backfill" jobs. This means that when the computers in the HTCondor cluster aren't busy and HTCondor doesn't have any jobs to run, HTCondor participates in volunteer computing projects. Right now, HTCondor is participating in the [[http://milkyway.cs.rpi.edu/milkyway/|MilkyWay@home Project]], which is a project created and supported by [[http://www.rpi.edu/|Rensselaer Polytechnic Institute]] to model the 3D structures in our galaxy. |
| |
| =====Condor Documentation===== | =====HTCondor Documentation===== |
| We currently use Condor version 7.8.1. The Condor documentation for version 7.8.1 can be found [[http://condor.cs.wlu.edu/condor/manual/condor-V7_8_1-Manual.pdf|here]]. You can find the official documentation for other versions of Condor on the [[http://www.cs.wisc.edu/condor/|official Condor Project site]]. | We currently use HTCondor version 7.8.1. The HTCondor documentation for version 7.8.1 can be found [[http://condor.cs.wlu.edu/condor/manual/condor-V7_8_1-Manual.pdf|here]]. You can find the official documentation for other versions of HTCondor on the [[http://www.cs.wisc.edu/condor/|official HTCondor Project site]]. |
