| Optimization Task |
| Optimization Home |
| Members |
| Documentation |
| Downloads |
| Mailing list |
| Components |
| ROS |
| OptorSim |
CVS repository |
Simulating data access optimization algorithms - OptorSim
In order to evaluate our various optimization algorithms we have developed a Grid simulator in JAVA, OptorSim. In a Grid computing environment, each site can contain several storage or computing elements. OptorSim takes a grid configuration and a replica optimizer algorithm as input and then runs a number of grid jobs using the given configuration. It also allows a user to visualise the performance of the algorithm.Current development includes evaluation of an Economic Model, using a Peer to Peer auction protocol that optimises both the selection of replicas for running jobs and the dynamic creation of replicas in Grid sites using a file revenue prediction function. More details can be found in the documentation pages.
News
| OptorSim is now on SourceForge |
As of November 2006, OptorSim is no longer being updated at these web pages. For the 2.1 release and any future developments, please go to the OptorSim SourceForge pages.
Novemer 15 2004: Release v2.0.0 . A brand new GUI and timing model are available.
June 11 2004: Release v1.0.1. Bug fix release to fix bugs associated with file pinning and ResourceBroker. Thanks to Antoine Vernois and Gimun Sung for their helpful feedback on these bugs.
Febuary 13 2004: Release v1.0.0. There has been large refactoring of the code to make it more stable, modular and easier to expand. A Zipf based economic model has been implemented and it is now possible to simulate background network traffic.
March 7 2003: OptorSim Release v0.5.0. The new release has many more features including a built-in auction protocol and vastly improved GUI.
June 20 2002: Release v0.4.0. The economic model is now available. The simulation is packaged into rpm form.
April 26 2002: Prerelease v0.2.0. A complete reorganisation to provide modular development of access pattern generators and replica optimisers. Several replica optimiser algorithms contained, but still at the pre-release stage.
March 09 2002: Prerelease v0.1.0. A first implementation demonstrating some logic of the final software.
A Brief Overview of OptorSim
OptorSim models the interactions of the individual components of a running DataGrid and is based on the architecture of the EU DataGrid.The simulation was constructed assuming that the Grid consists of several sites, each of which may provide computational and data-storage resources for submitted jobs. Computing Elements (CEs) run jobs, which use the data in files stored on Storage Elements (SEs) and a single Resource Broker controls the scheduling of jobs to CEs. Sites without SEs or CEs act as network nodes or routers.
The movement of data associated with jobs between sites is performed by a component called the Replica Manager. Within the Replica Manager the decision to create or delete replicas is controlled by our replica optimisation algorithm built into the Replica Optimiser.
More detail on how the simulation works can be found in the user guide contained in each release which can be found in the download section of these pages. Some screenshots of OptorSim can be seen below (click on them for a larger view).
 |
 |
Publications
-
William H. Bell, David G. Cameron, Luigi Capozza, A. Paul Millar, Kurt Stockinger, and Floriano Zini. OptorSim - A Grid Simulator for Studying Dynamic Data Replication Strategies. International Journal of High Performance Computing Applications, 17(4), 2003.
- David G. Cameron, Ruben Carvajal-Schiaffino, A. Paul Millar, Caitriana
Nicholson, and Kurt Stockinger Floriano Zini. Evaluating
Scheduling and Replica Optimisation Strategies in OptorSim. In
4th International Workshop on Grid Computing (Grid2003), Phoenix, Arizona,
November 17,
2003. IEEE Computer Society Press.
- David G. Cameron, Ruben Carvajal-Schiaffino, A. Paul Millar, Caitriana
Nicholson, and Kurt Stockinger Floriano Zini. UK
Grid Simulation with OptorSim. In e-Science All-Hands Meeting, Nottingham, UK, September
2003.
- William H. Bell, David G. Cameron, Ruben Carvajal-Schiaffino, A. Paul Millar, Kurt Stockinger, and Floriano Zini. Evaluation of an Economy-Based File Replication Strategy for a Data Grid. In International Workshop on Agent based Cluster and Grid Computing at CCGrid 2003, Tokyo, Japan, May 2003. IEEE Computer Society Press.
Presentations given on OptorSim
- (ppt) November 2003, Evaluating Scheduling and Replica Optimisation Strategies in OptorSim, International Workshop on Grid Computing (Grid 2003), Phoenix, AZ
- (ppt) Sept 2003, The EU DataGrid – Replica Optimisation Strategies, CERN School of Computing, Krems, Austria.
- (ppt) Sept 2003, Grid Simulation with Optor Sim, Poster at CERN School of Computing, Krems, Austria.
- (ppt) Sept 2003, UK Grid Simulation with OptorSim, Poster at e-Science All-Hands Meeting, Nottingham, UK, September 2003
- (ppt) May 2003, Evaluation of an Economy-Based File Replication Strategy for a Data Grid, International Workshop on Agent based Cluster and Grid Computing at CCGrid 2003, Tokyo, Japan
- (ppt) 13/02/03 OptorSim: an Environment for the Simulation of Data Grids, CERN, Geneva, Switzerland
- (ppt) 23/11/02 OptorSim presented at irst Open House, Trento, Italy (in Italian)
- (ppt) 3/9/02 OptorSim poster presented at UK e-Science All Hands Conference, Sheffield, UK
- (ppt) 6/6/02 Economy-Based Optimisation of File Access and Replication on a Data Grid at MRG-SRA 2K2 Symposium, Levanto, Italy
- (ppt) (sxi) 5/6/02 OptorSim demostration at TERENA Network Conference 2002, Limerick, Ireland (What is sxi format?)
- (ppt) 25/4/02 OptorSim demonstration slides from the National e-Science Centre opening, Edinburgh, UK
- (ppt) (pdf) (ps) 25/4/02 OptorSim poster from the National e-Science Centre opening, Edinburgh, UK
- (ppt) 4/3/02 Preliminary report on OptorSim at 4th EU Datagrid conference, Paris, France
 |
The European Organization for Nuclear Research |
