DATASHARE

Section: CCB Online Datashare (7)
Updated:
Index Return to Main Contents
 

OVERVIEW

It's a common use case that you need to share files as part of your research. To make this simple, we provide an easy mechanism for putting data onto the internet so that it can be downloaded by other people. The service is called datashare and has two components.

- The file system /datashare/. This separate from the rest of the system and has a separate 100G quota (which you can check with the getquota(1) command in the same way as your other quotas). Within this, every collaboration project has a directory at /datashare/project/PROJECTNAME/ that any member of the project can write to. If you find that you need additional space please contact us so that we can consider your request; please note that while data should be added to the relevant project it is not possible to allocate quota directly to projects - all quota is on a per-user basis.

- The website https://datashare.molbiol.ox.ac.uk : All data stored in /datashare/ is publicly available via this web server.  

IMPORTANT

In using the datashare system, it is important to note that it has no guarantees of security whatsoever and that the data is available to the entire internet at all times. As such, you must not use it to share data which has any restrictions on who may have access. We regret that, at this time, we do not have a service which will allow you to securely share data with other people who do not themselves have access to our systems.

Additionally, please note that the datashare service is not a web publishing service. Whilst it is possible to place any data you wish in this folder, including HTML data or reference data, we do not guarantee the long term availablily of the data nor do we guarantee that the URL will be maintained at its current location. Do not use datashare for long term sharing of data and do not include datashare URLs in publications.  

HOW TO USE DATASHARE

- Decide which collaboration project you want your data associated with. For this example, I'll use sysadmin.

- If you don't have one already, create a directory in the project for your data. You can put the data directly in the project directory if you like, but it's neater if you don't.

 $ mkdir /datashare/project/sysadmin/dtooke

- Copy your data into /datashare/ ; please note that you cannot use symlinks to point to other storage locations on the cluster. For example:

 $ cp /project/sysadmin/dtooke/files.tar /datashare/project/sysadmin/dtooke/

- Your data will appear at datashare.molbiol.ox.ac.uk/public/project/PROJECTNAME/FOLDERNAME/FILENAME. For example, the file copied above could be accessed via datashare.molbiol.ox.ac.uk/public/project/sysadmin/dtooke/files.tar.

It is not possible to list files by pointing your browser at a directory - you must give the full path to each file as above. If you wish to transfer multiple files it may be more convenient to create a tar(1) archive and then copy that. It is also not possible to customise web server configuration using htaccess files; if you have a need of advanced features please contact us.  

TROUBLESHOOTING

If you're having problems getting datashare to work, the most important thing to check is that the file you're attempting to access on the internet is set up correctly. To do this, use the webcheck script that's part of the ccb module. For example:

$ module load ccb
$ webcheck /datashare/project/sysadmin/dtooke/test.txt
ERROR: /datashare/dtooke/test.txt is not a world readable file
$ webcheck /datashare/project/sysadmin/dtooke/BigWigs
WARN : /datashare/dtooke/BigWigs is a directory; you can only give web links to files
$ webcheck /datashare/project/sysadmin/dtooke/B0034234.tab
$

The last of those examples gave no output, and is correctly set up to access via datashare.molbiol.ox.ac.uk/public/project/sysadmin/dtooke/B0034234.tab  

BACKWARDS COMPATIBILITY

For backwards compatibility purposes, the web address userweb.molbiol.ox.ac.uk is redirected to point to datashare.molbiol.ox.ac.uk  

GETTING HELP

You can email the CCB team using the email address genmail@molbiol.ox.ac.uk. Using this address ensures your email is logged and assigned a tracking number, and will go to all the core team, which means the appropriate person or people will be able to pick it up.  

COPYRIGHT

This text is copyright University of Oxford and MRC and may not be reproduced or redistributed without permission.  

AUTHOR

Duncan Tooke <duncan.tooke@imm.ox.ac.uk>


 

Index

OVERVIEW
IMPORTANT
HOW TO USE DATASHARE
TROUBLESHOOTING
BACKWARDS COMPATIBILITY
GETTING HELP
COPYRIGHT
AUTHOR