Skip to content

Commit 807ddcd

Browse files
fmorelloCSCkkmattilNortamorkronberg
authored
Fm fixesjan (#1552)
* Update sd_desktop.md Spell check 1-3 * Update sd_desktop.md creation * Update sd_desktop.md creation * Update sd_desktop.md * Update sd_desktop.md * Update sd_desktop.md * Update sd_desktop.md * Update sd_desktop.md * Update sd_desktop.md workspace fixed * Update sd_desktop.md access to do * Update sd_desktop.md * Update sd_desktop.md Data Gateway fix * Update sd_desktop.md * Update sd_desktop.md * Update sd_desktop.md * Update sd_desktop.md * Update sd_connect.md text improved till crypt4gh * Update sd_connect.md fixed text until large file for analysis * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md fixed transfer encryption * Update sd_connect.md fixed all UI text * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md fixed layout * Delete SDConnect-segments.png deprecated * Add files via upload crypt4gh * Add files via upload large upload * Update sd_connect.md added images * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Update index.md * Update index.md * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md fixed new table * Update sd_connect.md * Update index.md * Update index.md * Update index.md * Update index.md * Create accessing-sd-services * Update accessing-sd-services * Rename accessing-sd-services to accessing-sd-services.md * Update accessing-sd-services.md * Update accessing-sd-services.md * Update index.md * Update accessing-sd-services.md * Update mkdocs.yml * Update index.md * Update mkdocs.yml Fixing SD service layout * Update index.md * Update intro.md * Update accessing-sd-services.md * Update accessing-sd-services.md * Update index.md * Update accessing-sd-services.md * Update accessing-sd-services.md * Update sd_desktop.md * Update sd_desktop.md * Update sd_desktop.md * Update index.md * Update sd_desktop.md * Update index.md * Update accessing-sd-services.md spelling * Update sd_connect.md spelling * Update index.md * Rename accessing-sd-services.md to accessingsdservices.md * Update accessingsdservices.md * Update sd-desktop-audited.md * Update sd-desktop-audited.md * Update sequencing_center_tutorial.md fixed broken link * Update index.md fixed link * Rename accessingsdservices.md to access.md * Rename access.md to sd-access.md * Update mkdocs.yml fixed link * Update index.md link fix * Update index.md fix * Update sd-access.md Improved text * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd-access.md * Update sd_desktop.md * Update mkdocs.yml fixed titles * Update sd_desktop.md fixing note * Update sd_connect.md text fixes * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Delete connect_encryption_app.png * Add files via upload * Update sd_connect.md * Delete connect_encryption.png * Add files via upload * Update sd_connect.md * Update sd_connect.md * Update sd_connect.md * Update data-new.md * Update data-new.md * Update data-new.md * Update data-new.md * Update data-new.md * Update sd-access.md * Update sd-access.md * Update sd_connect.md * Update data-new.md * Update index.md * fix what's new header * fix typo --------- Co-authored-by: kkmattil <[email protected]> Co-authored-by: Henrik Nortamo <[email protected]> Co-authored-by: Rasmus Kronberg <[email protected]>
1 parent 9c09234 commit 807ddcd

12 files changed

+531
-303
lines changed
Binary file not shown.
Loading
Loading

docs/data/sensitive-data/index.md

+48-43
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# Sensitive Data Services for research: user guide
1+
# Sensitive Data (SD) Services for research: user guide
22

33
This guide, in CSC Docs, introduces CSC's Sensitive Data (SD) services. To navigate the CSC user guide, click on the topics on the left-hand side of the navigation bar or use the search functionality. Below you can find an overview of the contents related to Sensitive Data Services.
44

@@ -7,43 +7,48 @@ This guide, in CSC Docs, introduces CSC's Sensitive Data (SD) services. To navig
77

88

99
## [Introduction](./intro.md)
10-
* [**Introduction to the user guide**](./intro.md#introduction-to-the-user-guide)
11-
* [**Introduction to the services**](./intro.md#introduction-to-the-services)
12-
* [**Legal agreements**](./intro.md#legal-agreements)
13-
* [**Useful terminology**](./intro.md#useful-terminology)
10+
* [Introduction to the user guide](./intro.md#introduction-to-the-user-guide)
11+
* [Introduction to the services](./intro.md#introduction-to-the-services)
12+
* [Legal agreements](./intro.md#legal-agreements)
13+
* [Useful terminology](./intro.md#useful-terminology)
1414

1515

16-
## [Applying for SD services access](./intro.md#applying-for-sd-services-access)
16+
## [Applying for SD services access](./sd-access.md)
1717

18+
* [For research data processing](./sd-access.md#processing-sensitive-research-data)
19+
* [For register data processing under the Act on Secondary use](./sd-access.md#processing-register-data-under-the-act-on-secondary-use)
20+
* [Default storage space and billing units consumption](./sd-access.md#default-storage-space-and-billing-units-consumption)
1821

1922

2023
## [Store and share with SD Connect](./sd_connect.md)
2124

22-
* [**Overview**](./sd_connect.md#overview)
25+
* [Overview](./sd_connect.md#overview)
2326

24-
* [**Key features**](./sd_connect.md)
27+
* [Key features](./sd_connect.md)
2528

26-
* [**Authentication**](./sd_connect.md#authentication)
29+
* [Authentication](./sd_connect.md#authentication)
2730

28-
* [**User Interface**](./sd_connect.md#user-interface)
31+
* [User Interface](./sd_connect.md#user-interface)
2932

30-
* [**Introduction to data encryption compatible with sensitive data services**](./sd_connect.md#introduction-to-data-encryption-compatible-with-sensitive-data-services)
33+
* [Introduction to data encryption compatible with sensitive data services](./sd_connect.md#introduction-to-data-encryption-compatible-with-sensitive-data-services)
3134

32-
* [**Data encryption and upload (less than 100 GB)**](./sd_connect.md#sensitive-data-encryption-and-upload-less-than-100-gb) (Default analysis)
35+
* [Data encryption and upload for analysis (less than 1 GB)](./sd_connect.md#sensitive-data-encryption-and-upload-for-analysis-less-than-1-gb) (Default analysis)
36+
37+
* [Data encryption and upload for analysis (up to 100 GB)](./sd_connect.md#sensitive-data-encryption-and-upload-for-analysis-up-to-100-gb)
3338

34-
* [**Data encryption and upload with multiple encryption keys (less than 100 GB)**](./sd_connect.md#sensitive-data-encryption-and-upload-with-multiple-encryption-keys-less-than-100-gb) (Data storage and transfer)
39+
* [Data encryption and upload for storage and sharing (less than 1 GB)](./sd_connect.md#sensitive-data-encryption-and-upload-for-storage-and-sharing-less-than-1-gb) (Data storage and transfer)
3540

3641

37-
* [**Data sharing**](./sd_connect.md#data-sharing)
42+
* [Data sharing](./sd_connect.md#data-sharing)
3843

39-
* [**Data download and decryption**](./sd_connect.md#data-download-and-decryption) (Data storage and transfer)
44+
* [Data download and decryption](./sd_connect.md#data-download-and-decryption) (Data storage and transfer)
4045

41-
* [**Command Line Interface: data encryption and upload:**](./sd_connect.md#command-line-interface-data-encryption-and-upload) (Advanced)
46+
* [Command Line Interface: data encryption and upload](./sd_connect.md#command-line-interface-data-encryption-and-upload) (Advanced)
4247

4348

44-
* [**Command Line Interface: data encryption for data sharing**](./sd_connect.md#command-line-interface-encryption-for-data-sharing) (Advanced)
49+
* [Command Line Interface: data encryption for data sharing](./sd_connect.md#command-line-interface-encryption-for-data-sharing) (Advanced)
4550

46-
* [**Troubleshooting**](./sd_connect.md#troubleshooting)
51+
* [Troubleshooting](./sd_connect.md#troubleshooting)
4752

4853

4954

@@ -53,57 +58,57 @@ This guide, in CSC Docs, introduces CSC's Sensitive Data (SD) services. To navig
5358

5459
## [Analyse and compute with SD Desktop](./sd_desktop.md)
5560

56-
* [**Overview**](./sd_desktop.md#overview)
61+
* [Overview](./sd_desktop.md#overview)
5762

58-
* [**Key features**](./sd_desktop.md)
63+
* [Key features](./sd_desktop.md)
5964

60-
* [**Authentication**](./sd_desktop.md#authentication)
61-
62-
* [**Setting up a virtual Desktop**](./sd_desktop.md#setting-up-a-virtual-desktop) (Default analysis)
65+
* [Authentication](./sd_desktop.md#authentication)
6366

64-
* [**Working with Desktop**](./sd_desktop.md#working-with-your-virtual-desktop)(Default analysis)
67+
* [Creating your virtual desktop](./sd_desktop.md#creating-your-virtual-desktop) (Default analysis)
6568

66-
* [**Accessing encrypted sensitive data within SD Desktop**](./sd_desktop.md#accessing-encrypted-sensitive-data-within-sd-desktop) (Default analysis)
69+
* [Working with your desktop](./sd_desktop.md#working-with-your-virtual-desktop)(Default analysis)
70+
71+
* [Accessing encrypted sensitive data within SD Desktop](./sd_desktop.md#accessing-encrypted-sensitive-data-within-sd-desktop) (Default analysis)
6772

68-
* [**Default programs available on SD Desktop**](./sd_desktop.md#default-programs-available-on-sd-desktop) (Default analysis)
73+
* [Default programs available on SD Desktop](./sd_desktop.md#default-programs-available-on-sd-desktop) (Default analysis)
6974

70-
* [**Software customization**](./sd_desktop.md#software-customisation) (Advanced)
75+
* [Software customization](./sd_desktop.md#software-customisation) (Advanced)
7176

72-
* [**Data export**](./sd_desktop.md#data-export-from-sd-desktop)
77+
* [Data export](./sd_desktop.md#data-export-from-sd-desktop)
7378

74-
* [**Deleting your virtual Desktop**](./sd_desktop.md#deleting-your-virtual-desktop)
79+
* [Managing volumes and desktops](./sd_desktop.md#managing-volumes-and-virtual-desktops)
7580

76-
* [**Troubleshooting**](./sd_desktop.md#troubleshooting)
81+
* [Troubleshooting](./sd_desktop.md#troubleshooting)
7782

7883

7984
## [SD Desktop for secondary use of health and social data](./sd-desktop-audited.md)
8085
Access to this service requires a Findata permit. There are also [instructions](./single-register-submission.md) for single registers to submit secondary use data for research use in SD services.
8186

82-
* [**Key features**](./sd-desktop-audited.md#key-features)
87+
* [Key features](./sd-desktop-audited.md#key-features)
8388

84-
* [**Before you start**](./sd-desktop-audited.md#before-you-start)
89+
* [Before you start](./sd-desktop-audited.md#before-you-start)
8590

86-
* [**Overview**](./sd-desktop-audited.md#overview)
91+
* [Overview](./sd-desktop-audited.md#overview)
8792

88-
* [**Service access**](./sd-desktop-audited.md#service-access)
93+
* [Service access](./sd-desktop-audited.md#service-access)
8994

90-
* [**Authentication**](./sd-desktop-audited.md#authentication)
95+
* [Authentication](./sd-desktop-audited.md#authentication)
9196

92-
* [**Setting up a virtual Desktop**](./sd-desktop-audited.md#setting-up-a-virtual-desktop)
97+
* [Setting up a virtual Desktop](./sd-desktop-audited.md#setting-up-a-virtual-desktop)
9398

94-
* [**Working with your virtual Desktop**](./sd-desktop-audited.md#working-with-your-virtual-desktop)
99+
* [Working with your virtual Desktop](./sd-desktop-audited.md#working-with-your-virtual-desktop)
95100

96-
* [**Accessing sensitive register data within SD Desktop**](./sd-desktop-audited.md#accessing-sensitive-register-data-within-sd-desktop)
101+
* [Accessing sensitive register data within SD Desktop](./sd-desktop-audited.md#accessing-sensitive-register-data-within-sd-desktop)
97102

98-
* [**Default programs available on the Desktop and software customisation**](./sd-desktop-audited.md#default-programs-available-on-the-desktop-and-software-customisation)
103+
* [Default programs available on the Desktop and software customisation](./sd-desktop-audited.md#default-programs-available-on-the-desktop-and-software-customisation)
99104

100-
* [**Data export from the Desktop**](./sd-desktop-audited.md#data-export-from-the-desktop)
105+
* [Data export from the Desktop](./sd-desktop-audited.md#data-export-from-the-desktop)
101106

102-
* [**Deleting your virtual Desktop**](./sd-desktop-audited.md#deleting-your-virtual-desktop)
107+
* [Deleting your virtual Desktop](./sd-desktop-audited.md#deleting-your-virtual-desktop)
103108

104-
* [**End of data access and data deletion policies**](./sd-desktop-audited.md#end-of-data-access-and-data-deletion-policies)
109+
* [End of data access and data deletion policies](./sd-desktop-audited.md#end-of-data-access-and-data-deletion-policies)
105110

106-
* [**Troubleshooting**](./sd-desktop-audited.md#troubleshooting)
111+
* [Troubleshooting](./sd-desktop-audited.md#troubleshooting)
107112

108113

109114
## **Services in the pilot phase:**

docs/data/sensitive-data/intro.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11

2-
# Sensitive Data services for research
2+
# Sensitive Data (SD) Services for research
33

44

55
## Introduction to the user guide

docs/data/sensitive-data/sd-access.md

+107
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,107 @@
1+
# Accessing Sensitive Data (SD) Services for research
2+
3+
CSC's Sensitive Data Services are available to researchers and students affiliated with Finnish higher education institutions (universities, universities of applied sciences) or a state research institute.
4+
5+
!!! Note
6+
The legal basis for data processing determines which service component you can access and use. For example, you can directly manage research data access, uploads, or data export using SD Connect and SD Desktop. In contrast, access to register data via SD Desktop is managed by CSC's helpdesk, based on the data permit issued by the Fidata authority and in compliance with the Finnish regulations.
7+
8+
Below is more information on the steps required to access the services:
9+
10+
* for processing research data;
11+
* for processing register data under the Act on Secondary Use;
12+
* storage space (or quota) availability and resource (or billing units) consumption.
13+
14+
You can browse through the guide using the navigation bar on the right side of this page or the search function.
15+
16+
17+
18+
## Processing sensitive research data
19+
20+
21+
To access SD Connect and SD Desktop for storing, sharing or analysing sensitive research data:
22+
23+
1. Create a user account using the [MyCSC](https://my.csc.fi) portal.
24+
25+
2. Create or join a CSC project and add project members.
26+
27+
3. Fill in the _Description of processing activities form_ and accept _CSC's Data Processing Agreement_.
28+
29+
4. All project members should add service access to Allas (to use SD Connect) and SD Desktop, accepting the terms of use.
30+
31+
5. All project members should activate their account's additional security verification (or Multi-factor Authentication) by scanning the QR code with an application (e.g. Google Authenticator).
32+
33+
34+
6. Apply for billing units or disk quota.
35+
36+
37+
For video tutorials and further guidance, check the [Accounts](../../accounts/index.md) paragraph at the beginning of this user guide.
38+
39+
Once you have completed these steps, you can log in with identity federation systems (Haka, Virtu, CSC Login, or LSLogin) at:
40+
41+
* [https://sd-connect.csc.fi](https://sd-connect.csc.fi)
42+
43+
* [https://sd-desktop.csc.fi](https://sd-desktop.csc.fi)
44+
45+
46+
with any modern web-browser (Note: private browsing is not supported using Firefox).
47+
48+
49+
## Processing register data under the Act on Secondary Use
50+
51+
Analysing register data under the Act on Secondary Use differs from the process mentioned above. In this case, CSC's helpdesk manages user's access to the SD Desktop computing environment in compliance with the Finnish Act on the Secondary Use of Health and Social data and the Findata authority's regulation.
52+
53+
Register data can only be provided by the Fidata authority and accessed via the SD Desktop service. For more information about data provided by single registers, contact us at: [email protected].
54+
55+
56+
!!! Note
57+
Register data processing is subject to several limitations. Therefore, we recommend contacting us at [email protected] (subject: sensitive data) before applying for a data permit to verify if the service matches your needs.
58+
59+
To access and analyse register data via the SD Desktop service:
60+
61+
1. Create [a CSC account](../../accounts/how-to-create-new-user-account.md) by logging in at the [My CSC portal](https://my.csc.fi) with your Haka account. If organization is not a member of the Haka or Virtu federation, contact us at [email protected]. Additional steps will be necessary to verify your identity.
62+
63+
2. Next, apply for a CSC project writing to [email protected] (subject: sensitive data) providing: - a copy of the data permit issued by the Findata authority; - a short description of your research project (name and research field are sufficient); - a list of all the project members, added in cc to the email (please use only organizational email addresses).
64+
65+
3. Each project member should activate the account's additional security verification (or Multi-factor Authentication) by scanning the QR code with a specific application (e.g. Google Authenticator). For further instructions, see the [MFA paragraph](../../accounts/mfa.md) under the Account section on the CSC user guide;
66+
67+
68+
4. Each project member should join the CSC project via the invitation link provided by the service desk and wait for approval;
69+
70+
71+
5. Fill in the [description of data processing activities](../../accounts/when-your-project-handles-personal-data.md) form;
72+
73+
74+
6. All project members should approve [the terms and conditions of SD Desktop service](../../accounts/how-to-add-service-access-for-project.md#member);
75+
76+
77+
For specific guidance regarding these steps, check the [Accounts](../../accounts/index.md) paragraph at the beginning of this user guide.
78+
79+
Note that you need to use your CSC username and password when you access data from your virtual desktop. If you don't remember your CSC password, you can [reset it](../../accounts/how-to-change-password.md) using the MyCSC portal.
80+
81+
82+
## Default storage space and billing units consumption
83+
84+
Using SD Connect and SD Desktop is free of charge for research purposes, according to [CSC's general terms of use](https://research.csc.fi/free-of-charge-use-cases). However, CSC service consumes resources: billing units for their use and quota for storage space allocation. A new CSC project includes about 10,000 billing units. You can find out how many billing units your CSC project will use with this [calculator](https://research.csc.fi/pricing). Here you can estimate the cost in billing units or euros. Once you have calculated how many billing units your project needs yearly, you can apply for more resources.
85+
86+
87+
### SD Connect:
88+
89+
When you apply for a new CSC project and service access for SD Connect/Allas, the default quota (or storage space) for SD Connect is 10 TB, which can be increased to 200 TB if needed. If you work with larger datasets and your project requires additional storage space, contact us for support at [email protected] (subject: sensitive data). Storing data in SD Connect/Allas consumes billing units.
90+
91+
The rate is: 1 units/TiBh, i.e. 1 TB of data stored in Allas consumes 24 Billing units in a day and 8760 BU in a year.
92+
93+
##¤ SD Desktop:
94+
95+
The default disk space (or storage space) in SD Desktop is 80 GB and can be increased to 280 GB by adding an external volume during virtual desktop creation. If you need additional storage space for data analysis, contact us for support at [email protected] (subject: sensitive data).
96+
Analysing data in SD Desktop consumes billing units based on the type of virtual desktop you are using. The rate is:
97+
98+
* Light computation, Billing units; 1.3 BU/h;
99+
100+
* Small computation, Billing Units: 5.2 units/h;
101+
102+
* Medium computation, Billing Units: 10.4 units/h;
103+
104+
* Heavy computation, Billing Units: 52 units/h.
105+
106+
107+
For further guidance on applying for additional quota or billing units, check the [Accounts](../../accounts/index.md) paragraph at the beginning of the user guide.

docs/data/sensitive-data/sd-desktop-audited.md

+4-4
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
11

22
# Sensitive Data Desktop for secondary use of health and social data
33

4-
Sensitive Data (SD) Desktop is a registered environment for secondary use of health and social data (register data). Access to the service requires a permit from the Findata authority. SD Desktop is a web-user interface that allows you to manage (start, use, delete) a virtual computer (here called Desktop, technically defined as a virtual machine) from your web browser. With the virtual Desktop, you can access the authorised datasets. No previous knowledge of cloud computing or programming expertise is required to use the service.
4+
Sensitive Data (SD) Desktop is a registered environment for secondary use of health and social data (register data). Access to the service requires a permit from the Findata authority. SD Desktop is a web-user interface that allows you to manage (start, use, delete) a virtual computer (here called desktop, technically defined as a virtual machine) from your web browser. With the virtual desktop, you can access the authorised datasets. No previous knowledge of cloud computing or programming expertise is required to use the service.
55
In the following user guide, you can learn how to:
66

77
* apply for service access;
8-
* set up your virtual Desktop;
8+
* set up your virtual desktop;
99
* analyze data authorised by Findata;
10-
* request export of non-sensitive results from the secure virtual Desktop.
10+
* request export of non-sensitive results from the secure desktop.
1111

1212
!!! Note
1313
We apologise for any confusion caused by the previous name of the service. You can apply to use SD Desktop by sending an application to Findata. This is a restricted version of the service compared to standard SD Desktop.
@@ -156,7 +156,7 @@ When you log in to SD Desktop **Homepage**, you will be able to access your virt
156156

157157
When you open the connection, a virtual computing environment (Linux Centos operating system) will open into your browser. When you access the virtual Desktop for the first time, you will see the getting started panel, from which you can, for example, adjust the screen resolution.
158158

159-
You can work with this virtual Desktop like in a standard computing environment. From the applications menu bar (top left corner) you can access several pre-installed programs. Examples include Open Office, image viewing applications, video and audio players, Jupiter Notebook etc. You can also open a terminal and use Linux from command line. To start using R-Studio please check [the paragraph](../../data/sensitive-data/sd_desktop.md#rstudio-in-sd-desktop) under SD Desktop.
159+
You can work with this virtual Desktop like in a standard computing environment. From the applications menu bar (top left corner) you can access several pre-installed programs. Examples include Open Office, image viewing applications, video and audio players, Jupiter Notebook etc. You can also open a terminal and use Linux from command line. To start using R-Studio please check [the following paragraph](../../data/sensitive-data/sd-desktop-audited.md#rstudio-in-sd-desktop).
160160

161161

162162
Security-related features of the audited SD Desktop include:

0 commit comments

Comments
 (0)