Cloud: Difference between revisions

From 太極
Jump to navigation Jump to search
 
(34 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Tips =
* [https://lifehacker.com/how-to-safely-store-sensitive-files-in-the-cloud-1848529835 How to Safely Store Sensitive Files in the Cloud]
* [https://www.ghacks.net/2017/06/15/a-comparison-of-linux-vps-providers-for-beginner-hosting/ A comparison of Linux VPS Providers for beginner hosting]
= Cloud/online storage =
* [https://www.makeuseof.com/tag/10-cloud-solutions-using-linux/ 10 Cloud Solutions You Should Be Using on Linux]
== Mounting ==
* [https://cryptomator.org/ Cryptomator] Free client-side encryption for your cloud files. Open source software: No backdoors, no registration
* [https://www.linuxuprising.com/2019/07/rclonetray-easily-mount-rclone-remotes.html?m=1 RcloneTray: Easily Mount Rclone Remotes On Demand Using A GUI]
== Mega ==
* [https://mega.nz/sync MegaSync]
== ownCloud ==
Use '''apt''' to install or go to the [https://owncloud.org/download/ download] page
== One Drive ==
* [https://packages.ubuntu.com/bionic/onedrive onedrive] package. [http://skilion.github.io/onedrive/ Homepage].
* https://github.com/skilion/onedrive
* [https://itsfoss.com/onedriver/ Mount Microsoft OneDrive in Linux With OneDriver GUI Tool] 2021
== Dropbox ==
See [[Software#Ubuntu|Software > Dropbox]].
== Google Drive ==
* [https://www.howtoforge.com/tutorial/how-to-access-your-google-drive-account-using-overgrive/  How to access your Google Drive account using '''overGrive'''] ($4.99) Support '''Auto sync''' and '''convert Google file format to Office format'''.
* [https://www.insynchq.com/ insync] ($30)
* Use [http://rclone.org rclone] program. See http://wiki.linuxquestions.org/wiki/Rsync_with_Google_Drive
** [https://www.linuxuprising.com/2019/08/rclone-149-adds-google-photos-backend.html?m=1 Rclone 1.49 Adds Google Photos Backend, New Web UI]
** [https://www.linuxuprising.com/2019/07/rclonetray-easily-mount-rclone-remotes.html?m=1 RcloneTray: Easily Mount Rclone Remotes On Demand Using A GUI]
** [https://www.linuxuprising.com/2019/10/rclone-browser-160-adds-new-options.html Cloud Storage GUI Rclone Browser 1.6.0 Adds New Options]
* [https://www.howtoforge.com/tutorial/how-to-access-google-drive-from-linux-gdrive/ How to access your Google Drive account from Linux command line using Gdrive] (Old)
* [https://www.ostechnix.com/how-to-mount-google-drive-locally-as-virtual-file-system-in-linux/ How To Mount Google Drive Locally As Virtual File System In Linux] (10/5/2018)
* [https://www.makeuseof.com/tag/access-google-drive-ubuntu/ How to Access Your Google Drive Account on Ubuntu] using '''Gnome Online Accounts''' (3/5/2018). In addition to the Google account, the program can be used to log into Nextcloud, Facebook, Microsoft, Flickr, Pocket, Foursquare, Microsoft Exchange and IMAP/SMTP accounts.
*# Install software <syntaxhighlight lang='bash'>
sudo apt install gnome-online-accounts # Probably already there
</syntaxhighlight>
*# Add google account. Either using the command line '''gnome-control-center online-accounts''' or using Settings > Online Accounts > Add an online account. Make sure the Files slider button is on. Close the Online Accounts dialog box.
*# Your Google Drive files are mounted in Nautilus now. You can add as many Google Drive accounts as you want. To add another, open Gnome Online Accounts again. Each account is listed separately in the sidebar in Nautilus.
Caveats:
* Unlike Windows or macOS, your Google Drive files are not downloaded and stored locally in Ubuntu. You must have an active internet connection to access your account.
* The online account files are located under "/run/user/1000/gvfs/" directory.
* PDF files can be opened by Document Viewer. When the file is loaded, it shows a random file name.
* The doc files cannot be opened by LibreOffice. When I drag and drop the files to Terminal, they show random file names like ''/run/user/1000/gvfs/google-drive:host=gmail.com,user=XXXXXXX/1LOLKBssIIR0x7TWR7MHIEeSU0uPj9TwK_YuAGTzt'
== Back up google photos ==
* [https://www.linuxuprising.com/2019/06/how-to-backup-google-photos-to-your.html How To Backup Google Photos To Your Computer With gphotos-sync] 2019-07-03
* [https://www.linuxuprising.com/2019/08/rclone-149-adds-google-photos-backend.html?m=1 Rclone 1.49 Adds Google Photos Backend, New Web UI] 2019-08-28
= Amazon =
= Amazon =
== Remote Desktop ==
== Remote Desktop ==
[https://www.nomachine.com/accessing-your-remote-linux-desktop-on-amazon-elastic-compute-cloud-via-NoMachine  
[https://www.nomachine.com/accessing-your-remote-linux-desktop-on-amazon-elastic-compute-cloud-via-NoMachine Accessing your remote desktop on Amazon's Elastic Compute Cloud via NoMachine]
Accessing your remote desktop on Amazon's Elastic Compute Cloud via NoMachine]


== [https://amazonlightsail.com/ Amazon Lightsail] ==
== [https://amazonlightsail.com/ Amazon Lightsail] ==
Virtual private servers starting at $5 a month (512MB memory, 1 Core, 20GB SSD, 1TB Transfer)
* Virtual private servers starting at $5 a month (512MB memory, 1 Core, 20GB SSD, 1TB Transfer)
* [https://www.makeuseof.com/free-website-hosting-on-amazon-lightsail/ How to Host a Free WordPress Website on Amazon Lightsail]


= Google =
= Google =
== Share PDF versions of Google Drive files ==
== Share PDF versions of Google Drive files ==
[http://www.makeuseof.com/tag/share-pdf-versions-google-drive-files-without-converting/ Share PDF Versions of Google Drive Files Without Converting by Hand][
[http://www.makeuseof.com/tag/share-pdf-versions-google-drive-files-without-converting/ Share PDF Versions of Google Drive Files Without Converting by Hand][
== Tips of using google drive ==
* [https://www.makeuseof.com/stop-paying-for-google-drive-storage/ Stop Paying for Google Drive Storage With These 7 Tips]
* [https://www.makeuseof.com/easy-way-clear-out-google-drive-free-space/ I Cleaned Out My Google Drive: Here’s How I Freed Up Storage Space Instantly]


== Open Google spreadsheet with the cursor on last working cell ==
== Open Google spreadsheet with the cursor on last working cell ==
Line 22: Line 77:
* [https://support.office.com/en-us/article/What-do-the-OneDrive-icons-mean-11143026-8000-44f8-aaa9-67c985aa49b3 What do the OneDrive icons mean?]
* [https://support.office.com/en-us/article/What-do-the-OneDrive-icons-mean-11143026-8000-44f8-aaa9-67c985aa49b3 What do the OneDrive icons mean?]
* [https://www.ghacks.net/2015/08/13/how-to-gain-access-to-onedrive-files-without-them-taking-up-storage-space/ How to gain access to OneDrive files without them taking up storage space]
* [https://www.ghacks.net/2015/08/13/how-to-gain-access-to-onedrive-files-without-them-taking-up-storage-space/ How to gain access to OneDrive files without them taking up storage space]
* [https://www.makeuseof.com/tag/remove-local-copies-onedrive-files-without-deleting/ How to Remove Local OneDrive Files Without Deleting Them]


For NIH one drive,  
For NIH one drive,  
Line 29: Line 85:
* it seems we cannot use oneDrive as a backup. If we unselect a folder for syncing, the folder will be immediately removed from the local system.
* it seems we cannot use oneDrive as a backup. If we unselect a folder for syncing, the folder will be immediately removed from the local system.
* not sure if the syncing is working. I copy a new folder to the local onedrive folder. The oneDrive icon on the top menu keeps rotation but nothing really happened. The new files are not in cloud and the syncing symbol shows files are not synced.
* not sure if the syncing is working. I copy a new folder to the local onedrive folder. The oneDrive icon on the top menu keeps rotation but nothing really happened. The new files are not in cloud and the syncing symbol shows files are not synced.
== Access offline ==
[https://www.makeuseof.com/access-onedrive-files-offline-windows/ How to Access OneDrive Files Offline on a Windows PC]
== SharePoint ==
[https://www.makeuseof.com/microsoft-sharepoint-sites-explained/ Microsoft SharePoint Sites Explained: Hub Site, Team Site, and Communication Site]
= Shared hosting and VPS =
[https://www.pcworld.com/article/1937668/best-web-hosting-services.html Best web hosting services 2023: Expert picks and advice]


= [https://www.digitalocean.com/ DigitalOcean] =
= [https://www.digitalocean.com/ DigitalOcean] =
Virtual private servers starting at $5 a month (512MB memory, 1 Core, 20GB SSD, 1TB Transfer)
Virtual private servers starting at $5 a month (512MB memory, 1 Core, 20GB SSD, 1TB Transfer)
= Oracle cloud =
<ul>
<li>https://oracle.com/cloud/
<li>[https://www.youtube.com/watch?v=E3z-T7d2jEI 【甲骨文】云服务器免费注册地址大全!]
<li>Be sure to keep SSH keys since there is no way to retrieve it
* For some reason, suddenly I cannot ssh connect to my VM after I installed and ran the calibre docker container.
* On another machine, my ssh connection got kicked out '''client_loop: send disconnect: Broken pipe'''
* The '''console connection''' method still relies on SSH, which doesn't solve your original problem. Unfortunately, Oracle Cloud Infrastructure (OCI) doesn't provide a direct, non-SSH method to access the command line of your VM through the web interface, unlike some other cloud providers.
<li>Hamburger icon on top-left -> Billing and cost management.
<li>Difficult to create VMs: Out of capacity for shape VM.Standard.A1.Flex in availability domain AD-2. Create the instance in a different availability domain or try again later. If you specified a fault domain, try creating the instance without specifying a fault domain, otherwise try creating the instance in a different availability domain. If that doesn’t work, please try again later.
* [https://www.reddit.com/r/oraclecloud/comments/zf0tje/out_of_capacity_for_shape_vmstandarda1flex/ Out of capacity for shape VM.Standard.A1.Flex]
* Change A1.Flex to A2.Flex will help but A2.Flex is not always free
* '''VM.Standard.E2.1.Micro''' is always available. But we are limited to
** 2 instances.
** '''RAM = 1GB''' No cache in VM. So if we ran out of memory, the machine will be frozen. Need to reboot.
** Network bandwidth is .48 rather 1 GB/s.
<li>[https://www.reddit.com/r/oraclecloud/comments/zqk3ky/how_much_space_i_can_use_with_free_tier/ how much space i can use with free tier?] 200GB in total.
<li>Linux distribution
* Ubuntu default username: ubuntu (about 240 MB RAM, [https://www.reddit.com/r/oraclecloud/comments/12jueh3/lightest_image_on_ram_for_micro_instances/ Lightest image on RAM for micro instances])
* Rocky linux default username: rocky. Rocky linux is way too heavy and slow on E2.1.Micro. "dnf update" takes long time. Why total memory is 760MB instead of 1GB.
<li>Post installation <BR/>
Fix date/time  (works for Ubuntu & rocky)
<syntaxhighlight lang='sh'>
sudo timedatectl set-timezone America/New_York
</syntaxhighlight>
<li>Open ports
* Document [https://docs.oracle.com/en-us/iaas/developer-tutorials/tutorials/apache-on-ubuntu/01oci-ubuntu-apache-summary.htm Free Tier: Install Apache and PHP on an Ubuntu Instance]. Search " Enable Internet Access" and "ingress rule".
* Document [https://docs.oracle.com/en-us/iaas/Content/Network/Concepts/overview.htm Networking Overview] Access to the Internet
* [https://stackoverflow.com/questions/54794217/opening-port-80-on-oracle-cloud-infrastructure-compute-node Opening port 80 on Oracle Cloud Infrastructure Compute node] & the link to [https://medium.com/@fathi.ria/oracle-database-cloud-open-ports-on-oci-1af24f4eb9f2 Oracle Database Cloud — Open Ports on OCI]
* [https://www.reddit.com/r/oraclecloud/comments/r8lkf7/comment/hv4kqyu/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button This works]. Suppose I installed Docker and start a nginx container. Then, Step 1 ('''seems not needed''').
<pre>
sudo apt install firewalld
sudo firewall-cmd --zone=public --permanent --add-port=8080/tcp
# sudo firewall-cmd --zone=public --permanent --remove-port=8080/tcp
sudo firewall-cmd --reload
sudo firewall-cmd --state9
sudo systemctl status firewalld
sudo firewall-cmd --list-all
sudo firewall-cmd --list-ports  # list open ports
</pre>
Or (not tested).
<pre>
sudo apt install ufw
ufw --version
sudo ufw enable
sudo ufw allow 80/tcp
sudo ufw status
</pre>
Step 2. Click on my '''Virtual cloud network''' vcn-2024xxxx-xxxx. Subnets -> '''subnet-2024XXXX-xxxx''' -> Security Lists -> "Default Security List for vcn-2024XXXX-xxxx" -> Ingress Rules -> Add '''Ingress Rules'''. Currently the rules contain port 22. So I just add port 8080.
</ul>
== Swap file ==
* [https://www.howtogeek.com/455981/how-to-create-a-swap-file-on-linux/ How to Create a Swap File on Linux]
* [https://docs.oracle.com/en/operating-systems/oracle-linux/6/admin/swap-create-use.html 18.2.2 Creating and Using a Swap File]
<pre>
sudo dd if=/dev/zero of=/swapfile bs=1M count=3072
sudo mkswap /swapfile
sudo chmod 600 /swapfile
sudo swapon /swapfile
echo '/swapfile none swap sw 0 0' | sudo tee -a /etc/fstab
</pre>
== Change hostname ==
[https://linuxconfig.org/setting-the-hostname-on-ubuntu-24-04 Setting the Hostname on Ubuntu 24.04]
<pre>
sudo hostname linuxconfig
sudo hostnamectl set-hostname linuxconfig
sudo nano /etc/hosts
</pre>
== Idle instance reclaim ==
[https://docs.oracle.com/en-us/iaas/Content/FreeTier/freetier_topic-Always_Free_Resources.htm#compute__idleinstances  Always Free Resources]
Idle Always Free compute instances may be reclaimed by Oracle. Oracle will deem virtual machine and bare metal compute instances as idle if, during a 7-day period, the following are true:
* CPU utilization for the 95th percentile is less than 20%
* Network utilization is less than 20%
* Memory utilization is less than 20% (applies to A1 shapes only)
== Minimal Ubuntu in Oracle Cloud ==
<pre>
This system has been minimized by removing packages and content that are
not required on a system that users do not log into.
To restore this content, you can run the 'unminimize' command.
</pre>
* htop shows 197MB (vs 247MB) on Ubuntu 24.04.1 LTS.
* It's optimized for cloud environments and automated deployments.
* It has a smaller footprint, faster boot times, and requires fewer security updates.
* It lacks many convenience tools typically found in standard Ubuntu Server installations. For example, manual pages, text editors, network diagnostic tools,...


= [https://c9.io/ Cloud9] =
= [https://c9.io/ Cloud9] =
Line 48: Line 208:
** [http://www.sparkleshare.org/ SparkShare], [https://www.linuxuprising.com/2019/01/sparkleshare-dropbox-like-sync-client.html Dropbox-Like Sync Client Powered By Git]  
** [http://www.sparkleshare.org/ SparkShare], [https://www.linuxuprising.com/2019/01/sparkleshare-dropbox-like-sync-client.html Dropbox-Like Sync Client Powered By Git]  
** [https://cozy.io/en/ Cozy].
** [https://cozy.io/en/ Cozy].
== File sharing platforms ==
[https://www.geeksmint.com/open-source-cloud-file-sharing-platforms/ 22 Best Free Open Source Cloud File Sharing Platforms]


== [https://owncloud.org/ ownCloud] ==
== [https://owncloud.org/ ownCloud] ==
Line 64: Line 227:


= Free website hosting services =
= Free website hosting services =
[https://www.makeuseof.com/tag/best-free-website-hosting-services/ The Best Free Website Hosting Services in 2019]
* [https://www.makeuseof.com/tag/best-free-website-hosting-services/ The Best Free Website Hosting Services in 2019]
* [https://www.makeuseof.com/tag/free-website-hosting-dropbox-google-drive-onedrive/ How to Get Free Website Hosting With Dropbox, Google Drive, or OneDrive] 2022


= Decide a date/schedule a meeting =
= Decide a date/schedule a meeting =
* https://doodle.com/
* https://doodle.com/
* https://www.surveymonkey.com/mp/online-schedule-poll/
* https://www.surveymonkey.com/mp/online-schedule-poll/

Latest revision as of 14:35, 10 March 2025

Tips

Cloud/online storage

Mounting

Mega

ownCloud

Use apt to install or go to the download page

One Drive

Dropbox

See Software > Dropbox.

Google Drive

Caveats:

  • Unlike Windows or macOS, your Google Drive files are not downloaded and stored locally in Ubuntu. You must have an active internet connection to access your account.
  • The online account files are located under "/run/user/1000/gvfs/" directory.
  • PDF files can be opened by Document Viewer. When the file is loaded, it shows a random file name.
  • The doc files cannot be opened by LibreOffice. When I drag and drop the files to Terminal, they show random file names like /run/user/1000/gvfs/google-drive:host=gmail.com,user=XXXXXXX/1LOLKBssIIR0x7TWR7MHIEeSU0uPj9TwK_YuAGTzt'

Back up google photos

Amazon

Remote Desktop

Accessing your remote desktop on Amazon's Elastic Compute Cloud via NoMachine

Amazon Lightsail

Google

Share PDF versions of Google Drive files

Share PDF Versions of Google Drive Files Without Converting by Hand[

Tips of using google drive

Open Google spreadsheet with the cursor on last working cell

https://stackoverflow.com/a/28893127

Sync Files to Your Computer

How to Sync Google Drive and OneDrive Files to Your Computer

Microsoft Onedrive

For NIH one drive,

  • we can only share with NIH users.
  • When sharing a file, the receiver needs to sign in through their browser and if the files are large, it cannot be opened online and needs to be downloaded to local first.
  • we need a PIV card in order to see oneDrive online.
  • it seems we cannot use oneDrive as a backup. If we unselect a folder for syncing, the folder will be immediately removed from the local system.
  • not sure if the syncing is working. I copy a new folder to the local onedrive folder. The oneDrive icon on the top menu keeps rotation but nothing really happened. The new files are not in cloud and the syncing symbol shows files are not synced.

Access offline

How to Access OneDrive Files Offline on a Windows PC

SharePoint

Microsoft SharePoint Sites Explained: Hub Site, Team Site, and Communication Site

Shared hosting and VPS

Best web hosting services 2023: Expert picks and advice

DigitalOcean

Virtual private servers starting at $5 a month (512MB memory, 1 Core, 20GB SSD, 1TB Transfer)

Oracle cloud

  • https://oracle.com/cloud/
  • 【甲骨文】云服务器免费注册地址大全!
  • Be sure to keep SSH keys since there is no way to retrieve it
    • For some reason, suddenly I cannot ssh connect to my VM after I installed and ran the calibre docker container.
    • On another machine, my ssh connection got kicked out client_loop: send disconnect: Broken pipe
    • The console connection method still relies on SSH, which doesn't solve your original problem. Unfortunately, Oracle Cloud Infrastructure (OCI) doesn't provide a direct, non-SSH method to access the command line of your VM through the web interface, unlike some other cloud providers.
  • Hamburger icon on top-left -> Billing and cost management.
  • Difficult to create VMs: Out of capacity for shape VM.Standard.A1.Flex in availability domain AD-2. Create the instance in a different availability domain or try again later. If you specified a fault domain, try creating the instance without specifying a fault domain, otherwise try creating the instance in a different availability domain. If that doesn’t work, please try again later.
    • Out of capacity for shape VM.Standard.A1.Flex
    • Change A1.Flex to A2.Flex will help but A2.Flex is not always free
    • VM.Standard.E2.1.Micro is always available. But we are limited to
      • 2 instances.
      • RAM = 1GB No cache in VM. So if we ran out of memory, the machine will be frozen. Need to reboot.
      • Network bandwidth is .48 rather 1 GB/s.
  • how much space i can use with free tier? 200GB in total.
  • Linux distribution
    • Ubuntu default username: ubuntu (about 240 MB RAM, Lightest image on RAM for micro instances)
    • Rocky linux default username: rocky. Rocky linux is way too heavy and slow on E2.1.Micro. "dnf update" takes long time. Why total memory is 760MB instead of 1GB.
  • Post installation
    Fix date/time (works for Ubuntu & rocky)
    sudo timedatectl set-timezone America/New_York
  • Open ports
    sudo apt install firewalld
    sudo firewall-cmd --zone=public --permanent --add-port=8080/tcp
    # sudo firewall-cmd --zone=public --permanent --remove-port=8080/tcp
    sudo firewall-cmd --reload
    
    sudo firewall-cmd --state9
    sudo systemctl status firewalld
    sudo firewall-cmd --list-all
    sudo firewall-cmd --list-ports  # list open ports
    

    Or (not tested).

    sudo apt install ufw
    ufw --version
    sudo ufw enable
    sudo ufw allow 80/tcp
    sudo ufw status
    

    Step 2. Click on my Virtual cloud network vcn-2024xxxx-xxxx. Subnets -> subnet-2024XXXX-xxxx -> Security Lists -> "Default Security List for vcn-2024XXXX-xxxx" -> Ingress Rules -> Add Ingress Rules. Currently the rules contain port 22. So I just add port 8080.

Swap file

sudo dd if=/dev/zero of=/swapfile bs=1M count=3072
sudo mkswap /swapfile
sudo chmod 600 /swapfile
sudo swapon /swapfile
echo '/swapfile none swap sw 0 0' | sudo tee -a /etc/fstab

Change hostname

Setting the Hostname on Ubuntu 24.04

sudo hostname linuxconfig
sudo hostnamectl set-hostname linuxconfig
sudo nano /etc/hosts

Idle instance reclaim

Always Free Resources

Idle Always Free compute instances may be reclaimed by Oracle. Oracle will deem virtual machine and bare metal compute instances as idle if, during a 7-day period, the following are true:

  • CPU utilization for the 95th percentile is less than 20%
  • Network utilization is less than 20%
  • Memory utilization is less than 20% (applies to A1 shapes only)

Minimal Ubuntu in Oracle Cloud

This system has been minimized by removing packages and content that are
not required on a system that users do not log into.

To restore this content, you can run the 'unminimize' command.
  • htop shows 197MB (vs 247MB) on Ubuntu 24.04.1 LTS.
  • It's optimized for cloud environments and automated deployments.
  • It has a smaller footprint, faster boot times, and requires fewer security updates.
  • It lacks many convenience tools typically found in standard Ubuntu Server installations. For example, manual pages, text editors, network diagnostic tools,...

Cloud9

How to Install WordPress on a Virtual Server for Free Using Cloud9

Mega: 50GB free

pCloud: 10GB free

This Dropbox Alternative Frees Up Device Storage Without Deleting Anything

Self-hosted

File sharing platforms

22 Best Free Open Source Cloud File Sharing Platforms

ownCloud

NextCloud

See NextCloud

Seafile

Similar to Nextcloud as it allows you to host your own cloud storage, while offering a Dropbox-style service. It has a Raspberry Pi server version. Github.

Video streaming

The 10 Best Free Movie Streaming Sites

Images

The Best Free Image Hosting Websites

Free website hosting services

Decide a date/schedule a meeting