Learn Free Google Virtual Machine In Google Cloud “ Askjitendrakumar.com

Image Source: https://askjitendrakumar.com/google-virtual-machine/

Big data is massive. Right? There is no doubt about it. Suppose you’re an aspirant Big Data Engineer or an Architect and are not yet from Cloud Platforms. In that case, you’re not connected to the infrastructure and platform needed for implementing large-scale Big Data solutions.

There are a myriad of firms that are operating in the Cloud market. My first choice is Google. Machine learning and analytics at the internet-scale are part of Google’s initial DNA.

My interest in GCP is to harness Google’s creativity in its applications and make it accessible to all. We won’t get into too many details right now.

This article is a straightforward goal. To experiment, learn and play with the latest Big Data tools, you require a top-of-the-line machine. This is a substantial expenditure. GCP lets you access the needed infrastructure for free cost for a whole year.

I’ll explain the basics of setting up and running a virtual machine with GCP in this post. I will provide ways to keep the costs lower and help you get through the free credits available for the whole year.

In the above article we will provide information on what follows.

1. Create and Manage a Linux VM in GCP
2. SSH to the Linux VM
3. Upload/download file to Linux VM
4. Connect to the VM by using third-party tools

Create A Free Account To Sign Up

The first step is to sign-up for an account for free. These are steps in below:

1. Go to cloud.google.com and hit the “Try it free” button.
2. Utilize your Gmail credentials to log in.
3. Take note of the conditions and terms of the agreement and click next.
4. In the next screen, you must create your payment profile. Select the account type that is an individual.
5. Tax information for an unregistered individual. You can leave tax information (PAN as well as TAN numbers) in an empty.
6. Enter your name and address information.
7. Then, you must enter the credit card number along with other details.
8. Then, hit the Start my free trial button. It’ll take just some time, and Google will establish an account for you at no cost and also the GCP task for you.

Google doesn’t charge for the account. Actually, they’ll provide you with USD 300 credits to the Google cloud accounts. It is possible to learn at no cost for a year or until you’ve exhausted the USD 300 credit.

I’ll give you some ideas to keep the prices at a minimum and use the credits for free to get the most benefit. After the year or having exhausted the credit limit you have been granted, they won’t charge you for anything until you have manually upgraded your account to become a paying customer.

There’s nothing to be concerned about your money.

Google Cloud Project

GCP project functions as an office for you. Google manages all resources, including credentials, permissions, and billing details, on a project level.

The GCP project will be assigned the following: a named Project, an automatically produced Project number, and an internationally unique Project ID.

You can choose an appropriate project name as well as a Project ID. It isn’t possible to alter this project ID at a later time.

Therefore, I suggest making a Project ID which you will be able to remember. Your free account permits you to create either 5 or 6 projects. I doubt you’ll require more than that until you plan to launch a live application.

A few projects are sufficient for learning and experimentation. After you’ve successfully signed up to receive a free GCP trial period, you will find your project’s dashboard. If you’re not there, Click the home button located in the top left corner, and you’ll get there.

Create Your Very First Virtual Machine

You can build the virtual machine in various ways; however, I like using the menu for compute engines. In the left side you will see options menu. Scroll down to select the compute engine option. Follow the steps below

1. Hit on Create button for the compute engine.
2. Give an appropriate name to the instance.
3. Choose the zone you want to select-the approximate monthly costs. You can test different zones. I discovered that the price is different for each zone. Choose the option that is the cheapest.
4. Select a type of machine. Because we’re experimenting, pick the smallest size available.
5. Choose which OS image. I like using CentOS 6 because most of my tutorials use the identical version. There are many options to pick from.
6. The standard size for disks of 10GB is HDD. They have choice of SSD; but , it’s pricely. The 10GB HDD is enough in the case of the OS. If you need to, you can purchase another HDD or SSD in the future.
7. Press the Create button. Only a few seconds later, your VM is running.
8. If you wish to end, select the VM and click on the stop button. If you need to eliminate it from your system, press the delete icon.

The CPU and RAM of your desktop are the essential part of the cost. The amount shows it is your amount that Google will deduct from your free credit when you continue to run the system for 730 hours per month.

I’m not sure you’ll need to run it longer than 100 hours within a month. The machine will be started to do your research, then put down, then restart it up again after you return the following day for your lab.

A key price element is the cost of the disk. Keep in mind that the cost for storage is in effect regardless of the time you shut down the machine. IT is because GCP reserves HDD space for you.

When you close your VM, you’re not using CPU or RAM; however, Google cannot use the HDD space for another use until you remove the storage. Make sure you select the space on your disk carefully. Check the price. It is possible to increase it in the future if you need more.

SSH into your VM

There is a way to SSH directly to the VM by using a web-based SSH tool. It’s the most straightforward method. Click the ssh button near your VM. The VM will then be signed into the system as an administrator with sudo privileges.

If you’d like to install any other tools, you can make use of the command yum. But, the majority of tools are preconfigured and ready for use.

How do make use of Putty and WinSCP in conjunction with GCP VM?

It is a terminal that start on a desktop. SSH Window is a terminal that runs on a browser. However, you can copy-paste things by using Ctrl+Shift+C and Ctrl+Shift+V.

It is possible to upload and download files via the VM by using the menu options within the SSH window. Therefore, in truth, you don’t require Putty or Windows SCP to use your GCP virtual machines. The tools are all available in the browser itself.

Let’s say that you’re not planning to make use of an internet-based SSH. You’re looking to utilize a specific third-party tool for a reason. You could do that too if you’d like, for instance, your friend to have access to the VM.

However, you don’t want to declare him a member or part of the team. It’s possible to make that happen as well. I’ll list the steps to take.

Generate a pair of SSH keys for an unspecified user

Use the following command.

ssh-keygen -t rsa -f ~/.ssh/tanya-gcp-ssh-key -C tanya

The ssh-keygen is the command’s name. The next component (-t rsa) is the name of the key. Then you specify the filename (~/.ssh/tanya-gcp-ssh-key). You can select any file name you like.

The final component will be the user name (-C tanya). You can choose any username you prefer. You do not require to make a new user, enter the password and then provide credentials. GCP will take care of that. GCP will handle this. You require to obtain the username you want.

you’ll have two files. The first holds the private key, while the second (the .pub file) is the one that contains your public keys. GCP has also tagged the files with a username you input into the ssh-keygen command. You must attach public keys to the VM. Follow these steps for doing this.

1. Copy the contents from the key public.
2. Enter the screen for the compute engine.
3. Click on the instance’s name.
4. Click Edit on the right.
5. Scroll down until you find and then click on the SSH Keys.
6. Copy your public key into the box and save it.

Save the key file

next step will be to save the key file and then share it with your friends or anyone else who you would like to access your machine. They can utilize the private key to log in to your GCP Virtual Machine.

Private Key file format

Unfortunately, the private key file isn’t working in the original format. We need to transform the file into Putty’s key file format. This can be done using the PuttyGen tool. PuttyGen is coming with Putty.

Therefore, you should start the program to load your file. Then save it as an encrypted key. This is all there is to it. You can now use the new file by using Putty and WinSCP to connect to your VM. Follow these steps to connect with Putty.

1. Start Putty.
2. You must enter the [email protected] address. Make use of the IP address external to your VM.
3. Following that, you must issue an encrypted key.
4. Click the button that opens.

It should connect. You should be signed in to your account using your username when you created your SSH key pairing. Keep in mind you should not distribute your private keys with other people since the user has sudo credentials.

Continue reading to build the multi-node Hadoop and Spark clusters in Google Cloud Platform.

Originally published at https://askjitendrakumar.com/google-virtual-machine/on November 2, 2021.