Monday, April 10, 2023

How to install GNOME GUI on top of minimal installation

The reference in the techmint is a good one for installing gui on top of minimal installation. Essentially, below are the commands 


dnf group list --installed

dnf group list --available

dnf group install "Workstation"

dnf group install "Server with GUI"


systemctl get-default

systemctl set-default graphical

systemctl get-default

reboot

references:

https://www.tecmint.com/install-gui-desktop-rocky-linux-9/

Sunday, April 9, 2023

What is a Hypervisor?

A hypervisor, also known as a virtual machine monitor or VMM, is a type of virtualization software that supports the creation and management of virtual machines (VMs) by separating a computer’s software from its hardware. Hypervisors translate requests between the physical and virtual resources, making virtualization possible. When a hypervisor is installed directly on the hardware of a physical machine, between the hardware and the operating system (OS), it is called a bare metal hypervisor. Some bare metal hypervisors are embedded into the firmware at the same level as the motherboard basic input/output system (BIOS). This is necessary for some systems to enable the operating system on a computer to access and use virtualization software.


Because the bare metal hypervisor separates the OS from the underlying hardware, the software no longer relies on or is limited to specific hardware devices or drivers.  This means bare metal hypervisors allow operating systems and their associated applications to run on a variety of types of hardware. They also allow multiple operating systems and virtual machines (guest machines) to reside on the same physical server (host machine). Because the virtual machines are independent of the physical machine, they can move from machine to machine or platform to platform, shifting workloads and allocating networking, memory, storage, and processing resources across multiple servers according to needs. For example, when an application needs more processing power, it can seamlessly access additional machines through the virtualization software. This results in greater cost and energy efficiency and better performance, using fewer physical machines. 


References:

https://www.vmware.com/in/topics/glossary/content/bare-metal-hypervisor.html

What is Witness VM

A "Witness" is a special VM that monitors the Metro Availability configuration health. The Witness resides in a separate failure domain to provide an outside view that can distinguish a site failure from a network interruption between the Metro Availability sites. It can only be configured on AHV and ESXi hypervisors.


The main functions of a Witness include:


· Making a failover decision in the event of a site or inter-site network failure.

· Avoiding a split-brain condition where the same storage container is active on both sites due to (for example) a WAN failure.

· Handling situations where a single storage or network domain fails.



referencs:

https://next.nutanix.com/how-it-works-22/witness-vm-and-why-you-might-need-it-38343#:~:text=A%20%22Witness%22%20is%20a%20special,on%20AHV%20and%20ESXi%20hypervisors.

What is Cisco HyperFlex Strech Cluster deployment

A Hyperflex stretched cluster is a single cluster with geographically distributed nodes. Both sides of the cluster act as primary for certain user VMs. The data for these VMs is replicated synchronously on the other site. Stretched clusters enable you to access the entire cluster even if one of the sites were to completely go down. Typically these sites are connected with a low latency, dedicated, high-speed link between them.


HyperFlex Stretched Cluster enables you to deploy an Active-Active disaster avoidance solution for mission critical workloads requiring high uptime (near zero Recovery Time Objective) and no data loss (zero Recovery Point Objective).


 Prerequisites

Requirements

All the nodes in the cluster should be of the same M5 models (All HX220 M5) or (HX 240 M5)

Only M5 node are supported in sctretch Clusters

Stretch clusters is only supported on ESXi HX platforms

Each site should have a minimum of 2 nodes

ALL the VLANs used on both clusters have to be SAME

Stretch cluster configuration requires a Witness VM

Stretch Clustres require the same number of IP addresses that is needed for a six node cluster

Only one instance of vCenter is used for a stretch cluster

vCenter with DRS and HA is required for the stretch cluster to work properly


References:

https://www.cisco.com/c/en/us/support/docs/hyperconverged-infrastructure/hyperflex-hx-data-platform/214489-hyperflex-stretch-clusters-deployment-gu.html

What is Optuna

Optuna is a software framework for automating the optimization process of these hyperparameters. It automatically searches for and finds optimal hyperparameter values by trial and error for excellent performance. Currently, the software can be used in Python.


Optuna uses a history record of trials to determine which hyperparameter values to try next. Using this data, it estimates a promising area and tries values in that area. Optuna then estimates an even more promising region based on the new result. It repeats this process using the history data of trials completed thus far. Specifically, it employs a Bayesian optimization algorithm called Tree-structured Parzen Estimator.



A hyperparameter is a parameter to control how a machine learning algorithm behaves. In deep learning, the learning rate, batch size, and number of training iterations are hyperparameters. Hyperparameters also include the numbers of neural network layers and channels. They are not, however, just numerical values. Things like whether to use Momentum SGD or Adam in training are also regarded as hyperparameters.


It is almost impossible to make a machine learning algorithm do the job without tuning hyperparameters. The number of hyperparameters tends to be high, especially in deep learning, and it is believed that performance largely depends on how we tune them. Most researchers and engineers that use deep learning technology manually tune these hyperparameters and spend a significant amount of their time doing so.




References:

https://odsc.com/blog/optuna-an-automatic-hyperparameter-optimization-framework/#:~:text=Optuna%20is%20a%20software%20framework,can%20be%20used%20in%20Python.

Saturday, April 8, 2023

AI/ML What is Apache Zeppelin

Web-based notebook that enables data-driven,

interactive data analytics and collaborative documents with SQL, Scala, Python, R and more.


Zeppelin SDK

Not only you can use Zeppelin as interactive notebook, you can also use it as JobServer via Zeppelin SDK (client api & session api)


Spark Interpreter Improved

Spark interpreter provides comparable Python & R user experience like Jupyter Notebook.



Flink Interpreter Improved

Flink interpreter is refactored, supports Scala, Python & SQL. Flink 1.10 and afterwards (Scala 2.11 & 2.12) are all supported.


Yarn Interpreter Mode

You can run interpreter in yarn cluster, e.g. you can run Python interpreter in yarn and R interpreter in yarn.


Inline Configuration

Generic ConfInterpreter provide a way configure interpreter inside each note.


Interpreter Lifecycle Management

Interpreter lifecycle manager automatically terminate interpreter process on idle timeout. So resources are released when they're not in use. See here for more details.

Multi-purpose Notebook

The Notebook is the place for all your needs


 Data Ingestion

 Data Discovery

 Data Analytics

 Data Visualization & Collaboration


Multiple Language Backend

Apache Zeppelin interpreter concept allows any language/data-processing-backend to be plugged into Zeppelin. Currently Apache Zeppelin supports many interpreters such as Apache Spark, Apache Flink, Python, R, JDBC, Markdown and Shell.


References

https://zeppelin.apache.org/



what is X11 on Linux

X11 is very important for a sysadmin because some applications only install or run on GUI. This always happen in case of third party applications. So in this article, we are talking about how to use x11 forwarding.

This is an awesome tool for every sysadmin who is working remotely via putty and need to work or install GUI applications.

Mostly cases we use it on java and KVM applications with the help of x11. 

If you are using it on the remote machine do not set any environment variable. Just enable x11 forwarding in ssh setting in putty and follow the below steps.

references:

https://www.explinux.com/2020/07/how-to-enable-x11-forwarding-in-rhel-8-centos-8.html