Most Popular Open Source DevOps Tools ( With Installation And Configuration )

In this post, let’s look at the steps to install and configure the most used DevOps tools in the current IT industry which are in high demand.

Before moving ahead, we recommend beginners to have a little grasp on what is DevOps, why DevOps was introduced and DevOps working by referring to our blog An Introduction To DevOps.

System Prerequisite:

Ahead of installing we request the user to review the following system requirements.

• Stable Internet connection.
• Ubuntu 16.4
• Root user privileges.
• Minimum 4 GB RAM and 500GB hard drive.

What you will learn:

“What you will learn” after reading this post. You will be able to Install and configure the below listed open source DevOps tools.

1. Install or upgrade Java to version 8

• Set JAVA_HOME

2. Install and configure Git

• Git Configuration.
• Initialize a Git Repository.
• Add And Commit Files To GitHub Repository.

3. Install Maven

• Configure Maven.
• Update PATH Environment Variable.

4. Install Jenkins

• Adjust Firewall.
• Setting Up Jenkins.
• Getting Started With Jenkins Through Web UI.

5. Install Tomcat

• Download And Install Tomcat Server
• Start Tomcat Server
• Stop Tomcat Server
• Configure Tomcat Server
• Change The Default PORT

6. Install Apache ANT

• Installing Apache ANT
• Check Version Of Apache ANT

7. Install Chef

• Install NTP Service
• Enable NTP Service
• Start NTP Service
• Download Chef Development Kit File For Ubuntu
• Install Chef Development Kit
• Hands-on With A Simple Example.

8. Install Docker

• Installing Docker
• Start Docker Services
• Hands-on With Docker Commands

9. Nagios Installation

• Create User And Group For Nagios
• Download And Install Nagios
• Setup Apache 2 With Authentication
• Configure Nagios
• Download And Install Nagios Plugins
• Verify The Settings
• Start The Nagios Services
• Access The Web UI Of NagiosStep 1: Before installing java make sure the newest versions of all packages are currently installed on the Ubuntu system.
  sudo apt-get update -y

  

  Step 2: Nowadays most of the software uses Java version 8 and above because Java version 8 is a superlative release of the world’s #1 development platform. Follow the steps below to download and install Java 8.

  sudo apt-get install openjdk-8-jre-headless -y

  

  Step 3: Set JAVA_HOME  Environment Variables.

  vim .bashrc

  Once you open the bashrc_profile, insert the following two lines at the end of the file.

  export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64

  export PATH=$PATH:$JAVA_HOME/bin

  

  Note: Use the command esc : wq! to save and exit the .bashrc file.

  Step 4: Use the below command to see the newly installed java.

  java -version

  

  We can see from the above screenshot Java 8 is successfully installed.

  Now Let us see the steps to install and configure GIT which is the most popular version control software.

  Step 1: To install git use the following command in the terminal.

  sudo apt-get install git -y

  

  As you can see GIT is already present in Ubuntu if it is not installed then use the above command to install GIT in your system.

  Step 2: To check the git version you can use the below command:

  git –version

  

  GIT Configuration

  Step 3: Before using GIT repository we have to configure the “email id” and the “username”. Thus use the following commands to configure.

  git config –global user.name “Your Name”

  git config –global user.email your email address

  

  As you have configured the “user name” and “email id”, all the above information is stored in the below gitconfig file

  ~/.gitconfig

  

  Step 4: Create and Initialize a GIT repository using the below commands.

  mkdir -p /home/acadgild/myproject

  cd /home/acadgild/myproject/

  git init

  

  Step 5: Add and Commit files to GIT repository by using the below commands.

  vim wordcount.py

  git add .

  git commit -m “First Commit”

  

  You have successfully installed and configured the GIT. Now you are ready to use this open source distributed version control system.

  Maven is one of the best build automation tools which is mostly used for building Java-based projects.

  Maven addresses two aspects of building software:

  • First, it describes how software is built,
  • Second, it describes its dependencies.

  Step 1: Use the below command to install maven.

  sudo apt-get install maven

  

  Step 2: Update and set the MAVEN_HOME environment variable in bashrc_profile

  sudo vim .bashrc

  Once you open the bashrc profile type the below two lines at the end of the file.

  export MAVEN_HOME=/usr/share/maven

  export PATH=$PATH:$MAVEN_HOME/bin

  

  Note: Use the command esc : wq! to save and exit the .bashrc file.

  Step 3: Now to update the changes which we have made in the bash_profile type the below command.

  source .bashrc

  You have successfully installed Maven.

  Jenkins is a continuous integration server which is written in Java. It can handle any type of build or continuous integration. It is used by different teams of different sizes for those projects that may have heterogeneous languages like Java, .net, PHP, etc

  Installing Jenkins

   

  Follow the below steps to install Jenkins.

  Step 1: Add the Jenkins Debian repository.

  wget -q -O – https://pkg.jenkins.io/debian/jenkins.io.key | sudo apt-key add –

  sudo sh -c ‘echo deb http://pkg.jenkins.io/debian-stable binary/ > /etc/apt/sources.list.d/jenkins.list’

  

  Step 2: Once the Jenkins repository is created in the following path, update the repository and install Jenkins using the below commands.

  sudo apt-get update -y

  sudo apt-get install jenkins -y

  

  Step 3: Jenkins service will start automatically after the installation and you can check the status of the Jenkins service by using the below command.

  sudo service jenkins status

  If you want to start the Jenkins manually then use the below command.

  sudo service jenkins start

  

  If you want to stop the Jenkins manually then you can use the below command.

  sudo service jenkins stop

  Adjusting Firewall

  Step 4: If you are installing Jenkins on remote Ubuntu server  that  protected by a firewall

  All you have to do is you need to open the port 8080 because this is the default port which will be used by Jenkins web UI.

  Let us the below commands to open the port 8080:

  sudo ufw allow 8080

  sudo ufw status

  Getting started with Jenkins web UI

  Step 5:  As the Jenkins service is already started, we can use the below command to launch the Jenkins Web UI.

  Open the browser and type the below URL

  http://localhost:8080

  Below is the page which will be displayed.

  

  The first time/ First, you have to enter the password which is located in the below location

  /var/lib/jenkins/secrets/initialAdminPassword

  Now we will fetch the password from the above location given using the below command.

  sudo less /var/lib/jenkins/secrets/initialAdminPassword

  

  Now copy the password and paste it to the browser in the given field of the password.

  Step 6: Once you are done with the above step you will get the next page.

  

  In this step, click on “Install suggested plugins” to start with the installation of Jenkins packages.

  Once you click on “Install suggested plugins” it will start the installation of the plugin so you have to wait for complete the installation.

  

  Note: In my case, there is one plugin called pipeline is not installed but am sure in your case it might not list the above plugin and you will be able to see the successful message.

  Step 7: Now click on the “continue” and fill the user details shown in the below image.  

  All you have to do is you have to fill the details which are shown in the below image.

  

  Step 8: Once you finish the filling procedure, click on the “save and continue” button.

  You will see the below page once after selecting the “save and continue” button.

  

  Now here in the above image, you can see the Jenkins URL where we can access the web UI of the Jenkins, just click on the save and finish button which is the final step to install Jenkins.

  

  You can now start exploring Jenkins features by visiting the official page

  Apache Tomcat server is one of the best web servers which is highly used to deploy web applications.

  For Example, if your application contains server-side programming languages like PHP then these languages need a server to run that’s why we use tomcat server.

  In this part, we will see the steps to install and configure Tomcat 8.5.X

  To find the latest version of the Apache Tomcat click on this link.

  Now we will start the installation steps of Apache Tomcat Server

  Step 1: create one folder called “tomcat” or directory in your home directory by the below command.

  mkdir tomcat

  cd tomcat

  

  Step 2: Copy the address link of Apache tomcat tarball.

  Link: https://www-us.apache.org/dist/tomcat/tomcat-8/v8.5.42/bin/apache-tomcat-8.5.42.tar.gz

  Step 3: Open a terminal and type the below command to download the tar file by the below command.

  wget https://www-us.apache.org/dist/tomcat/tomcat-8/v8.5.42/bin/apache-tomcat-8.5.42.tar.gz

  

  Step 4: Extract the tarball in the tomcat folder which we have created earlier using the below command.

  tar -zxvf apache-tomcat-8.5.42.tar.gz

  

  Step 5: Update the bashrc profile(Environment Variable. with the path of tomcat where we have extracted by the below command //where is the ending braces.

  vim .bashrc

  Once you open the .bashrc file now press “i” to write the below lines to the file.

  export TOMCAT_HOME=/home/acadgild/tomcat/apache-tomcat-8.5.42

  export PATH=$PATH:$TOMCAT_HOME/bin

  

  Note: Use the command esc : wq! to save and exit the .bashrc file.

  Step 6: Now to update the changes which we have made in the bash_profile use the below command.

  source .bashrc

  Configure Tomcat

  Step 7: Edit the tomcat-users.xml file which is in the conf directory of tomcat.

  Ensure to remove comments <! – and  –> which is at the beginning and ending of the configuration part of the tomcat-users.xml file.

  

  After editing the tomcat-users.xml file the code looks like:

  

  Now, save the File.

  Change the default PORT from 8080 to 9005

  Step 8: Open and edit the file server.xml which is in the conf directory and change the connector port to a different value by using the below command.

  vim server.xml

  

  Now we have successfully completed the configuration of tomcat server.

  Start Tomcat Server

  Let’s start the tomcat server and check whether if it is working.

  Step 9: Start Tomcat Server by using the below command.

  startup.sh

  

  Step 10: Launch the web UI of Tomcat by entering the below URL in a web browser.

  localhost:9005

  

  Once after launching the web UI we can see that tomcat is successfully installed.

  ANT stands for Another Neat Device. Is a java based build device and mainly used to build the software, to build scripts like compiling, executing tests, and packaging.

  An alternative to this tool is apache maven which is more functionality than apache ANT but it depends on the company use case which they want to use to build the software.

  Lets Starts with the installation of apache ANT which is very simple.

  Step 1: Install Apache Ant by the below command.

  • sudo ap-get install ant -y

  

  Sometimes Apache ANT is preinstalled in some of the Ubuntu version (16.4 and above .. As you can see in the above image the ANT is already installed.’

  In your case if it is not installed then follow the step 1.

  Step 2: Check whether it is installed or not.

  Chef is a configuration management tool for dealing with machine setup on physical servers, virtual machines and in the cloud. Many companies use Chef Software to control and manage their infrastructure including Facebook, Etsy, Cheezburger, and Indiegogo

  Before starting the installation of chef we need NTP service so we will install NTP service first.

  Install NTP service

  Step 1: Install NTP Service by using the below command.

  sudo apt-get install ntp -y

  

  Step 2: Start the NTP Service by using the below command.

  • sudo service ntp start

  

  Now let’s start with the chef installation.

  Step 1: Create a new directory called chef under the home directory by using the below command.

  mkdir chef

  Step 2: Download chef tarball into your system by using the below command.

  Wget https://packages.chef.io/files/stable/chefserver/12.19.31/ubuntu/18.04/chef-server-core_12.19.31-1_amd64.deb

  

  Step 3: Install the downloaded file by using the below command.

  sudo dpkg -i chef_15.1.8-1_amd64.deb

  

  As you can see we have successfully installed chef development kit in our system.

  Hands On on chef with a simple example

  Let’s consider an example where we have to create a file called hello world and we have to add some contents in that file so how we will do it using chef.

  Step 1:  Create a script file in the Ruby scripting language by using the below command.

  vim hello-world.rb

  Step 2: Write contents to the file hello-world.rb which we have created earlier.

  

  Now we will run the file to see if we are able to create a file called acadgild and display the contents like “welcome to acadgild”.

  Step 3: Run the script using the chef using the below command.

  • chef-apply hello-world.rb

  

  As you can see in the above result after running the command we have successfully created the file called “acadgild” and we have written “welcome to acadgild” in the file.

  Step 4: Check the results by using the below commands.

  ls

  cat acadgild

  

  We have successfully run the chef job and you can see the result in the above screenshot.

  Docker is an open source tool which is designed to create, deploy and run the applications using containers. The container is a kind of virtual machine which allows the developer to package the application with all its dependencies and libraries.

  Now, let us see the steps to install docker.

  Step 1: To ensure the download are valid, add the GPG key for the official docker repository in to your system by the below command.

  curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add –

  Step 2: Add the docker repositories to the apt resources by the below command.

  sudo add-apt-repository “deb

  [arch=amd64]https://download.docker.com/linux/ubuntu $(lsb_release -cs) stable”

  

  Step 3: Update package database with the docker package which is added through the repository using the below command.

  sudo apt-get update -y

  

  Step 4: Make sure you are installing docker from docker repositories and not from ubuntu repositories by using the below command.

  apt-cache policy docker-ce

  

  Step 5: Install the docker community edition using the below command.

  sudo apt-get install -y docker-ce

  

  Step 6: Check docker services are running by using below command.

  sudo systemctl status docker

  

  Docker Commands without Sudo Privileges 

  To execute the docker command every time you have to type the password using sudo so to run the docker commands without sudo or root privileges run the below command.

  Step 7: Create a group docker by the below command.

  sudo groupadd docker

  Step 8: Add the user to the docker group by using the below command.

  sudo usermod -aG docker $USER

  Docker Commands

  Step 8: To check the commands which are supported by the docker type the following command in the terminal.

  docker

  

  Step 9: To view the information of docker enter the following command in the terminal.

  • docker info

  

  Working with Docker Images

  Docker containers are run from docker images. Most of the images you will get it from the docker hub.image which is nothing but an environment like linux, unix, ubuntu.

  Anybody can build and host their Docker images on Docker Hub, so most applications and Linux distributions you’ll need to run Docker containers have images that are hosted on Docker Hub.

  Step 10: To check whether you have access and can download the image from docker hub use the below command.

  sudo docker run hello-world

  

  Step 11: Search for the ubuntu image by using the below command.

  sudo docker search ubuntu

  

  In the OFFICIAL column, OK indicates an image built and supported by the company behind the project.

  Step 12: Pull the image from docker hub by the below command

  sudo docker pull ubuntu

  

  Docker Operations On Containers

  Step 13: create the container using below command.

  sudo docker run -it ubuntu

  

  Step 14: Start the container using below command.

  sudo docker start <container ID>

  

  Step 15: Stop the container using below command.

  sudo docker start container ID

  

  As you can see we have successfully installed docker in our system and performed some basic task and executed the commands on docker.

  Nagios is the most popular, open source, a powerful monitoring system for any kind of infrastructure. Infrastructure refers to the basic systems and services that a country or organization needs in order to function properly. It enables organizations to identify and resolve IT infrastructure problems before they affect critical business processes. Nagios has the capability of monitoring application, services, entire IT infrastructure.

  Now, let us follow the below steps to install Nagios.

  Step 1: Use following commands to install required packages for Nagios.

  sudo apt-get install apache2 php libapache2-mod-php php-gd libgd-dev

  Step 2: Create a Nagios user by the below command.

  sudo adduser nagios

  

  Step 3: Create group for nagios user  by the below command.

  sudo groupadd naggp

  sudo usermod -a -G naggp nagios

  sudo usermod -a -G naggp www-data

  

  Once, after installing the dependencies and creation of/, creating user, and group now we will install the core services of nagios

  Step 4: Create a new directory called nagios under home directory by using the below command.

  mkdir -nagios

  cd nagios

  Step 5: Download the latest version of nagios core by the using below command

  wget href=“https://assets.nagios.com/downloads/nagioscore/releases/nagios-4.4.3.tar.gz”>https://assets.nagios.com/downloads/nagioscore/releases/nagios-4.4.3.tar.gz

  

  Step 6: Extract the downloaded file by using the below command.

  • tar -zxzf nagios-4.4.3.tar.gz

  

  Step 7: Install nagios core by using the below commands

  cd nagios-4.4.3<br>

  sudo ./configure –with-command-group=naggp<br>

  sudo make all<br>

  sudo make install<br>

  sudo make install-init<br>

  sudo make install-daemoninit<br>

  sudo make install-config<br>

  sudo make install-commandmode<br>

  sudo make install-exfoliation

  Now copy event handler’s scripts under libexec directory. These binaries provides multiple events triggers for your Nagios web interface.

  Step 8: Copy event handler’s scripts by using the below command.

  • sudo cp -R contrib/eventhandlers/ /usr/local/nagios/libexec/
  • sudo chown -R nagios:nagios /usr/local/nagios/libexec/eventhandlers

  Setup apache with authentication

  Step 9: Create an Apache configuration file for your Nagios server.

  • sudo vim /etc/apache2/conf-available/nagios.conf

  Configure Nagios

  Add the following lines to the above nagios.conf file

  ScriptAlias /nagios/cgi-bin “/usr/local/nagios/sbin”

  <Directory “/usr/local/nagios/sbin”>

  Options ExecCGI

  AllowOverride None

  Order allow,deny

  Allow from all

  AuthName “Restricted Area”

  AuthType Basic

  AuthUserFile /usr/local/nagios/etc/htpasswd.users

  Require valid-user

  </Directory>

  Alias /nagios “/usr/local/nagios/share”

  <Directory “/usr/local/nagios/share”>

  Options None

  AllowOverride None

  Order allow,deny

  Allow from all

  AuthName “Restricted Area”

  AuthType Basic

  AuthUserFile /usr/local/nagios/etc/htpasswd.users

  Require valid-user

  </Directory>

  Step 10: Setup apache authentication for user nagiosadmin

  sudo htpasswd -c /usr/local/nagios/etc/htpasswd.users nagiosadmin

  

  Step 11: enable Apache configuration and restart Apache service.

  sudo a2enconf nagios

  sudo a2enmod cgi rewrite

  sudo service apache2 restart

  After installing and configuring Nagios core service we are going to install Nagios plugins from the official website.

  Step 12: Download Nagios plugins and install by using the below commands.

  mkdir nagios-plugin

  cd nagios-plugin

  wget https://nagios-plugins.org/download/nagios-plugins-2.2.1.tar.gz

  cd nagios-plugins-2.2.1

  

  Step 13: compile and install Nagios plugins

  sudo ./configure –with-nagios-user=nagios –with-nagios-group=nagios –with-openssl

  sudo make

  sudo make install

  Verify The Settings

  Step 14: Use the below commands to verify the nagios installation and configuration file.

  sudo /usr/local/nagios/bin/nagios -v /usr/local/nagios/etc/nagios.cfg

  Start The Nagios Services

  Step 15: start the nagios service by using the below commands.

  sudo systemctl enable nagios

  sudo service nagios start

  Access the Web UI of Nagios

  Step 16: Type the below URL in your browser

  192.168.1.31/nagios

  Note: Instead of 192.168.1.37 you can put your machine ip address.

  Once you type the above url in your browser you will be prompted to requesting username and password.

  Username = nagiosadmin

  Password = “whatever you have given at the time of installation”.

  Once you enter the username and password you will get the below web UI of nagios.

  

  Now we have successfully installed and configure nagios monitoring server in our system.

  In order to increase the software development productivity, vagrant tries to simplify the software configuration management of virtualization.

  Vagrant is an open source software product which help us to build and maintain the portable virtual software development environment like virtualbox , vmware , docker containers.   

  To install vagrant you need one virtualization software and one of the great and open source virtualization software is virtual box so first we will install the virtual box.

  Install Virtualbox

  Step 1: Download and install virtual box by the below command.

  sudo apt-get install virtualbox -y

  

  Step 2: Download and install vagrant by the below command.

  sudo apt-get install vagrant -y

  Once you done with the installation now we will deploy our development environment which is virtualbox.

  Step 3:   Deploy virtualbox development environment by the below command.

  Step 4: Start the vagrant by the below command.

  vagrant init ubuntu/precise32

  vagrant up

  

  We hope this blog helped you in installing and Configuring Open Source DevOps Tools. Keep visiting our site www.acadgild.com for more updates on Data Science and other technologies.