Free Shipping

Secure Payment

easy returns

24/7 support

  • Home
  • Blog
  • Most Popular Open Source DevOps Tools ( With Installation And Configuration )

Most Popular Open Source DevOps Tools ( With Installation And Configuration )

 July 14  | 0 Comments

In this post, let’s look at the steps to install and configure the most used DevOps tools in the current IT industry which are in high demand.

Before moving ahead, we recommend beginners to have a little grasp on what is DevOps, why DevOps was introduced and DevOps working by referring to our blog An Introduction To DevOps.

System Prerequisite:

Ahead of installing we request the user to review the following system requirements.

  • Stable Internet connection.
  • Ubuntu 16.4
  • Root user privileges.
  • Minimum 4 GB RAM and 500GB hard drive.

What you will learn:

“What you will learn” after reading this post. You will be able to Install and configure the below listed open source DevOps tools.

1. Install or upgrade Java to version 8

  • Set JAVA_HOME

2. Install and configure Git

  • Git Configuration.
  • Initialize a Git Repository.
  • Add And Commit Files To GitHub Repository.

3. Install Maven

  • Configure Maven.
  • Update PATH Environment Variable.

4. Install Jenkins

  • Adjust Firewall.
  • Setting Up Jenkins.
  • Getting Started With Jenkins Through Web UI.

5. Install Tomcat

  • Download And Install Tomcat Server
  • Start Tomcat Server
  • Stop Tomcat Server
  • Configure Tomcat Server
  • Change The Default PORT

6. Install Apache ANT

  • Installing Apache ANT
  • Check Version Of Apache ANT

7. Install Chef

  • Install NTP Service
  • Enable NTP Service
  • Start NTP Service
  • Download Chef Development Kit File For Ubuntu
  • Install Chef Development Kit
  • Hands-on With A Simple Example.

8. Install Docker

  • Installing Docker
  • Start Docker Services
  • Hands-on With Docker Commands

9. Nagios Installation

  • Create User And Group For Nagios
  • Download And Install Nagios
  • Setup Apache 2 With Authentication
  • Configure Nagios
  • Download And Install Nagios Plugins
  • Verify The Settings
  • Start The Nagios Services
  • Access The Web UI Of NagiosStep 1: Before installing java make sure the newest versions of all packages are currently installed on the Ubuntu system.
    sudo apt-get update -y
    Updating Repositories

    Step 2: Nowadays most of the software uses Java version 8 and above because Java version 8 is a superlative release of the world’s #1 development platform. Follow the steps below to download and install Java 8.

    sudo apt-get install openjdk-8-jre-headless -y
    Installing Java

    Step 3: Set JAVA_HOME  Environment Variables.

    vim .bashrc

    Once you open the bashrc_profile, insert the following two lines at the end of the file.

    export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
    export PATH=$PATH:$JAVA_HOME/bin
    Setting JAVA_HOME

    Note: Use the command esc : wq! to save and exit the .bashrc file.

    Step 4: Use the below command to see the newly installed java.

    java -version
    Checking Java Version

    We can see from the above screenshot Java 8 is successfully installed.

    Now Let us see the steps to install and configure GIT which is the most popular version control software.

    Step 1: To install git use the following command in the terminal.

    sudo apt-get install git -y
    GIT Installation

    As you can see GIT is already present in Ubuntu if it is not installed then use the above command to install GIT in your system.

    Step 2: To check the git version you can use the below command:

    git –version

    GIT Configuration

    Step 3: Before using GIT repository we have to configure the “email id” and the “username”. Thus use the following commands to configure.

    git config –global user.name “Your Name”
    git config –global user.email your email address
    Configuring GIT

    As you have configured the “user name” and “email id”, all the above information is stored in the below gitconfig file

    ~/.gitconfig
    Git Config File View

    Step 4: Create and Initialize a GIT repository using the below commands.

    mkdir -p /home/acadgild/myproject
    cd /home/acadgild/myproject/
    git init
    Git Initialization

    Step 5: Add and Commit files to GIT repository by using the below commands.

    vim wordcount.py
    git add .
    git commit -m “First Commit”
    Git Commit

    You have successfully installed and configured the GIT. Now you are ready to use this open source distributed version control system.

    Maven is one of the best build automation tools which is mostly used for building Java-based projects.

    Maven addresses two aspects of building software:

    • First, it describes how software is built,
    • Second, it describes its dependencies.

    Step 1: Use the below command to install maven.

    sudo apt-get install maven
    Installing Maven

    Step 2: Update and set the MAVEN_HOME environment variable in bashrc_profile

    sudo vim .bashrc

    Once you open the bashrc profile type the below two lines at the end of the file.

    export MAVEN_HOME=/usr/share/maven
    export PATH=$PATH:$MAVEN_HOME/bin
    Adding Maven Home To Bashrc_Profile

    Note: Use the command esc : wq! to save and exit the .bashrc file.

    Step 3: Now to update the changes which we have made in the bash_profile type the below command.

    source .bashrc

    You have successfully installed Maven.

    Jenkins is a continuous integration server which is written in Java. It can handle any type of build or continuous integration. It is used by different teams of different sizes for those projects that may have heterogeneous languages like Java, .net, PHP, etc

    Installing Jenkins

     

    Follow the below steps to install Jenkins.

    Step 1: Add the Jenkins Debian repository.

    wget -q -O – https://pkg.jenkins.io/debian/jenkins.io.key | sudo apt-key add –
    sudo sh -c ‘echo deb http://pkg.jenkins.io/debian-stable binary/ > /etc/apt/sources.list.d/jenkins.list’
    Adding Jenkins Repo To The System.

    Step 2: Once the Jenkins repository is created in the following path, update the repository and install Jenkins using the below commands.

    sudo apt-get update -y
    sudo apt-get install jenkins -y
    Jenkins Installation

    Step 3: Jenkins service will start automatically after the installation and you can check the status of the Jenkins service by using the below command.

    sudo service jenkins status

    If you want to start the Jenkins manually then use the below command.

    sudo service jenkins start
    Start Jenkins Services

    If you want to stop the Jenkins manually then you can use the below command.

    sudo service jenkins stop

    Adjusting Firewall

    Step 4: If you are installing Jenkins on remote Ubuntu server  that  protected by a firewall

    All you have to do is you need to open the port 8080 because this is the default port which will be used by Jenkins web UI.

    Let us the below commands to open the port 8080:

    sudo ufw allow 8080
    sudo ufw status

    Getting started with Jenkins web UI

    Step 5:  As the Jenkins service is already started, we can use the below command to launch the Jenkins Web UI.

    Open the browser and type the below URL

    http://localhost:8080

    Below is the page which will be displayed.

    Start Page Of Jenkins

    The first time/ First, you have to enter the password which is located in the below location

    /var/lib/jenkins/secrets/initialAdminPassword

    Now we will fetch the password from the above location given using the below command.

    sudo less /var/lib/jenkins/secrets/initialAdminPassword
    Jenkins Password

    Now copy the password and paste it to the browser in the given field of the password.

    Step 6: Once you are done with the above step you will get the next page.

    Start Jenkins Installation

    In this step, click on “Install suggested plugins” to start with the installation of Jenkins packages.

    Once you click on “Install suggested plugins” it will start the installation of the plugin so you have to wait for complete the installation.

    Jenkins Web Installation

    Note: In my case, there is one plugin called pipeline is not installed but am sure in your case it might not list the above plugin and you will be able to see the successful message.

    Step 7: Now click on the “continue” and fill the user details shown in the below image.  

    All you have to do is you have to fill the details which are shown in the below image.

    Filling User Details

    Step 8: Once you finish the filling procedure, click on the “save and continue” button.

    You will see the below page once after selecting the “save and continue” button.

    Jenkins Web URL

    Now here in the above image, you can see the Jenkins URL where we can access the web UI of the Jenkins, just click on the save and finish button which is the final step to install Jenkins.

    Start Using Jenkins

    You can now start exploring Jenkins features by visiting the official page

    Apache Tomcat server is one of the best web servers which is highly used to deploy web applications.

    For Example, if your application contains server-side programming languages like PHP then these languages need a server to run that’s why we use tomcat server.

    In this part, we will see the steps to install and configure Tomcat 8.5.X

    To find the latest version of the Apache Tomcat click on this link.

    Now we will start the installation steps of Apache Tomcat Server

    Step 1: create one folder called “tomcat” or directory in your home directory by the below command.

    mkdir tomcat
    cd tomcat
    Creating Directory For Tomcat

    Step 2: Copy the address link of Apache tomcat tarball.

    Link: https://www-us.apache.org/dist/tomcat/tomcat-8/v8.5.42/bin/apache-tomcat-8.5.42.tar.gz

    Step 3: Open a terminal and type the below command to download the tar file by the below command.

    wget https://www-us.apache.org/dist/tomcat/tomcat-8/v8.5.42/bin/apache-tomcat-8.5.42.tar.gz

    Step 4: Extract the tarball in the tomcat folder which we have created earlier using the below command.

    tar -zxvf apache-tomcat-8.5.42.tar.gz
    Extract Downloaded Tomcat File

    Step 5: Update the bashrc profile(Environment Variable. with the path of tomcat where we have extracted by the below command //where is the ending braces.

    vim .bashrc

    Once you open the .bashrc file now press “i” to write the below lines to the file.

    export TOMCAT_HOME=/home/acadgild/tomcat/apache-tomcat-8.5.42
    export PATH=$PATH:$TOMCAT_HOME/bin

    Note: Use the command esc : wq! to save and exit the .bashrc file.

    Step 6: Now to update the changes which we have made in the bash_profile use the below command.

    source .bashrc

    Configure Tomcat

    Step 7: Edit the tomcat-users.xml file which is in the conf directory of tomcat.

    Ensure to remove comments <! – and  –> which is at the beginning and ending of the configuration part of the tomcat-users.xml file.

    After editing the tomcat-users.xml file the code looks like:

    Now, save the File.

    Change the default PORT from 8080 to 9005

    Step 8: Open and edit the file server.xml which is in the conf directory and change the connector port to a different value by using the below command.

    vim server.xml

    Now we have successfully completed the configuration of tomcat server.

    Start Tomcat Server

    Let’s start the tomcat server and check whether if it is working.

    Step 9: Start Tomcat Server by using the below command.

    startup.sh

    Step 10: Launch the web UI of Tomcat by entering the below URL in a web browser.

    localhost:9005

    Once after launching the web UI we can see that tomcat is successfully installed.

    ANT stands for Another Neat Device. Is a java based build device and mainly used to build the software, to build scripts like compiling, executing tests, and packaging.

    An alternative to this tool is apache maven which is more functionality than apache ANT but it depends on the company use case which they want to use to build the software.

    Lets Starts with the installation of apache ANT which is very simple.

    Step 1: Install Apache Ant by the below command.

    • sudo ap-get install ant -y

    Sometimes Apache ANT is preinstalled in some of the Ubuntu version (16.4 and above .. As you can see in the above image the ANT is already installed.’

    In your case if it is not installed then follow the step 1.

    Step 2: Check whether it is installed or not.

    Chef is a configuration management tool for dealing with machine setup on physical servers, virtual machines and in the cloud. Many companies use Chef Software to control and manage their infrastructure including Facebook, Etsy, Cheezburger, and Indiegogo

    Before starting the installation of chef we need NTP service so we will install NTP service first.

    Install NTP service

    Step 1: Install NTP Service by using the below command.

    sudo apt-get install ntp -y

    Step 2: Start the NTP Service by using the below command.

    • sudo service ntp start

    Now let’s start with the chef installation.

    Step 1: Create a new directory called chef under the home directory by using the below command.

    mkdir chef

    Step 2: Download chef tarball into your system by using the below command.

    Wget https://packages.chef.io/files/stable/chefserver/12.19.31/ubuntu/18.04/chef-server-core_12.19.31-1_amd64.deb

    Step 3: Install the downloaded file by using the below command.

    sudo dpkg -i chef_15.1.8-1_amd64.deb

    As you can see we have successfully installed chef development kit in our system.

    Hands On on chef with a simple example

    Let’s consider an example where we have to create a file called hello world and we have to add some contents in that file so how we will do it using chef.

    Step 1:  Create a script file in the Ruby scripting language by using the below command.

    vim hello-world.rb

    Step 2: Write contents to the file hello-world.rb which we have created earlier.

    Now we will run the file to see if we are able to create a file called acadgild and display the contents like “welcome to acadgild”.

    Step 3: Run the script using the chef using the below command.

    • chef-apply hello-world.rb

    As you can see in the above result after running the command we have successfully created the file called “acadgild” and we have written “welcome to acadgild” in the file.

    Step 4: Check the results by using the below commands.

    ls
    cat acadgild

    We have successfully run the chef job and you can see the result in the above screenshot.

    Docker is an open source tool which is designed to create, deploy and run the applications using containers. The container is a kind of virtual machine which allows the developer to package the application with all its dependencies and libraries.

    Now, let us see the steps to install docker.

    Step 1: To ensure the download are valid, add the GPG key for the official docker repository in to your system by the below command.

    curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add –

    Step 2: Add the docker repositories to the apt resources by the below command.

    sudo add-apt-repository “deb
    [arch=amd64]https://download.docker.com/linux/ubuntu $(lsb_release -cs) stable”

    Step 3: Update package database with the docker package which is added through the repository using the below command.

    sudo apt-get update -y

    Step 4: Make sure you are installing docker from docker repositories and not from ubuntu repositories by using the below command.

    apt-cache policy docker-ce

    Step 5: Install the docker community edition using the below command.

    sudo apt-get install -y docker-ce

    Step 6: Check docker services are running by using below command.

    sudo systemctl status docker

    Docker Commands without Sudo Privileges 

    To execute the docker command every time you have to type the password using sudo so to run the docker commands without sudo or root privileges run the below command.

    Step 7: Create a group docker by the below command.

    sudo groupadd docker

    Step 8: Add the user to the docker group by using the below command.

    sudo usermod -aG docker $USER

    Docker Commands

    Step 8: To check the commands which are supported by the docker type the following command in the terminal.

    docker

    Step 9: To view the information of docker enter the following command in the terminal.

    • docker info

    Working with Docker Images

    Docker containers are run from docker images. Most of the images you will get it from the docker hub.image which is nothing but an environment like linux, unix, ubuntu.

    Anybody can build and host their Docker images on Docker Hub, so most applications and Linux distributions you’ll need to run Docker containers have images that are hosted on Docker Hub.

    Step 10: To check whether you have access and can download the image from docker hub use the below command.

    sudo docker run hello-world

    Step 11: Search for the ubuntu image by using the below command.

    sudo docker search ubuntu

    In the OFFICIAL column, OK indicates an image built and supported by the company behind the project.

    Step 12: Pull the image from docker hub by the below command

    sudo docker pull ubuntu

    Docker Operations On Containers

    Step 13: create the container using below command.

    sudo docker run -it ubuntu

    Step 14: Start the container using below command.

    sudo docker start <container ID>

    Step 15: Stop the container using below command.

    sudo docker start container ID

    As you can see we have successfully installed docker in our system and performed some basic task and executed the commands on docker.

    Nagios is the most popular, open source, a powerful monitoring system for any kind of infrastructure. Infrastructure refers to the basic systems and services that a country or organization needs in order to function properly. It enables organizations to identify and resolve IT infrastructure problems before they affect critical business processes. Nagios has the capability of monitoring application, services, entire IT infrastructure.

    Now, let us follow the below steps to install Nagios.

    Step 1: Use following commands to install required packages for Nagios.

    sudo apt-get install apache2 php libapache2-mod-php php-gd libgd-dev

    Step 2: Create a Nagios user by the below command.

    sudo adduser nagios

    Step 3: Create group for nagios user  by the below command.

    sudo groupadd naggp
    sudo usermod -a -G naggp nagios
    sudo usermod -a -G naggp www-data

    Once, after installing the dependencies and creation of/, creating user, and group now we will install the core services of nagios

    Step 4: Create a new directory called nagios under home directory by using the below command.

    mkdir -nagios
    cd nagios

    Step 5: Download the latest version of nagios core by the using below command

    wget href=“https://assets.nagios.com/downloads/nagioscore/releases/nagios-4.4.3.tar.gz”>https://assets.nagios.com/downloads/nagioscore/releases/nagios-4.4.3.tar.gz

    Step 6: Extract the downloaded file by using the below command.

    • tar -zxzf nagios-4.4.3.tar.gz

    Step 7: Install nagios core by using the below commands

    cd nagios-4.4.3<br>
    sudo ./configure –with-command-group=naggp<br>
    sudo make all<br>
    sudo make install<br>
    sudo make install-init<br>
    sudo make install-daemoninit<br>
    sudo make install-config<br>
    sudo make install-commandmode<br>
    sudo make install-exfoliation

    Now copy event handler’s scripts under libexec directory. These binaries provides multiple events triggers for your Nagios web interface.

    Step 8: Copy event handler’s scripts by using the below command.

    • sudo cp -R contrib/eventhandlers/ /usr/local/nagios/libexec/
    • sudo chown -R nagios:nagios /usr/local/nagios/libexec/eventhandlers

    Setup apache with authentication

    Step 9: Create an Apache configuration file for your Nagios server.

    • sudo vim /etc/apache2/conf-available/nagios.conf

    Configure Nagios

    Add the following lines to the above nagios.conf file

    ScriptAlias /nagios/cgi-bin “/usr/local/nagios/sbin”
    <Directory “/usr/local/nagios/sbin”>
    Options ExecCGI
    AllowOverride None
    Order allow,deny
    Allow from all
    AuthName “Restricted Area”
    AuthType Basic
    AuthUserFile /usr/local/nagios/etc/htpasswd.users
    Require valid-user
    </Directory>
    Alias /nagios “/usr/local/nagios/share”
    <Directory “/usr/local/nagios/share”>
    Options None
    AllowOverride None
    Order allow,deny
    Allow from all
    AuthName “Restricted Area”
    AuthType Basic
    AuthUserFile /usr/local/nagios/etc/htpasswd.users
    Require valid-user
    </Directory>

    Step 10: Setup apache authentication for user nagiosadmin

    sudo htpasswd -c /usr/local/nagios/etc/htpasswd.users nagiosadmin

    Step 11: enable Apache configuration and restart Apache service.

    sudo a2enconf nagios
    sudo a2enmod cgi rewrite
    sudo service apache2 restart
    After installing and configuring Nagios core service we are going to install Nagios plugins from the official website.

    Step 12: Download Nagios plugins and install by using the below commands.

    mkdir nagios-plugin
    cd nagios-plugin
    wget https://nagios-plugins.org/download/nagios-plugins-2.2.1.tar.gz
    cd nagios-plugins-2.2.1

    Step 13: compile and install Nagios plugins

    sudo ./configure –with-nagios-user=nagios –with-nagios-group=nagios –with-openssl
    sudo make
    sudo make install

    Verify The Settings

    Step 14: Use the below commands to verify the nagios installation and configuration file.

    sudo /usr/local/nagios/bin/nagios -v /usr/local/nagios/etc/nagios.cfg

    Start The Nagios Services

    Step 15: start the nagios service by using the below commands.

    sudo systemctl enable nagios
    sudo service nagios start

    Access the Web UI of Nagios

    Step 16: Type the below URL in your browser

    192.168.1.31/nagios

    Note: Instead of 192.168.1.37 you can put your machine ip address.

    Once you type the above url in your browser you will be prompted to requesting username and password.

    Username = nagiosadmin

    Password = “whatever you have given at the time of installation”.

    Once you enter the username and password you will get the below web UI of nagios.

    Now we have successfully installed and configure nagios monitoring server in our system.

    In order to increase the software development productivity, vagrant tries to simplify the software configuration management of virtualization.

    Vagrant is an open source software product which help us to build and maintain the portable virtual software development environment like virtualbox , vmware , docker containers.   

    To install vagrant you need one virtualization software and one of the great and open source virtualization software is virtual box so first we will install the virtual box.

    Install Virtualbox

    Step 1: Download and install virtual box by the below command.

    sudo apt-get install virtualbox -y

    Step 2: Download and install vagrant by the below command.

    sudo apt-get install vagrant -y

    Once you done with the installation now we will deploy our development environment which is virtualbox.

    Step 3:   Deploy virtualbox development environment by the below command.

    Step 4: Start the vagrant by the below command.

    vagrant init ubuntu/precise32
    vagrant up

    We hope this blog helped you in installing and Configuring Open Source DevOps Tools. Keep visiting our site www.acadgild.com for more updates on Data Science and other technologies.

>