Harish Shan

This post is about Hadoop 2.4.1 (latest stable version) Single Node Cluster Installation on Ubuntu 14.04. The Hadoop Single Node Cluster Installation method are suitable only for beginners practicing. The Hadoop Multi Node Cluster is more suitable for production environment Since Hadoop is meant for distributed environment. The Multi Node Cluster Hadoop Installation steps are almost as same as Single Node Cluster Hadoop Installation with few configuration changes. My next post will cover the Multi Node Cluster Hadoop Installation. The Hadoop installation requires the pre-require steps like installing Java & ssh, creating dedicated Linux user account, disabling IPv6, generating key-gen for user account. This pre-require steps requires for Hadoop node(s) communication by Secure Shell Protocol(ssh). Disable IPv6 requires since Hadoop doesn't support for IPv6. Step 1: Install Oracle Java JDK7 on Ubuntu . Step 2: Install SSH-Server To install Open ssh server, execute th...

This post is about basic concepts of Big Data and Apache Hadoop framework. It is essential to know about Big Data for today's IT industry since Big Data technologies are getting more popular and powerful now a days. Big Data: Big Data is nothing but storing or processing LARGE quantity of data sets. Data can be Structured Data (ex: RDBMS) Semi Structured Data (ex: XML Files) Unstructured Data (ex:Flat files) Big data overcomes the challenges of traditional databases such as Volume, Velocity, Variety, Complex Data sets. 95% of Today's Data are created in the last three years so the state of data is changed a lot. Popular Companies such as Amazon, Google, Facebook, Twitter, Yahoo have realized the power of Big data and doing R&D on Big Data. Apache Hadoop: Apache Hadoop is an open source Big Data framework for distributed storage and distributed processing for very large data sets on computer clusters. Apache Hadoop is a Master-Slave Shared Nothing Architectur...

This post is about how to make software piracy free world. I really want to write about this post is to make awareness on Software Piracy since it is illegal, that most people are unaware about it What is Software Piracy? Illegal usage, copy, distribute software without ownership or legal rights. So If we are using a paid software product without purchasing it means we are using it Illegally, the good thing is it does not hurt any person directly. There is no such a strict rules on pirated software usage on most of the countries. Most of us are still using pirated software even without aware that it is illegal. There are Three options in our hand: Let us continue with Microsoft Windows by purchasing licence from Online for cheap price Once they are ready to buy software and gonna spend huge amount, they can consider Apples Mac Desktop or Laptop. Best way is Linux obviously. Why should we move towards Linux? Now Linux has evolved a lot. It is not how, what we kno...

I have purchased an HP Pavilion 15-n011tu laptop recently with the operating system Ubuntu 12.04. The laptop is completely fine when I purchase,but after I upgraded to Ubuntu 14.04 version, only WIFI has stoped working. Even we can switch on or off the WIFI. This is a very common problem for all those who purchase HP laptop with Ubuntu OS, since HP is not supporting drivers for any Linux destro. Solution 1: Solution for this problem is we can purchase Windows 7 or 8, since HP is providing driver support for Windows 8 (both 32 & 64 bit) and Windows 7(only 64 bit). Currently HP Windows drivers are available at the following URL address http://h10025.www1.hp.com/ewfrf/wc/softwareCategory?cc=us&lc=en&product=5440120 Solution 2: But purchasing Windows OS is costly. Now a days, It is trend to migrating Windows to Linux for developers. In that case, Without WIFI or Internet any laptop is almost waste. Please follow the following steps for Ubuntu Operating System. St...

This post is about installing Spring Tool Suite (STS) on Ubuntu. The Spring Tool Suite is an Eclipse-based development environment that is customized for developing Spring applications. Step 1: Download the latest Spring Tool Suite for Linux from STS official website: http://spring.io/tools/sts/all  Step 2: Extract into any folder which you prefer. My extracted Spring Tool Suite locations is /home/harishshan/springsource Step 3: Create the Menu icon for quick access sudo nano /usr/share/applications/STS.desktop Step 4: Enter the following content [Desktop Entry] Name=SpringSource Tool Suite Comment=SpringSource Tool Suite Exec=/home/harishshan/springsource/sts-3.4.0-RELEASE/STS Icon=/home/harishshan/springsource/sts-3.4.0-RELEASE/icon.xpm StartupNotify=true Terminal=false Type=Application Categories=Development;IDE;Java; Step 5: Now you can check from Quick Menu by typing " Spring "

This article is about the Cron Job and how to schedule task on Ubuntu machine using Cron jobs. The cron is a time-based job scheduler in Unix-like computer operating systems. The word " Crontab " is derived from chronos (Time in Greeks) and tab stands for table. Crontab is useful for scheduling the task automatically run at regular interval as the background process. Crontabs are useful for taking backups, synchronizing files, etc. Before doing all other stuffs, first we will change the default editor to nano editor by typing the following command in terminal. export EDITOR="nano" To schedule new /edit crontab entries for specific time crontab -e This will open the nano editor with the default commented scheduling with five stars to allow our task scheduling. we can schedule our tasks here as follows * * * * * /home/harishshan/example.sh This will execute the example.sh for every minute. The following is an easy way to remember the crontab fo...

This article is about installing the Oracle Java JDK7 (Java Development Kit 7) on the Ubuntu Operating System. Everybody knows that Sun Java was migrated to Oracle Java with Open source licence. Similarly IBM and Open source community has their own standard Java JDK. I personally prefer Oracle's Java JDK, Since majority of the cooperates uses Oracle JDK,I also recommend Ubuntu Java beginners to start with Oracle JDK. So don't confuse while downloading/Installing Oracle Java JDK.The following steps will guide you to install Oracle JDK in Ubuntu in a very easy manner. To install Oracle JDK in Ubuntu, Advanced Package Tools (apt) provides the many providers for oracle. The webupd8team provider provides the following command to install the Oracle JDK. To install Oracle JDK 7, execute the following commands in the terminal. sudo apt-get install python-software-properties sudo add-apt-repository ppa:webupd8team/java sudo apt-get update sudo apt-get install oracle-java7-ins...

List of Linux Commands: Command Description alias Create an alias apropos Search manual for keyword at Schedule a job to run in the future. awk Find and Replace text within file(s) break Exit from a loop builtin Run a shell builtin bunzip2 Decompress file from bzip2 format bzip2 Compress file to bzip2 format cal Display a calendar case Conditionally perform a command cat Concatenate files to standard output cd Change Directory cfdisk Partition table manipulator for Linux chgrp Change group ownership chmod Change access permissions chown Change file owner and group chroot Run a command with a different root directory chvt Change the virtual Terminal cksum Print CRC checksum and byte counts clear Clear terminal screen cmp Compare two files comm Compare two sorted files line by line command Run a command – ignoring shell functions compress Compress file(s) to old Unix compress format continue Resume the next iteration of a loop convmv A perl script that c...