Académique Documents
Professionnel Documents
Culture Documents
Chapter : 2
Setup Your System
Steps for installing Hadoop
Search for Cloudera Hadoop Machine in Google.
Go to download Quick Starts for CDH 5.13 – Cloudera.
Select the Platform VMWare in the Cloudera website and Click "Get in now".
Fill in the form.
The Zip file wiil be downloaded. Extract the zip file.
Download The VMWare workstation software from google and install it.
Double click cloudera vmplayer file & it will open through the vmplayer.
Once the virtual machine start go to the terminals of it write the command sudo
yum update to update the latest version of the file.
Basic Commands:
su : Is used to get into the root user. You need to give the password for the root user.
jps : Is used to check whether hadoop daemons started or not.
mysql -u root -p : To start mysql service and to stop you need to give command
"exit".
java -version : To know which version of java you are using.
hadoop version : To know which version of hadoop you are using.
hive : To connect to hive and to exit you have to give command "exit;".
pig : To connect to pig and to exit give " quit;".
ls : List the directory contents.
-- ls -l : It will list the details related to the file and directory.
-- ls -a : List all the content of folder including the files.
cd : Change the working directory.
man : Displays the information of any command.
info : Displays the information of any command.
du : Displays sizes of files and directories of the given directories. Displays length of
a file in case its just a file.
i. du -s : Results in an aggregate summary of file lengths being displayed.
ii.du -h : Format file sizes in a "human – readable” fashion
who am i : Displays the current user logged in.
pwd : Displays the present working directory
cat : To display the content of the file.
-- cat > : To create a file and write the contents in the file.
-- cat >> : For creating the file if it is not available and for appending the contents of
two file.
cp : Copying file from one location to other.
jar cvf/-cvf filename.har <scr> : To create a jar file.
jar xvf filename.jar : To extract the jar file.