{"id":41157,"date":"2022-06-08T12:30:36","date_gmt":"2022-06-08T17:30:36","guid":{"rendered":"https:\/\/www.rosehosting.com\/blog\/?p=41157"},"modified":"2022-12-05T05:27:54","modified_gmt":"2022-12-05T11:27:54","slug":"how-to-install-hadoop-on-debian-11","status":"publish","type":"post","link":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/","title":{"rendered":"How to Install Hadoop on Debian 11"},"content":{"rendered":"<div id=\"bsf_rt_marker\"><\/div><p><img decoding=\"async\" class=\"size-full wp-image-41569 alignnone\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg\" alt=\"how to install hadoop on debian 11\" width=\"742\" height=\"372\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg 742w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11-300x150.jpg 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11-150x75.jpg 150w\" sizes=\"(max-width: 742px) 100vw, 742px\" \/><\/p>\n<p>The Apache Hadoop or also known as Hadoop is an open-source, Java-based framework that allows for the distributed processing of large data sets across computers. It is used to store and process large datasets. It allows clustering multiple computers to store and process data more quickly instead of using a single large computer. Hadoop consists of four main modules:<\/p>\n<p>&#8211; HDFS (Hadoop Distributed File System)<br \/>\n&#8211; YARN (Yet Another Resource Negotiator)<br \/>\n&#8211; MapReduce<br \/>\n&#8211; Hadoop Common<\/p>\n<p>In this tutorial, we will explain how to install Hadoop on Debian 11.<\/p>\n<p><!--more--><\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_65 counter-hierarchy ez-toc-counter ez-toc-transparent ez-toc-container-direction\">\n<p class=\"ez-toc-title\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-663e00b3cda90\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"ez-toc-cssicon\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-663e00b3cda90\"  aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#Prerequisites\" title=\"Prerequisites\">Prerequisites<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#Step-1-Login-to-the-server\" title=\"Step 1. Login to the server\">Step 1. Login to the server<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#Step-2-Create-a-System-User-and-Generate-SSH-Key\" title=\"Step 2. Create a System User and Generate SSH Key\">Step 2. Create a System User and Generate SSH Key<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#Step-3-Install-Java\" title=\"Step 3. Install Java\">Step 3. Install Java<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#Step-4-Download-and-Install-Hadoop\" title=\"Step 4. Download and Install Hadoop\">Step 4. Download and Install Hadoop<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#Step-5-Configure-Hadoop\" title=\"Step 5. Configure Hadoop\">Step 5. Configure Hadoop<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"Prerequisites\"><\/span>Prerequisites<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li>Debian 11<\/li>\n<li>SSH root access or a normal system user with sudo privileges<\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"Step-1-Login-to-the-server\"><\/span>Step 1. Login to the server<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>First, log in to your Debian 11 server through SSH as the root user:<\/p>\n<pre>ssh root@IP_Address -p Port_number<\/pre>\n<p>Replace &#8220;root&#8221; with a user that has sudo privileges if necessary. Additionally, replace &#8220;IP_Address&#8221; and &#8220;Port_Number&#8221; with your server\u2019s respective IP address and SSH port number.<\/p>\n<p>You can check whether you have the proper Debian version installed on your server with the following command:<\/p>\n<pre>$ lsb_release -a<\/pre>\n<p>You should get this output:<\/p>\n<pre>No LSB modules are available.\r\nDistributor ID: Debian\r\nDescription: Debian GNU\/Linux 11 (bullseye)\r\nRelease: 11\r\nCodename: bullseye<\/pre>\n<p>Before starting, you have to make sure that all Ubuntu OS packages installed on the server are up to date.<br \/>\nYou can do this by running the following commands:<\/p>\n<pre>$ sudo apt update -y\r\n$ sudo apt upgrade -y<\/pre>\n<h2><span class=\"ez-toc-section\" id=\"Step-2-Create-a-System-User-and-Generate-SSH-Key\"><\/span>Step 2. Create a System User and Generate SSH Key<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>It is not a good idea to run Hadoop as root, so for security reasons, we will create a new system user:<\/p>\n<pre>$ sudo useradd -r hadoop -m -d \/opt\/hadoop --shell \/bin\/bash<\/pre>\n<p>A user &#8216;hadoop&#8217; has been created, let&#8217;s log in as the user.<\/p>\n<pre>$ su - hadoop<\/pre>\n<p>Hadoop requires ssh access to manage its nodes, whether remote or local nodes. To access the nodes without a password, we can generate SSH key and copy the public key to the ~\/.ssh\/authorized_keys file.<\/p>\n<pre>$ ssh-keygen -t rsa<\/pre>\n<p>You will get an output like this.<\/p>\n<pre>hadoop@debian11:~$ ssh-keygen -t rsa\r\nGenerating public\/private rsa key pair.\r\nEnter file in which to save the key (\/opt\/hadoop\/.ssh\/id_rsa): \r\nCreated directory '\/opt\/hadoop\/.ssh'.\r\nEnter passphrase (empty for no passphrase): \r\nEnter same passphrase again: \r\nYour identification has been saved in \/opt\/hadoop\/.ssh\/id_rsa\r\nYour public key has been saved in \/opt\/hadoop\/.ssh\/id_rsa.pub\r\nThe key fingerprint is:\r\nSHA256:QYHlb6Is9n05OtnR+6i71t4MZeN9gVqGVCoa28aiUXg hadoop@debian11.rosehosting.com\r\nThe key's randomart image is:\r\n+---[RSA 3072]----+\r\n| o+. . |\r\n| oo o |\r\n| . Eo. o |\r\n| o *oo . . |\r\n| . +S+oo ++. |\r\n| .o.oo. =+ o.|\r\n| o.o o =... o|\r\n| . o .o * o= .|\r\n| . o=+*o.+ |\r\n+----[SHA256]-----+<\/pre>\n<p>Next, let&#8217;s add hadoop&#8217;s public key to the authorized key file, to allow user &#8216;hadoop&#8217; to log in to the system without a password and only use the SSH key.<\/p>\n<pre>$ cat ~\/.ssh\/id_rsa.pub &gt; ~\/.ssh\/authorized_keys<\/pre>\n<p>Log in to the system through SSH now.<\/p>\n<pre>$ ssh localhost<\/pre>\n<p>You should be able to log in to SSH without a password now.<br \/>\nLet&#8217;s exit from user &#8216;hadoop&#8217; and then continue to the next step.<\/p>\n<pre>$ exit<\/pre>\n<h2><span class=\"ez-toc-section\" id=\"Step-3-Install-Java\"><\/span>Step 3. Install Java<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Hadoop is written in Java, so we require Java in our system to be able to run Hadoop. Let&#8217;s run this command below to install the default JDK for Java from the repository.<\/p>\n<pre>$ sudo apt install default-jdk default-jre -y<\/pre>\n<p>Java should be installed now, you can check and verify it by invoking this command:<\/p>\n<pre>$ sudo java -version<\/pre>\n<h2><span class=\"ez-toc-section\" id=\"Step-4-Download-and-Install-Hadoop\"><\/span>Step 4. Download and Install Hadoop<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>At the time of writing this article, the latest stable version of Hadoop is version 3.3.2. You can go to their download page at https:\/\/hadoop.apache.org\/releases.html to check the more recent version if any.<\/p>\n<p>Let&#8217;s log in as user &#8216;hadoop&#8217; to download and extract it, so we do not need to change the file and directory permission.<\/p>\n<pre>$ su - hadoop\r\n$ wget https:\/\/dlcdn.apache.org\/hadoop\/common\/hadoop-3.2.3\/hadoop-3.2.3.tar.gz -O hadoop-3.2.3.tar.gz\r\n$ tar -xzvf hadoop-3.2.3.tar.gz -C \/opt\/hadoop --strip-components=1<\/pre>\n<p>Before continuing to the next steps, make sure <strong>JAVA_HOME<\/strong> is pointing to the correct directory, you can check this by listing \/usr\/lib\/jvm<\/p>\n<pre>$ ls \/var\/lib\/jvm<\/pre>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-41467 size-full\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-on-debian-11.webp\" alt=\"install hadoop on debian 11\" width=\"622\" height=\"46\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-on-debian-11.webp 622w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-on-debian-11-300x22.webp 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-on-debian-11-150x11.webp 150w\" sizes=\"(max-width: 622px) 100vw, 622px\" \/><br \/>\nNow, let&#8217;s edit \/opt\/hadoop\/.bashrc<\/p>\n<pre>$ nano \/opt\/hadoop\/.bashrc<\/pre>\n<p>Insert the following lines into the file.<\/p>\n<pre>export JAVA_HOME=\/usr\/lib\/jvm\/java-11-openjdk-amd64\r\nexport HADOOP_HOME=\/opt\/hadoop\r\nexport PATH=$PATH:$HADOOP_HOME\/bin\r\nexport PATH=$PATH:$HADOOP_HOME\/sbin\r\nexport HADOOP_MAPRED_HOME=$HADOOP_HOME\r\nexport HADOOP_COMMON_HOME=$HADOOP_HOME\r\nexport HADOOP_HDFS_HOME=$HADOOP_HOME\r\nexport YARN_HOME=$HADOOP_HOME\r\nexport HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME\/lib\/native\r\nexport HADOOP_OPTS=\"-Djava.library.path=$HADOOP_HOME\/lib\"<\/pre>\n<p>Save the file and exit, then run the command below to activate the newly added environment variables.<\/p>\n<pre>$ source ~\/.bashrc<\/pre>\n<h2><span class=\"ez-toc-section\" id=\"Step-5-Configure-Hadoop\"><\/span>Step 5. Configure Hadoop<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Hadoop can be configured to run in a single node or multi-node cluster. In this tutorial, we will show you how to set up Hadoop single node cluster or pseudo-distributed mode. There are some files we need to modify in this step, now let&#8217;s edit the Hadoop environment file first.<\/p>\n<pre>$ nano \/opt\/hadoop\/etc\/hadoop\/hadoop-env.sh<\/pre>\n<p>Add the following line to the file.<\/p>\n<pre>export JAVA_HOME=\/usr\/lib\/jvm\/java-11-openjdk-amd64<\/pre>\n<p>Edit core-site.xml file.<\/p>\n<pre>$ nano \/opt\/hadoop\/etc\/hadoop\/core-site.xml<\/pre>\n<p>Add these lines to the configuration tag.<\/p>\n<pre>&lt;property&gt;\r\n&lt;name&gt;fs.default.name&lt;\/name&gt;\r\n&lt;value&gt;hdfs:\/\/localhost:9000&lt;\/value&gt;\r\n&lt;\/property&gt;<\/pre>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-41468 size-full\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-on-debian.webp\" alt=\"install hadoop on debian\" width=\"673\" height=\"439\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-on-debian.webp 673w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-on-debian-300x196.webp 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-on-debian-150x98.webp 150w\" sizes=\"(max-width: 673px) 100vw, 673px\" \/><\/p>\n<p>Edit hdfs-site.xml file<\/p>\n<pre>$ nano \/opt\/hadoop\/etc\/hadoop\/hdfs-site.xml<\/pre>\n<p>Add these lines to the configuration tag.<\/p>\n<pre>&lt;property&gt;\r\n&lt;name&gt;dfs.replication&lt;\/name&gt;\r\n&lt;value&gt;1&lt;\/value&gt;\r\n&lt;\/property&gt;\r\n&lt;property&gt;\r\n&lt;name&gt;dfs.namenode.name.dir&lt;\/name&gt;\r\n&lt;value&gt;file:\/opt\/hadoop\/hadoop_tmp\/hdfs\/namenode&lt;\/value&gt;\r\n&lt;\/property&gt;\r\n&lt;property&gt;\r\n&lt;name&gt;dfs.datanode.data.dir&lt;\/name&gt;\r\n&lt;value&gt;file:\/opt\/hadoop\/hadoop_tmp\/hdfs\/datanode&lt;\/value&gt;\r\n&lt;\/property&gt;<\/pre>\n<p>Save the file by pressing CTRL + O and exit with CTRL + X<\/p>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-41469 size-full\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-debian-11.webp\" alt=\"install hadoop debian 11\" width=\"663\" height=\"521\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-debian-11.webp 663w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-debian-11-300x236.webp 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-debian-11-150x118.webp 150w\" sizes=\"(max-width: 663px) 100vw, 663px\" \/><\/p>\n<p>Edit yarn-site.xml file<\/p>\n<pre>$ nano \/opt\/hadoop\/etc\/hadoop\/yarn-site.xml<\/pre>\n<p>Add these lines to the configuration tag.<\/p>\n<pre>&lt;property&gt;\r\n&lt;name&gt;yarn.nodemanager.aux-services&lt;\/name&gt;\r\n&lt;value&gt;mapreduce_shuffle&lt;\/value&gt;\r\n&lt;\/property&gt;\r\n&lt;property&gt;\r\n&lt;name&gt;yarn.nodemanager.aux-services.mapreduce.shuffle.class&lt;\/name&gt;\r\n&lt;value&gt;org.apache.hadoop.mapred.ShuffleHandler&lt;\/value&gt;\r\n&lt;\/property&gt;<\/pre>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-41470 size-full\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-debian.webp\" alt=\"install hadoop debian\" width=\"742\" height=\"408\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-debian.webp 742w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-debian-300x165.webp 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/install-hadoop-debian-150x82.webp 150w\" sizes=\"(max-width: 742px) 100vw, 742px\" \/><\/p>\n<p>The last file to modify is the mapred-site.xml.<\/p>\n<pre>$ nano \/opt\/hadoop\/etc\/hadoop\/mapred-site.xml<\/pre>\n<p>Add these lines to the configuration tag.<\/p>\n<pre>&lt;property&gt;\r\n&lt;name&gt;mapreduce.framework.name&lt;\/name&gt;\r\n&lt;value&gt;yarn&lt;\/value&gt;\r\n&lt;\/property&gt;<\/pre>\n<p>Do not forget to save the file and then exit from the nano editor.<\/p>\n<pre><img decoding=\"async\" class=\"aligncenter wp-image-41471 size-full\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-on-debian-11.webp\" alt=\"installing hadoop on debian 11\" width=\"680\" height=\"389\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-on-debian-11.webp 680w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-on-debian-11-300x172.webp 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-on-debian-11-150x86.webp 150w\" sizes=\"(max-width: 680px) 100vw, 680px\" \/><\/pre>\n<p>The files above have been modified, we need to create some directories, run this command:<\/p>\n<pre>$ mkdir -p \/opt\/hadoop\/hadoop_tmp\/hdfs\/{namenode,datanode}<\/pre>\n<p>Prior to starting Hadoop services for the first time, we need to format the namenode.<\/p>\n<pre>$ hdfs namenode -format<\/pre>\n<p>Start namenode and datanode<\/p>\n<pre>$ start-dfs.sh<\/pre>\n<p>If you see this warning message:<\/p>\n<pre><em>Unable to load native-hadoop library for your platform... using builtin-java classes where applicable<\/em><\/pre>\n<p>It means your server OS is 64bit, but Hadoop native library is 32bit. This is expected and you can ignore the warning. If you are not comfortable with it, you can download Hadoop source file then compile it to get the 64bit shared library.<\/p>\n<p>Now let&#8217;s start the YARN resource and node managers.<\/p>\n<pre>$ start-yarn.sh<\/pre>\n<p>The last one, run this command:<\/p>\n<pre>$ jps<\/pre>\n<p>You will get an output like this:<\/p>\n<pre>106129 SecondaryNameNode\r\n108050 Jps\r\n105877 NameNode\r\n106375 ResourceManager\r\n105960 DataNode\r\n106458 NodeManager<\/pre>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-41472 size-full\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-on-debian.webp\" alt=\"installing hadoop on debian\" width=\"451\" height=\"141\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-on-debian.webp 451w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-on-debian-300x94.webp 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-on-debian-150x47.webp 150w\" sizes=\"(max-width: 451px) 100vw, 451px\" \/><\/p>\n<p>Now. you can go to http:\/\/YOUR_SERVER_IP_ADDRESS:9870\/ and see the namenode, datanode, etc.<\/p>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-41473 size-full\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian-11.webp\" alt=\"installing hadoop debian 11\" width=\"1024\" height=\"487\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian-11.webp 1024w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian-11-300x143.webp 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian-11-150x71.webp 150w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian-11-768x365.webp 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<p>To check the YARN web portal, you can navigate to http:\/\/YOUR_SERVER_IP_ADDRESS:8088\/<br \/>\n<img decoding=\"async\" class=\"aligncenter wp-image-41474 size-full\" src=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian.webp\" alt=\"installing hadoop debian\" width=\"1024\" height=\"479\" srcset=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian.webp 1024w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian-300x140.webp 300w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian-150x70.webp 150w, https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/installing-hadoop-debian-768x359.webp 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<p>That\u2019s it. You have successfully installed and configured Hadoop on Debian 11 VPS.<\/p>\n<p>Of course, you don\u2019t have to install Hadoop on Debian 11 if you have a <a href=\"https:\/\/www.rosehosting.com\/debian-hosting\/\">Managed Debian Server<\/a> with us. You can simply ask our support team to install Hadoop on Debian 11 for you. They are available 24\/7 and will be able to help you with the installation.<\/p>\n<p>PS. If you enjoyed reading this blog post on how to install Hadoop on Debian 11, feel free to share it on social networks or simply leave a comment in the comments section. Thanks.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Apache Hadoop or also known as Hadoop is an open-source, Java-based framework that allows for the distributed processing of &#8230; <\/p>\n<p class=\"read-more-container\"><a title=\"How to Install Hadoop on Debian 11\" class=\"read-more button\" href=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#more-41157\" aria-label=\"Read more about How to Install Hadoop on Debian 11\">Read More<\/a><\/p>\n","protected":false},"author":4,"featured_media":41569,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1700,13,1712],"tags":[1962,2015,1603],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Install Hadoop on Debian 11 - RoseHosting<\/title>\n<meta name=\"description\" content=\"How to Install Hadoop on Debian 11 - RoseHosting\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Install Hadoop on Debian 11 - RoseHosting\" \/>\n<meta property=\"og:description\" content=\"How to Install Hadoop on Debian 11 - RoseHosting\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/\" \/>\n<meta property=\"og:site_name\" content=\"RoseHosting\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/RoseHosting\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/rosehosting.helpdesk\" \/>\n<meta property=\"article:published_time\" content=\"2022-06-08T17:30:36+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-05T11:27:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg?v=1653306418\" \/>\n\t<meta property=\"og:image:width\" content=\"742\" \/>\n\t<meta property=\"og:image:height\" content=\"372\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Jeff Wilson\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@rosehosting\" \/>\n<meta name=\"twitter:site\" content=\"@rosehosting\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jeff Wilson\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/\"},\"author\":{\"name\":\"Jeff Wilson\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#\/schema\/person\/7ce77a842fa6a9a7f8efa186f2353713\"},\"headline\":\"How to Install Hadoop on Debian 11\",\"datePublished\":\"2022-06-08T17:30:36+00:00\",\"dateModified\":\"2022-12-05T11:27:54+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/\"},\"wordCount\":891,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg\",\"keywords\":[\"debian 11\",\"hadoop\",\"how to install\"],\"articleSection\":[\"Debian\",\"Tutorials\",\"Web Frameworks\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/\",\"url\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/\",\"name\":\"How to Install Hadoop on Debian 11 - RoseHosting\",\"isPartOf\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg\",\"datePublished\":\"2022-06-08T17:30:36+00:00\",\"dateModified\":\"2022-12-05T11:27:54+00:00\",\"description\":\"How to Install Hadoop on Debian 11 - RoseHosting\",\"breadcrumb\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#primaryimage\",\"url\":\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg\",\"contentUrl\":\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg\",\"width\":742,\"height\":372,\"caption\":\"how to install hadoop on debian 11\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.rosehosting.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Install Hadoop on Debian 11\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#website\",\"url\":\"https:\/\/www.rosehosting.com\/blog\/\",\"name\":\"RoseHosting\",\"description\":\"Premium Linux Tutorials Since 2001\",\"publisher\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.rosehosting.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#organization\",\"name\":\"RoseHosting\",\"url\":\"https:\/\/www.rosehosting.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/03\/android-chrome-192x192-1.png\",\"contentUrl\":\"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/03\/android-chrome-192x192-1.png\",\"width\":192,\"height\":192,\"caption\":\"RoseHosting\"},\"image\":{\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/RoseHosting\",\"https:\/\/x.com\/rosehosting\",\"https:\/\/www.linkedin.com\/in\/rosehosting\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#\/schema\/person\/7ce77a842fa6a9a7f8efa186f2353713\",\"name\":\"Jeff Wilson\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.rosehosting.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/09271207587f897ab46faaed9b355252?s=96&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/09271207587f897ab46faaed9b355252?s=96&r=g\",\"caption\":\"Jeff Wilson\"},\"description\":\"An experienced Linux veteran with many years of experience. Helping other Linux admins with frequent Linux and business-related blog posts on the RoseHosting blog. Techie by choice. Loving nature and travel. Happily married and father of two lovely children.\",\"sameAs\":[\"https:\/\/www.rosehosting.com\",\"https:\/\/www.facebook.com\/rosehosting.helpdesk\"],\"url\":\"https:\/\/www.rosehosting.com\/blog\/author\/jwilson\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to Install Hadoop on Debian 11 - RoseHosting","description":"How to Install Hadoop on Debian 11 - RoseHosting","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/","og_locale":"en_US","og_type":"article","og_title":"How to Install Hadoop on Debian 11 - RoseHosting","og_description":"How to Install Hadoop on Debian 11 - RoseHosting","og_url":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/","og_site_name":"RoseHosting","article_publisher":"https:\/\/www.facebook.com\/RoseHosting","article_author":"https:\/\/www.facebook.com\/rosehosting.helpdesk","article_published_time":"2022-06-08T17:30:36+00:00","article_modified_time":"2022-12-05T11:27:54+00:00","og_image":[{"width":742,"height":372,"url":"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg?v=1653306418","type":"image\/jpeg"}],"author":"Jeff Wilson","twitter_card":"summary_large_image","twitter_creator":"@rosehosting","twitter_site":"@rosehosting","twitter_misc":{"Written by":"Jeff Wilson","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#article","isPartOf":{"@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/"},"author":{"name":"Jeff Wilson","@id":"https:\/\/www.rosehosting.com\/blog\/#\/schema\/person\/7ce77a842fa6a9a7f8efa186f2353713"},"headline":"How to Install Hadoop on Debian 11","datePublished":"2022-06-08T17:30:36+00:00","dateModified":"2022-12-05T11:27:54+00:00","mainEntityOfPage":{"@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/"},"wordCount":891,"commentCount":0,"publisher":{"@id":"https:\/\/www.rosehosting.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#primaryimage"},"thumbnailUrl":"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg","keywords":["debian 11","hadoop","how to install"],"articleSection":["Debian","Tutorials","Web Frameworks"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/","url":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/","name":"How to Install Hadoop on Debian 11 - RoseHosting","isPartOf":{"@id":"https:\/\/www.rosehosting.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#primaryimage"},"image":{"@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#primaryimage"},"thumbnailUrl":"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg","datePublished":"2022-06-08T17:30:36+00:00","dateModified":"2022-12-05T11:27:54+00:00","description":"How to Install Hadoop on Debian 11 - RoseHosting","breadcrumb":{"@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#primaryimage","url":"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg","contentUrl":"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/05\/how-to-install-hadoop-on-debian-11.jpg","width":742,"height":372,"caption":"how to install hadoop on debian 11"},{"@type":"BreadcrumbList","@id":"https:\/\/www.rosehosting.com\/blog\/how-to-install-hadoop-on-debian-11\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.rosehosting.com\/blog\/"},{"@type":"ListItem","position":2,"name":"How to Install Hadoop on Debian 11"}]},{"@type":"WebSite","@id":"https:\/\/www.rosehosting.com\/blog\/#website","url":"https:\/\/www.rosehosting.com\/blog\/","name":"RoseHosting","description":"Premium Linux Tutorials Since 2001","publisher":{"@id":"https:\/\/www.rosehosting.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.rosehosting.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.rosehosting.com\/blog\/#organization","name":"RoseHosting","url":"https:\/\/www.rosehosting.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.rosehosting.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/03\/android-chrome-192x192-1.png","contentUrl":"https:\/\/www.rosehosting.com\/blog\/wp-content\/uploads\/2022\/03\/android-chrome-192x192-1.png","width":192,"height":192,"caption":"RoseHosting"},"image":{"@id":"https:\/\/www.rosehosting.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/RoseHosting","https:\/\/x.com\/rosehosting","https:\/\/www.linkedin.com\/in\/rosehosting\/"]},{"@type":"Person","@id":"https:\/\/www.rosehosting.com\/blog\/#\/schema\/person\/7ce77a842fa6a9a7f8efa186f2353713","name":"Jeff Wilson","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.rosehosting.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/09271207587f897ab46faaed9b355252?s=96&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/09271207587f897ab46faaed9b355252?s=96&r=g","caption":"Jeff Wilson"},"description":"An experienced Linux veteran with many years of experience. Helping other Linux admins with frequent Linux and business-related blog posts on the RoseHosting blog. Techie by choice. Loving nature and travel. Happily married and father of two lovely children.","sameAs":["https:\/\/www.rosehosting.com","https:\/\/www.facebook.com\/rosehosting.helpdesk"],"url":"https:\/\/www.rosehosting.com\/blog\/author\/jwilson\/"}]}},"_links":{"self":[{"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/posts\/41157"}],"collection":[{"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/comments?post=41157"}],"version-history":[{"count":9,"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/posts\/41157\/revisions"}],"predecessor-version":[{"id":43698,"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/posts\/41157\/revisions\/43698"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/media\/41569"}],"wp:attachment":[{"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/media?parent=41157"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/categories?post=41157"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rosehosting.com\/blog\/wp-json\/wp\/v2\/tags?post=41157"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}