Hadoop HDFS commands in Cheat sheet

Hadoop HDFS (Hadoop Distributed File System) is a core component of the Hadoop ecosystem. HDFS is designed to store large data sets in a distributed environment.

To View the printable PDF of this sheet

The following are some common HDFS commands:

1. hdfs dfs -ls: List all the files and directories in the HDFS file system
2. hdfs dfs -mkdir: Create a new directory in HDFS
3. hdfs dfs -put: Copy a file from local file system to HDFS
4. hdfs dfs -get: Copy a file from HDFS to the local file system
5. hdfs dfs -cat: Display the content of a file in HDFS
6. hdfs dfs -rm: Remove a file from HDFS
7. hdfs dfs -rmdir: Remove an empty directory from HDFS
8. hdfs dfs -cp: Copy a file from one directory to another within HDFS
9. hdfs dfs -mv: Move a file from one directory to another within HDFS
10. hdfs dfs -du: Display the space consumed by a file in HDFS.

These commands can be executed from the command line by prefixing them with “hdfs dfs”. Note that these commands are basic and there are many more advanced HDFS commands available.