carltheperson.com

Getting Better at Linux With 10 Mini-Projects

2020-11-28 Carl Riis

How do you advance your Linux skills when you are already comfortable with the basics? My solution was to come up with 10 subjects to learn and create an accompanying mini-project.

All the source code for the projects can be found in this GitHub repository.

1. UNIX - Recat

The first thing I wanted to learn more about was UNIX since Linux is a UNIX-like operating system. I also never really felt that I fully understood what exactly UNIX was, besides being a family of fairly similar operating systems.

The first thing I did was to read the entire Wikipedia page on UNIX. I also read this original paper written by Dennis Ritchie and Ken Thompson from 1974, which was really interesting though I can’t say I understood all of it. After some more reading and some Youtube videos, I felt comfortable that I understood what UNIX was, and what makes it interesting.

For the project, I decided to try and write my first C program. Following the Unix philosophy, I made sure that it did one thing only. That thing ended up being a program that reverses the contents of a text file. Since this is just a reverse version of cat, I called the program recat.

2. What is a shell? - SeaShell

For this project, I was curious to find out what exactly a shell was. Even though it is something that I use often, I was still confused about what differentiates it from the terminal. Turns out it’s really not that complicated. I learned this by rereading the shell part of the paper from the previous project, and some explanations online like this and this one. The Unix shell Wikipedia entry was also very informative.

Since this project is about the shell, I found it appropriate to try and write my own. I settled on the name SeaShell, which I found way too funny. It’s not very advanced, but it does the job.

3. Ownership and permissions - Tellaccess

This is one of the things that I know is really important for Linux, but have never really understood. I have tried before but never been able to get the knowledge to stick, maybe because I didn’t really care about security until now.

The ownership and permission system turned out to be really intuitive, and I was able to understand the basics from this one article. I later discovered this one from Linux Handbook which was more comprehensive.

For the project, I decided to create a program that tells you in human-readable form, the ownership and permissions of a file. I called the project tellaccess because it tells you who can access the file in what ways.

4. Grep - Grep detective

Grep is the sort of UNIX magic I have always wanted to learn. Since grep is all about regular expressions I would have to learn that first. This was actually quite difficult because grep uses the POSIX Basic Regular Expressions, which is not that common. The Wikipedia entry was a lifesaver. Besides that, I also used the man page for grep as a reference.

For the project, I thought that a fun idea might be to create a detective game. In the game, you get a folder full of files, and it’s your job to extract information. I called the game Grep detective.

5. Awk and sed - Passwdinfo

Awk and sed are more of the UNIX magic that I have always thought was really cool, though I never really understood what they were used for. I often saw answers on Stack Overflow with people using them in crazy one-liners, but I always copy-pasted them without much thought. Well, time to unravel the mystery.

I primarily used this paper to learn about them. For the project, I wanted to create my own one-liner that shows information about the users on your system in a clear way. I found just reading the /etc/passwd a little too messy, so the project passwdinfo, displays the most important information in a neat table. I found information about the /etc/passwd file here.

6. Find - Find treasure hunt

Another important tool I never really got around to learning. Learning how to use find was fairly easy, it was mostly about memorizing the different flags, and the format you set the flags in. I used this as a reference.

For the project, I created a treasure hunt where you look for clues in files with different attributes. I first wrote a script that created a bunch of small files and directories as noise. Then a selected few of the files got clues to the whereabouts of the other ones. In the end, you find the treasure, which I won’t tell you what is.

7. File system - Root tour

Ever since I executed my first ls / I have wondered what all those directories were for. Time to unveil the mystery. The first thing I did was read this article as it explained each directory in root and provided a nice graph. This resource was also nice since it had a table that summed up each directory in one or two sentences.

The project ended up being a program that gives you descriptions for directories in your own root folder.

8. Processes - Stranger danger

Processes are another important element of Linux that I have never gotten around to learning. Like many other subjects I have covered here, it turned out to be fairly intuitive. This article was really easy to understand.

I was contemplating for a while what kind of project I could create but ultimately came up with a command that prints all processes that don’t belong to you or root. That way, you can keep a close eye on who is creating processes. Note, there are many legitimate reasons that other users would run processes on your system, and it rarely means someone has gained access to your computer.

9. Systemd services - Createservice

Whenever I try to set up a database on a Linux machine I have been confused about how to configure the systemd service. I have also been in situations where I needed to create a service from a binary but always struggled. The struggle ends now. As with any new subject, it’s always a good idea to read the Wikipedia page, so that is where I started. Surprisingly, I learned that systemd is a quite controversial piece of software, but I still wanted to learn it and judge it for myself. For understanding the basics of systemd I read this and for understanding how to create a new service I read this.

For the project, I made createservice, which allows you to make a systemd service from any executable that will automatically start up on boot. Here I test it out on Prometheus:

10. Bash scripting - Penguin cipher

Bash scripting is something I have been avoiding for a long time. Partly because I believe that my programming language of choice, Go, is almost as handy when it comes to scripting, and partly because I think that Bash syntax looks horrible. Can’t knock it till you try it, so here I am trying to learn Bash scripting.

This was a nice introduction, and after finding this cool cheatsheet I felt comfortable trying to create a project.

The project ended up being a cipher program I called Penguin cipher after Linux’s mascot. It allows you to encrypt text into something like this: MTExIDIxMSAzMTMgNDAyIDQ2OCA0NjQgMTU5IDI0MSAyMzAgMzY3IDM3NCA1MjYgMTM3IDIyMiAyOTUgMzYzIDQzNCA0MzUg