Beautiful Blogging
If you’ve read my first article, you’ll know that I have been toying with the idea to start my own blog for quite some time. Now that I’ve finally done it, I’d like to share how it went so far and what I’ve learned till now (disclaimer: a lot!). If you already have your own GitHub page and only want some information on how to integrate feature X you’ve seen on this blog, you can skip ahead to Adding functionality immediately.
Choosing a platform
Sites like Medium have helped me a good deal in understanding difficult to grasp subjects, because the authors often rely on a simplified language and lot’s of visualizations. Further, there is a discussion section at the end of each article (a vital component for a blog discussing technical topics, as I’ve suggested here) to interact with your audience and to answer questions, explain parts in more detail and iron out mistakes in the article.
The downside of these and similar sites is, that you don’t have as much freedom to design your post or add functionality (to which we come in the final section), you are dependent on the site operator and its policies (like financing it through adds) and it’s yet another account you need to create. Finally, you’ll probably not learn as much compared to setting it up yourself.
Once you’ve decided to take things into your own hand there are of course behemoths like WordPress or Squarespace chivalrously extending their hands to offer you creative freedom without friction, but it will cost you. Need a domain? Get on board with our premium plan! Need this feature? Buy this plugin! Want to do this very specific thing? No, we don’t have it, but you can program it yourself…
To be clear, I’m not generally against paying for digital products, even if there are free alternatives, because as you know, if it’s free you are the product (or rather, the resource). But what if there was a free and open source alternative, you can program a little bit and want to learn something new? Let me introduce you to:
GitHub Pages
GitHub Pages let’s you transform any GitHub repository into a website. In fact, this can be done with a click of a button if you’ve already written a great readme. But you can also setup a special repository which is not connected to any project but rather to your GitHub account and is therefore ideal to becoming your mouthpiece.
As you might have noticed, this section (and also the upcoming ones) expects you to know what git and GitHub are. If you’ve never used them, don’t worry, it’s not super complicated to get started, but it’s squarely outside the scope of this article to introduce them.
Why is it great?
Here are some advantages of this approach:
- It’s foss! Free and open source.
- It feels familiar. Chances are, if you’ve ever programmed something, especially collaboratively, you’ve used git and you probably already have a GitHub account. Using this familiar technology feels natural and you don’t need yet another account.
- You get the usual benefits of git but for web development: top notch version control and easy collaboration.
- You can write all the content in markdown! I love markdown, especially for quickly putting together and structuring a thought, so ideal for blogging. Your markdown content is converted to HTML automatically, so you don’t need to write a single line of HTML, CSS or JavaScript (but you can)!
- No database: Your sites repository functions as hub for all the content displayed on your page so it’s extremely fast (short loading times) and there is no (My)SQL involved, which also means no dependency on external services.
- Secure: No content management system (i.e. the online tools found in products like WordPress to edit your page) and no database or use of PHP (which means you produce static sites, which still can be interactive though).
Who is it for?
Let’s quickly determine who the target audience for this approach might be:
- You want to blog (like a hacker).
- You don’t want to spend money on it but rather time (and potentially learn something)
- You want to have (almost) full control over every aspect of the design and functionality.
- You’ve already worked with git and GitHub.
- You know how to program (at least a little bit).
- You don’t hate Markdown
I’d say 1 to 3 are the most important, because if you want to do something completely different than blogging, say a shopping site, GitHub pages is certainly the wrong thing. And if you don’t mind spending money and are happy with (potentially rigid) templates and plugins, there are also better options out there.
4 and 5 aren’t actually that important, because you can set everything up without any git, GitHub or programming knowledge and once you have, you can gradually start understanding everything and playing with the components until you grasp the basic concepts. It will take a lot more time though.
How to set it up?
There are a ton of good tutorials out there to setup a basic GitHub page, but I’d like to highlight two of them:
- fast.ai: You might know them from their free deep learning course, but they have also published this blog post, that teaches you how to setup your GitHub page without programming or touching the command line at all.
- Jekyll Now: This is the tutorial I’ve been using for setting up my GitHub page.
No matter which way you choose, I highly recommend using a template. What? Didn’t he just say that he doesn’t like templates? Well, there are at least two types of templates. There are those which I’d call closed source or cryptic, so you either can’t or are highly discouraged to change anything major. And then there are those which are actually in the spirit of a true template: a starting point from where you can go everywhere (not just a few timid steps in a couple of predefined directions). I’m talking about the latter here.
The reason templates are so great is, that instead of reinventing the wheel, which is very time consuming and difficult, you merely need to tinker with it and see what happens. After some back and forth you start to get an understanding which part does what and how they work together. A great template is Minima which already features a lot of functionality and is ready for offline work, to which I’ll come next, among other things.
Adding functionality
This is the heart of this article. As I already had clear ideas what I expected from my blog, there were quite a few additions I had to make to the basic setup to get everything up and running. All of these are documented somewhere on the Internet, but I think it is a good idea to put them here in one place and how to make them play together as there are some pitfalls when combining everything.
1. Working offline
Being able to work offline is extremely useful for a variety of reasons. First of all, you can work wherever and whenever you like. Secondly, you don’t rely on any service being operational, because even if you have an Internet connection, your host (i.e. GitHub) might be down or there are other connection problems. It is also faster, especially when working with GitHub pages, because once pushed, your changes aren’t visible immediately. And as you’re basically programming your blog, you will make mistakes and you will want to check what a new feature looks like regularly, so this can become quite annoying. Fortunately, it is quite easy to set this up, because GitHub pages works with Jekyll behind the scenes to convert your markdown into HTML and you can run Jekyll locally.
What’s Jekyll? Jekyll is a static site generator with built-in support for GitHub Pages and a simplified build process. Jekyll takes Markdown and HTML files and creates a complete static website based on your choice of layouts. Jekyll supports Markdown and Liquid, a templating language that loads dynamic content on your site
Prerequisites
I’ll assume a couple of things before moving forward:
- You’re on Linux.
- You have git installed and know how to use it.
- You have a GitHub account.
- You know how to setup a basic GitHub page.
- You’ve cloned or forked a template like Minima. You can also have a look at the GitHub repository for this blog, which, as mentioned previously, is a fork of the Jekyll Now theme.
Setup
Now, follow the official Jekyll Ubuntu or other Linux distros installation guide. If you haven’t cloned or forked a template like mentioned in step 5 above, you can also clone your basic GitHub page repository, change into its directory and run bundle exec jekyll new .
(note the dot in the end).
There are a couple of interesting files in your GitHub page repository/directory. For now, the most important is the Gemfile. Here you need to change gem “jekyll”
into gem "github-pages", "~> 206", group: :jekyll_plugins
. You can also go ahead and add some plugins we will use later:
group :jekyll_plugins do
gem "jekyll", "~> 3.8.7"
gem "jekyll-sitemap", "~> 1.4.0"
gem "jekyll-feed", "~> 0.13"
gem "jekyll-seo-tag", "~> 2.6.1"
end
The number behind each plugin is its version, which should match the GitHub pages dependency version to make sure that your offline site looks and works identical to the one processed by GitHub once you go online. Now, head into the _config.yml
file and add/change markdown: kramdown
, which is the processor used by GitHub to convert your markdown into HTML.
Afterwards, or if you have used a template, run bundle exec jekyll serve
. If you get errors, run bundle update
and try again. You should now be able to open your GitHub page in your browser by navigating to http://127.0.0.1:4000/.
Files and directories
Something I found confusing in the beginning is the rather complicated file and directory structure. Here’s a quick overview of what’s what:
index.md
: Your landing page. It’s empty except for its layout, which is defined in_layouts/home.html
.about.md
: Jekyll differentiates between pages and posts. I’m using pages as self contained units, like the landing page and the About page and posts for, well, posts.style.scss
: Together with the files in_sass
, this determines the look of your HMTL elements._posts
: This is where your blog posts go. It’s just a bunch of markdown files, one for each post with a date in front which gets added to thepage.date
variable automatically. I’ll come back to those variables in the next section._drafts
: Here you can put unfinished posts which you can render locally usingbundle exec jekyll serve --draft
and which don’t show up in the online version of your page._layouts
: This directory, together with_includes
,_sass
and thestyle.css
are the heart of each template and define the entire look of your page, apart from the content of your posts. Here you find all the HTML code of your site, so this is where you should look if you want to change the structure of it. There is adefault.html
defining some properties which are inherited by the other layout files while thehome.html
,page.html
andpost.html
define the layouts of the index page as well as other pages and posts respectively._includes
: Here you’ll find additional functionality which you can include into a layout. Thedefault.html
layout for example includes themathjax.html
for math support while thepost.html
includesdisqus.html
for DISQUS discussion support. We’ll look at those includes in more detail in the following sections.
2. Liquid templating
Liquid is a kind of small scripting language, allowing you to do rudimentary dynamic things inside your otherwise static GitHub page. It’s mainly used to store values in variables, which can then be used elsewhere and for simple if-else control flow (or at least I’m using it like this).
Variables can be accessed using {{ variable }} while logical statements are written like {% if statement %}. How to define variables? There are a number of predefined variables you can use anywhere on the site or in a post like the site.title
and site.description
defined in the _config.yml or site.posts
, a list of all your posts in the _posts
directory which is used by home.html
to iterate over all of them using {% for post in site.posts %} and to render them subsequently.
A page also has some predefined variables like page.date
. Here is where seems between Jekyll and Liquid begin to show in my opinion, as Liquid only knows site
and page
so the date of a Jekyll post or page are both accessed using page.date
. That’s confusing! So always use page
to access a variable, even if you’re writing a post. For example, I like to begin each post with the following markdown: # {{ page.title }}.
Finally, variables can be defined by yourself, for example in the YAML Front Matter of each markdown file. You simply put a
---
layout: post
title: And now...The Larch!
thumbnail: /images/image.png
---
at the front of a post and whatever you define there can then be accessed using e.g. {{ page.thumbnail }}. As hinted at in the example, I like to define the location of the thumbnail image I use next to a post here and then to include it in home.html like so:1
{% if post.thumbnail %}
<div class="thumbnail">
<img src="{{ post.thumbnail }}" />
</div>
{% endif %}
By the way, I just learned something new while writing this section: If you want Jekyll to render Liquid code like {{ variable }} or {% if post.thumbnail %} instead of evaluating it, you need to put it into {% raw %} and endraw
fences instead of simple markdown code fences2.
3. The discussion section
Enabling a DISQUS discussion section involves two steps. First you need to make a DISQUS account. Once you have it, go to Admin
and at the top create a new site. The Website name should be yourgithubname.github.io
and the Website URL should be https://yourgithubname.github.io/
. Once you have created your site you’ll get a Shortname
which is a unique identifier for your site and which you’ll need for the next step.
Open your_config.yml
and add/change disqus: yourshortname
. Mine is disqus: hummat-github-io
and I guess yours will be similar. You’ll also have to add/change the url
field. Mine is url: "https://hummat.github.io"
. In your post.html
add <div data-include="disqus.html"></div>. Make sure you have a disqus.html
similar to mine in your _includes
directory. It checks whether you have defined your shortname in the _config.yml
and disables comments if you’ve set comments
to false
inside your posts YAML Front Matter, which you can use to disable comments in certain posts if you don’t need them.
That’s it! You now should have a discussion section similar to the one at the end of this post.
4. Math support
If you want to write about math related topics like machine learning, you need to be able to display mathematical equations. While you can get away with simply typing 2+2=4, it is not exactly pretty and anything slightly more complex is out of your reach. The de facto standard to render high quality math in the scientific community is $\LaTeX$. Aha, you see where this is going, right?
On the web, Latex, or rather Latex math mode, is supported through the JavaScript library MathJax. To get it to work inside GitHub pages you need to have an include file like this one. There are a few things to note about this file. The first is the Liquid tag {% if page.mathjax %}, which allows you to only enable MathJax in posts where you need it, similar to the DISQUS approach above3.
We then configure how we want MathJax to behave. Most important are the inlineMath
and displayMath
lines, which allow you to enable math mode the same way you’d do it inside a Latex file.
Finally, we load the library from a remote source so it’s always up to date and doesn’t bloat our site. After some research I’m now pretty confident that the URL given in my mathjax.html
is currently the correct one to use. You can now do things like this!
5. Interactive visualizations
Okay, so this really gets me excited! The ability to add interactive visualizations is my newest achievement and it’s so neat! I’ve already written about why I think visualizations are the best thing that can happen to a complicated topic here, so I won’t repeat myself, but interactive visualizations?! That’s like visualizations on steroids. So, how can it be done?
It all starts with Plotly’s Python graphing library. It’s basically Matplotlib for the web, if you know what I mean. You write some visualization code like this one—play with it on if you like (might take a while to start)—and then you save the figure in a special way:
import plotly.io as pio
pio.write_html(fig,
file='../_includes/figures/figure.html',
full_html=False,
# include_mathjax='cdn',
include_plotlyjs='cdn')
It stores the interactive figure inside HTML file which you can then include in your post using <div data-include="/figures/figure.html"></div>. We set full_html
to false
because we want the figure to be part of an already existing HTML site and include_plotlyjs
to ‘cdn’ which means the Plotly JavaScript library will be fetched from the web (similar to the MathJax library)4 because it would otherwise bloat each figure to >3MB. Here’s a comparison (click on the arrows to change the image and on the second image to see how interactive it is!):
6. Markdown and HTML: A love-hate relationship
Markdown is great for structuring text with ease (and that’s what it’s made for) but as soon as you’d like to add some advanced functionality like image slideshows or even just colored text, you’ll have to resort to HTML. Because Jekyll converts your markdown to HTML anyways, this often works out of the box. But when it doesn’t work, it’s weird. Part of the problem is the implicit handling of some style properties in markdown by adding or removing whitespace (tabs, spaces, newlines) and another the peculiarities of different markdown-HTML converters.
Take collapsible section for example. They are not natively supported by markdown, but easily to add with a little HTML like this:
<details>
<summary>Click to expand!</summary>
## Heading 1. A numbered 2. list * With some * Sub bullets
</details>
Now when I actually type this here, see what happens:
Click to expand!
## Heading 1. A numbered 2. list _ With some _ Sub bulletsThe collapsible is there, but its content, written in markdown, doesn’t get processed into HTML. There are several solutions to this. You can simply write everything in HTML, it works, but that’s usually what you were trying to avoid in the first place by using markdown with Jekyll. You can switch the markdown processor from kramdown to CommonMarkGhPages in your _config.yml
. You have to be careful to add a blank line between the first HTML line and the markdown content and to indent everything, but it works great. Until you want to add some sophisticated HTML, like an interactive visualization, and you have to find out that it gets partly parsed as markdown to be converted into HTML and breaks.
The solution I’m currently using is the following:
<details markdown="1">
<summary>Click to expand!</summary>
## Heading 1. A numbered 2. list * With some * Sub bullets
</details>
This works as expected! (Note the markdown="1"
addition)
Click to expand!
Heading
- A numbered
- list
- With some
- Sub bullets
There is no need to add weird whitespace, doesn’t break other code like the interactive visualizations and can also be used to wrap markdown content in other kinds of HTML containers.
8. Tips, Tweaks & Tricks
There are a couple of small tweaks and insights I’d like to summarize in this section. This list probably (and hopefully) be growing over time, as I’ll add whatever I find out.
-
Popup footnotes
Footnotes are great to unclutter your main text, but I hate to have to jump to the end of the page (or, heavens forbid, scroll there) only to scroll back up in search of where I left of once I’ve read the footnote. That’s already slightly improved in the build in way markdown handles footnotes, as there always is a reference back to where you came from. Simply write
[^1]
where you want your footnote to appear and then, somewhere below,[^1]: your footnote text
.But the main advantage of the digital format is, that you can show footnotes in a popup next to the text where they appear whenever you hover or click on them. To enable this functionality, simply add this file to your
_include
directory5 and this line <div data-include="popup.html"></div> to your e.g. default layout in_layouts
. Et voilá, popup footnotes!6If your footnotes don’t look nice (e.g. the number is too large and not a superscript), add those lines to your
style.scss
:sup { line-height: 1em; font-size: 0.75em; position: relative; top: -0.5em; vertical-align: baseline; }
-
Cross-references
To use cross-references in markdown, i.e. jump to a specific section, you can simply use
[something](#the-section-name)
which will then look like something. If you want to reference to something else than a section, you’ll have to put an HTML anker there first, like so<a name="this-is-an-anker"></a>
which you can then refer to in the same way as before with[something](#this-is-an-anker)
. -
Selective printing
In an earlier post I wanted the reader to be able to print out a specific section (the summary) of the post. One way to achieve this is wrapping everything you don’t want to be printed into
<div class="noprint" markdown="1"></div>
7 fences and putting the following into yourstyle.scss
file:@media print { .noprint { display: none; } }
You can also add additional things here like
footer {display: none;}
if you don’t want your footer to show up in the printout. -
Slideshows
Slideshows are neat, because you can put in tons of visualizations without making your post unbearably long. I’ve basically copy-pasted this example into a
_includes/slideshow.html
(JavaScript part)8 and a_sass/_slideshow.scss
(CSS part) and enabled it by putting <div data-include="slideshow.html"></div> into my_layouts/default.html
file as well as@import "slideshow";
at the top of mystyle.scss
file. -
Adding videos
Adding videos to your site is extremely easy. Simply add it to a directory inside your GitHub Pages repository, say
videos
, and use<video width="100%" height="auto" loop autoplay controls> <source type="video/mp4" src="/videos/my_video.mp4" /> </video>
Note that, when working offline, there seems to be a bug with Chrome/Chromium (at the time of me writing this) where the video won’t play. Don’t worry, it will play online and you can still test it offline with another browser like Firefox.
-
Interactive code
Interactive figures are one thing, but as you most likely produced them using some code, wouldn’t it be nice if people also could interact with the code and change the figure to their liking? Fortunately that’s super simple! Like already shown here, you can create your figures in a Jupyter notebook—like this one which you can find in the notebooks directory—and add an
environment.yml
9 file to the root of your GitHub page repository, filling in all packages you used in your notebook. Then head over to the Binder website.Over there, you simply fill in the URL of your GitHub pages repository and the path to the notebook you want to run—like
/notebooks/beautiful-blogging.ipynb
—and copy the markdown generated below. Paste it wherever you want to link to your code to get this:An interested reader can now simply click on it to start an interactive version of your code!
-
Note again the
post
vspage
dilemma. ↩ -
The
endraw
should look like the {% raw %} but I couldn’t get that to work… ↩ -
We do this, because JavaScript libraries are usually slow to load, especially if they are large, so no point in bloating up a post which doesn’t even make use of the functionality. ↩
-
Use
include_mathjax
if you need Latex support in figure labels etc. ↩ -
I’m a popup footnote! ↩
-
Remember the
markdown="1"
trick to force kramdown to process your markdown as such? ↩ -
With the addition of {% if page.slideshow %} so I can enable it only if needed by putting
slideshow: true
into a posts YAML Front Matter. Have a look at_includes/slideshow2.html
instead if you need multiple slideshows. ↩ -
This assumes you are using
conda
, if you usepip
or other languages than Python, check out the Binder documentation. ↩