Editing Yotsuba Society/Github Site

[http://github.com/bibanon/bibanon/wiki The Bibliotheca Anonoma] has put together a brand new, [http://jekyllrb.com/ Jekyll] (and [http://mmistakes.github.io/minimal-mistakes Minimal Mistakes])-based website for the [http://yotsubasociety.org Yotsuba Society], which beats the rotting Drupal 7.x CMS it used to use.

And don't worry, all the old pagelinks and downloads still work (we worked hard to make that possible), so no need to change your bookmarks.

== Situation ==

The [http://www.yotsubasociety.org Yotsuba Society], recently discovered that their website was getting spam sites injected into their aging Drupal 7.x installation.

Yes, with these messy, ancient CMS codebases, if you fail to update, security is like swiss cheese. It's a matter of time before your site gets exploited. And even if you think your site has nothing of value, it has valuable server space that spam sites can plaster their junk into.

{{#eimage:https://i.imgur.com/j8Klw8T.png|thumb|inline}}

The admin's original plan was simply to shut down the site indefinitely, but that would have meant the total death of the Yotsuba Society. A great example that sometimes, even the archivists have to archived. So I instead recommended that they abandon the CMS system entirely, and replace it with a Static HTML engine (such as Jekyll).

The CMS is often a necessary evil in large, account-based websites which implement forums, rich content, multiple posters, and such. However, by now the Yotsuba Society had significantly reduced it's operations, and was only using the CMS as a blog. Because Drupal 7 was now legacy code, it was starting to get spam ads injected into it to trick some poor saps.

Not everything has to be a giant Wordpress/Drupal/Joomla site. If you're only pushing information in a blog and some pages, perhaps with a few Disqus comments on the side, all you need is a static HTML engine, such as [http://jekyllrb.com/ Jekyll].

* '''No more complex interfaces to wrestle with.''' Just write a page and push (via FTP or Git).
* '''No more bloated WYSIYWG editors.''' Just write in Markdown syntax, it's easy to learn and has massive potential. Dump YouTube embed codes in, dump internal image links, and be done with it.
* '''No more security issues.''' Bloated CMS systems, with their accounts and SQL injection vulnerabilities, offer a massive attack surface, especially if it's not well updated. With Static HTML, there's nothing for attackers to attack, other than the web server admin console.
* '''Static HTML uses significantly fewer resources.''' You don't need a PHP engine or SQL Database to generate pages on the fly anymore. The HTML pages are pregenerated on the author's computer, and just thrown at the viewer. In fact, you can serve them for free via Github Pages (which allows you to use your same ol' custom domains).

And yes, Static HTML engines support comments too, via [https://help.disqus.com/customer/portal/articles/472138-jekyll-installation-instructions Disqus.]

== Migration Rules ==

First, we must lay down some ground rules for website migration.

* '''NEVER cause link rot.''' - Isn't it annoying when your bookmarked links no longer work? Even if the original content has been imported, you will break links if you change them to a different URL structure. Link rot causes a whole host of issues, from reduced accessibility to reduced Google listing presence.
* We have to make sure that links such as <code>http://yotsubasociety.org/node/1</code> still work, or at least redirect in the new site. Luckily, Jekyll has [http://davidtuite.com/posts/how-to-manage-permalinks-in-jekyll a <code>permalink:</code> option to set custom URLs], and a [https://help.github.com/articles/redirects-on-github-pages/ Jekyll Redirect-from plugin] to create multiple redirects. Say goodbye to link rot.
* '''Make sure all downloadable files remain in the same location.''' - Related to link rot. Ensure that any downloadable files can be accessed from the exact same URLs as you used to use.
* '''Retain as much functionality as possible.''' - Don't drop features that the old site used to have: no matter how trivial, someone out there really does use them. Try to find some kind of alternative that the new site can provide.
* '''RSS Feeds''' - Yes, there are people out there that still use these, despite that Google Reader is long gone. How else would you subscribe to of blogs? Thankfully, most Jekyll themes come with a templatable <code>feeds.xml</code> that generates an RSS XML feed without any effort.
* '''Comments''' - While the Yotsuba Society doesn't have comments, I would have used Disqus if it did, and imported the old comments with all history.
* '''Multiple Authorship''' - This is a tricky one, given that it would be unsafe to give account access to all authors of the Yotsuba Society website. Since Jekyll is static HTML and best used with Git anyway, I would migrate the site to Github Pages, where you can give multiple users commit access to a repository.
* '''Teach the Website Owners well.''' - Make sure that the owners of the site actually know how to use the engine, and provide plenty of documentation.
* Jekyll is pretty simple to work with, but the actual command-line tools that help create posts can be a pain to install on Windows. Unfortunately, since most of the world uses Windows, you'll have to figure out a suitable alternative.
* The [https://github.com/blog/905-edit-like-an-ace Github Online Repo Editor] is actually quite nice, and [https://github.com/blog/1327-creating-files-on-github you can even create files using it.]
* We then [https://github.com/yotsubasociety/yotsubasociety.github.io#getting-started created a README.md file] that provides full documentation on how to create blog posts, edit articles, and modify the site structure.

== Importing a Drupal Website into Jekyll ==

Jekyll provides a fully-functional [http://import.jekyllrb.com/docs/home/ blog import system] that will grab all pages, tags, categories from Drupal, by communicating with the SQL server.

<blockquote>'''Note:''' This script can't grab image nodes or comments! Remember to grab those manually or obtain via some other method!<br />
Also, it only grabs blog posts. Home Pages and other special nodes also need to be obtained manually.
</blockquote>
# Install Ruby: [https://gorails.com/setup/osx/10.10-yosemite Mac OS X] - [https://www.ruby-lang.org/en/documentation/installation/ Linux]
# Install Node.js: [http://nodejs.org/download/ Mac OS X] - [https://github.com/joyent/node/wiki/installing-node.js-via-package-manager Linux]
# Open a command line.
# [http://import.jekyllrb.com/docs/installation/ Install Jekyll-Import.] Some manual installation may be necessary.

* NOTE: This converter requires Sequel and the MySQL gems.
* MySQL has been superseded by MariaDB in Linux. Make sure to install <code>mariadb</code> and <code>libmariadbclient-dev</code> (for Debian)
* The MySQL gem can be difficult to install on OS X. Make sure to install MySQL, and use this argument instead: <code>--with-mysql-config=/usr/local/mysql/bin/mysql_config</code>

<pre>$ sudo gem install sequel
$ sudo gem install execjs
$ sudo gem install mysql --with-mysql-config=/usr/bin/mysql_config</pre>
<ol start="4" style="list-style-type: decimal;">
<li>Use the import commands shown on Jekyll-Import documentation: [http://import.jekyllrb.com/docs/drupal6/ Drupal 6] - [http://import.jekyllrb.com/docs/drupal7/ Drupal 7]</li></ol>

You should edit the fields in the command before using it.

* <code>dbname</code> - The name of your database, just as Drupal asked you during installation. (check PHPMyAdmin)
* <code>user</code> - The username of the database user. Check your hosting provider's admin console.
* <code>password</code> - The password of the database user.
* <code>host</code> - The SQL Server hosting all the website data.
* <code>prefix</code> - The table prefixes used in the database. Usually, it's <code>drupal_</code>, but you might have set something different.

There are two ways to work with the Drupal SQL Database:

# You can communicate directly with the curren website's Drupal SQL Database. However, it might be necessary to add your current IP as a trusted host (see your hosting provider for more details).
# Alternatively, you can make a SQL database dump using PHPMyAdmin, import it, and host your own database on your computer. The <code>host</code> entry should then be <code>localhost</code>. This can be a bit more challenging to set up, but it reduces security vulnerabilities, and is necessary when a backup is all you've got.

For example, here is the command we used to communicate with the Yotsuba Society MySQL Database:

<source lang="bash">$ ruby -rubygems -e 'require "jekyll-import";
    JekyllImport::Importers::Drupal7.run({
      "dbname"   => "yotsubasociety",
      "user"     => "yotsubasociety",
      "password" => "put_your_password_here",
      "host"     => "mysql.yotsubasociety.org",
      "prefix"   => "drupal_"
    })'</source>
=== Set up a SQL Backup and Export from it ===

Sometimes you might only have access to a SQL database backup. To export this database, you will have to create a local MySQL/MariaDB server, and import the database backup.

<ol style="list-style-type: decimal;">
<li>Install MySQL/MariaDB. Some Linux distros may have already migrated to MariaDB, which is a drop-in replacement for MySQL.</li>
<li><p>Start the MySQLd Service. On Debian/Ubuntu:</p>
<p>sudo service start mysqld</p></li>
<li><p>Run the MySQL/MariaDB Secure Installation Script as root, and follow the instructions. Make sure to drop the test database and reload the privilege tables.</p>
<p>sudo mysql_secure_installation</p></li>
<li><p>Once you're finished, log in as the root MySQL user.</p>
<p>mysql -u root -p</p></li>
<li><p>Create a user to manage the databases. For example, I used user: <code>localuser</code> with password: <code>password</code>.</p></li></ol>

<pre>MariaDB [(none)]&gt; CREATE USER 'localuser'@'localhost' IDENTIFIED BY 'password';
Query OK, 0 rows affected (0.00 sec)

MariaDB [(none)]&gt; GRANT ALL PRIVILEGES ON *.* TO 'localuser'@'localhost'
    -&gt;            WITH GRANT OPTION;
Query OK, 0 rows affected (0.00 sec)
</pre>
<ol start="6" style="list-style-type: decimal;">
<li>Now create a new database to import the backup into. In this example, we call it <code>yotsubasociety</code>. Then quit.</li></ol>

<pre>MariaDB [(none)]&gt; create database yotsubasociety;
Query OK, 1 row affected (0.00 sec)

MariaDB [(none)]&gt; quit</pre>
Now you can import the database. As the <code>localuser</code> user, we access the <code>localhost</code> SQL server and insert the backup.sql dump into the <code>yotsubasociety</code> database.

<pre>mysql -u localuser -p -h localhost yotsubasociety &lt; yotsubasociety352015.sql</pre>
Finally, here's the command we used to export to Jekyll from the <code>localhost</code> SQL Server. Usually, the prefix is <code>drupal_</code>.

<source lang="bash">$ ruby -rubygems -e 'require "jekyll-import";
    JekyllImport::Importers::Drupal7.run({
      "dbname"   => "yotsubasociety",
      "user"     => "localuser",
      "password" => "password",
      "host"     => "localhost",
      "prefix"   => "drupal_"
    })'</source>
=== Cleaning up the Posts ===

Unfortunately, [https://github.com/jekyll/jekyll-import/issues/90 due to bugs in the Drupal import script:]

* The author names aren't imported.
* The correct slugs aren't imported. In order to maintain compatibility with the old site's links, we need to grab the <code>url_alias</code> table as shown in [https://www.drupal.org/files/er_db_schema_drupal_7.png the Drupal 7 database schema.]
* The title is corrupted, as shown below:

<pre>---
layout: post
title: !binary |-
  SW50cm9kdWN0aW9uIHRvIFlvdHN1YmEgU29jaWV0eQ==
created: 1300717398
---</pre>
On the other hand, the correct title (well, lost underscores and Capitals) is always posted in the filename:

<code>2014-03-04-the-complete-history-of-4chan.md</code>

There must be some way we can make the title work. (though maybe it might actually display when compiled?)

=== Patching Jekyll-Import to work with Drupal 7 ===

Jekyll-Import's Drupal 7 import scripts just aren't perfect or complete, [https://github.com/jekyll/jekyll-import/issues/90 as this bug report shows.] We had to patch it to give us the correct title.

I have fixed this bug entirely by forcing the strings into Unicode format (and stripping any preceding and ending whitespace with <code>strip</code>):

<source lang="ruby"># Get the relevant fields as a hash, delete empty fields and convert
# to YAML for the header
data = {
    'layout' => 'post',
    'title' => title.strip.force_encoding("UTF-8"),
    'created' => created,
    'excerpt' => summary
}.delete_if { |k,v| v.nil? || v == ''}.to_yaml</source>
That way, it works even for those pesky titles with stray 2 junk that screws everything up.

=== Hacking the Jekyll-Import Gem ===

Before the change went live at the [https://github.com/jekyll/jekyll-import/blob/master/lib/jekyll-import/importers/drupal7.rb#L76 Jekyll-Import] gem, I had to push the change to my existing gem to make the title work. First, we will have to be able to edit the gem, which is non-trivial. Thankfully, this user on StackOverflow has a handy [http://stackoverflow.com/a/8690945 Fork and Source method.]

<ol style="list-style-type: decimal;">
<li>Fork the [https://github.com/jekyll/jekyll-import/ Jekyll-Import] script to your own Github account.</li>
<li><p>Make your edits to [https://github.com/antonizoon/jekyll-import/blob/master/lib/jekyll-import/importers/drupal7.rb#L76 the Drupal import script] on your own repository. For example, I edited the following to add a <code>permalink</code> entry with spaces as underscores, and a better Title section:</p>
<pre>  # Get the relevant fields as a hash, delete empty fields and convert
  # to YAML for the header
  data = {
    'layout' =&gt; 'post',
    'title' =&gt; '' + title,
    'permalink' =&gt; '/' + title.strip.gsub!(' ', '_'),
    'created' =&gt; created,
    'excerpt' =&gt; summary
  }.delete_if { |k,v| v.nil? || v == ''}.to_yaml</pre></li>
<li><p>Now, clone your [https://github.com/antonizoon/jekyll-import/ forked Jekyll-Import repository] and add this to the Gemfile (also remove the <code>gemspec</code> line):</p>
<p>gem 'gem_name', :git =&gt; 'git://github.com/username/foo'</p></li>
<li>Run the command <code>bundle install</code> to install the modified Gem.</li>
<li><p>Run the Jekyll-Import command you planned to use as usual. If it works, submit a pull request to the authors.</p></li></ol>

(though for me, the changes didn't stick, so I just hacked the file directly at: <code>/usr/lib/ruby/gems/1.9.1/gems/jekyll-import-0.5.3/lib/jekyll-import/importers/drupal7.rb</code>)

=== Obtain url_alias ===

If your website used a <code>url_alias</code>, as it probably should have, you will definitely want to inject them into the blog pages as a Jekyll <code>permalink</code>.

Sadly, [https://www.drupal.org/files/er_db_schema_drupal_7.png as you see from the Drupal 7 Schema], the <code>url_alias</code> table is in no way relationally related to a node, which is just plain stupid and makes life hard.

I guess the only way to insert this right is to do it by hand. That's what we were forced to do.

First, use the following MySQL command to open the table and grab everything from the <code>url_alias</code> table.

<pre>MariaDB [(none)]&gt; USE yotsubasociety
Database changed
MariaDB [yotsubasociety]&gt; SELECT * FROM drupal_url_alias;</pre>
You will obtain all the <code>url_alias</code> from the database:

{|
!align="right"| pid
!align="center"| source
! alias
|-
|align="right"| 1
|align="center"| [http://www.yotsubasociety.org/node/4 node/4]
| articles
|-
|align="right"| 2
|align="center"| [http://www.yotsubasociety.org/node/6 node/6]
| the_otaku_continuum
|-
|align="right"| 3
|align="center"| [http://www.yotsubasociety.org/node/7 node/7]
| contact
|-
|align="right"| 4
|align="center"| [http://www.yotsubasociety.org/node/8 node/8]
| imageboardguide
|-
|align="right"| 5
|align="center"| [http://www.yotsubasociety.org/node/9 node/9]
| boardsfaq
|-
|align="right"| 6
|align="center"| [http://www.yotsubasociety.org/node/10 node/10]
| Channerstages
|-
|align="right"| 7
|align="center"| [http://www.yotsubasociety.org/node/5 node/5]
| staff_recruitment_and_content_drive
|-
|align="right"| 9
|align="center"| [http://www.yotsubasociety.org/node/12 node/12]
| archiveslaunch
|-
|align="right"| 10
|align="center"| [http://www.yotsubasociety.org/node/13 node/13]
| An_Ode_to_the_F40PH
|-
|align="right"| 11
|align="center"| [http://www.yotsubasociety.org/node/14 node/14]
| news_update_5_23_2011
|-
|align="right"| 12
|align="center"| [http://www.yotsubasociety.org/node/15 node/15]
| Critique_and_Commentary
|-
|align="right"| 13
|align="center"| [http://www.yotsubasociety.org/node/16 node/16]
| What_is_Chanthropology
|-
|align="right"| 14
|align="center"| [http://www.yotsubasociety.org/node/17 node/17]
| originsofanon_pti
|-
|align="right"| 15
|align="center"| [http://www.yotsubasociety.org/node/18 node/18]
| originsofanon_ptii
|-
|align="right"| 16
|align="center"| [http://www.yotsubasociety.org/node/19 node/19]
| originsofanon_ptiii
|-
|align="right"| 17
|align="center"| [http://www.yotsubasociety.org/node/20 node/20]
| 20084chanthreads
|-
|align="right"| 18
|align="center"| [http://www.yotsubasociety.org/node/21 node/21]
| yotsuba_archiver_changeover
|-
|align="right"| 19
|align="center"| [http://www.yotsubasociety.org/node/22 node/22]
| the2ndchannel_pti
|-
|align="right"| 20
|align="center"| [http://www.yotsubasociety.org/node/23 node/23]
| Raids_and_invasions_briefing
|-
|align="right"| 21
|align="center"| [http://www.yotsubasociety.org/node/24 node/24]
| eternal_summer
|-
|align="right"| 22
|align="center"| [http://www.yotsubasociety.org/node/25 node/25]
| Classic_4chan_memes
|-
|align="right"| 23
|align="center"| [http://www.yotsubasociety.org/node/26 node/26]
| YS_Staff
|-
|align="right"| 24
|align="center"| [http://www.yotsubasociety.org/node/27 node/27]
| Briefings
|-
|align="right"| 25
|align="center"| [http://www.yotsubasociety.org/node/28 node/28]
| Futaba_Channel_Briefing
|-
|align="right"| 26
|align="center"| [http://www.yotsubasociety.org/node/29 node/29]
| 2channel_briefing
|-
|align="right"| 27
|align="center"| [http://www.yotsubasociety.org/node/30 node/30]
| material_submission
|-
|align="right"| 28
|align="center"| [http://www.yotsubasociety.org/node/31 node/31]
| Join_us
|-
|align="right"| 29
|align="center"| [http://www.yotsubasociety.org/node/32 node/32]
| How_to_Easily_Archive_a_Web_Site
|-
|align="right"| 30
|align="center"| [http://www.yotsubasociety.org/node/33 node/33]
| Television_Mostly_Sucks
|-
|align="right"| 31
|align="center"| [http://www.yotsubasociety.org/node/34 node/34]
| briefing_channers_age
|-
|align="right"| 32
|align="center"| [http://www.yotsubasociety.org/node/35 node/35]
| YSArchives_Update10_10_2011
|-
|align="right"| 33
|align="center"| [http://www.yotsubasociety.org/node/36 node/36]
| burial_of_Illusion_of_rules_one_and_two
|-
|align="right"| 34
|align="center"| [http://www.yotsubasociety.org/node/37 node/37]
| TheSecondChannel
|-
|align="right"| 35
|align="center"| [http://www.yotsubasociety.org/node/38 node/38]
| TheThirdChannel
|-
|align="right"| 36
|align="center"| [http://www.yotsubasociety.org/node/39 node/39]
| news_update-10-30-2011
|-
|align="right"| 37
|align="center"| [http://www.yotsubasociety.org/node/40 node/40]
| re-savetheinternet
|-
|align="right"| 38
|align="center"| [http://www.yotsubasociety.org/node/41 node/41]
| like_fish
|-
|align="right"| 39
|align="center"| [http://www.yotsubasociety.org/node/42 node/42]
| Report_of_Joint_Operations
|-
|align="right"| 40
|align="center"| [http://www.yotsubasociety.org/node/43 node/43]
| 2011_Diaspora
|-
|align="right"| 41
|align="center"| [http://www.yotsubasociety.org/node/44 node/44]
| americawonet
|-
|align="right"| 42
|align="center"| [http://www.yotsubasociety.org/node/45 node/45]
| how_to_lurk_moar
|-
|align="right"| 43
|align="center"| [http://www.yotsubasociety.org/node/46 node/46]
| Alternatives_to_Scared_Straight
|-
|align="right"| 44
|align="center"| [http://www.yotsubasociety.org/node/47 node/47]
| chanverse_racism_briefing
|-
|align="right"| 45
|align="center"| [http://www.yotsubasociety.org/node/48 node/48]
| 1-26-2012_pressrelease
|-
|align="right"| 46
|align="center"| [http://www.yotsubasociety.org/node/49 node/49]
| dealing_with_depression
|-
|align="right"| 47
|align="center"| [http://www.yotsubasociety.org/node/50 node/50]
| Can_you_make_a_emblem
|-
|align="right"| 48
|align="center"| [http://www.yotsubasociety.org/node/51 node/51]
| If_anyone_cares
|-
|align="right"| 49
|align="center"| [http://www.yotsubasociety.org/node/52 node/52]
| sp_superbowl2012
|-
|align="right"| 50
|align="center"| [http://www.yotsubasociety.org/node/53 node/53]
| ruoccupy
|-
|align="right"| 51
|align="center"| [http://www.yotsubasociety.org/node/54 node/54]
| Nurse-kun_archives
|-
|align="right"| 52
|align="center"| [http://www.yotsubasociety.org/node/55 node/55]
| facesofanonpti
|-
|align="right"| 53
|align="center"| [http://www.yotsubasociety.org/node/56 node/56]
| facesofanonptii
|-
|align="right"| 54
|align="center"| [http://www.yotsubasociety.org/node/57 node/57]
| YSchan_first_year
|-
|align="right"| 55
|align="center"| [http://www.yotsubasociety.org/node/59 node/59]
| wikichan_restoration_complete
|-
|align="right"| 56
|align="center"| [http://www.yotsubasociety.org/node/60 node/60]
| YSArchives_Update_5_6_2012
|-
|align="right"| 57
|align="center"| [http://www.yotsubasociety.org/node/61 node/61]
| Computer games keep me mentally active
|-
|align="right"| 58
|align="center"| [http://www.yotsubasociety.org/node/62 node/62]
| tuesday is backup day
|-
|align="right"| 59
|align="center"| [http://www.yotsubasociety.org/node/63 node/63]
| 2012Hibernation
|-
|align="right"| 60
|align="center"| [http://www.yotsubasociety.org/node/64 node/64]
| Mostly_Perceived_Fear_and_Loathing_of_Reddit
|-
|align="right"| 61
|align="center"| [http://www.yotsubasociety.org/node/65 node/65]
| Some_Chinese_Rail_Pics
|-
|align="right"| 62
|align="center"| [http://www.yotsubasociety.org/node/66 node/66]
| two_panels-two_powerpoints
|-
|align="right"| 63
|align="center"| [http://www.yotsubasociety.org/node/67 node/67]
| The_Imageboard_World_2
|-
|align="right"| 64
|align="center"| [http://www.yotsubasociety.org/node/68 node/68]
| imageboardworld2_present
|-
|align="right"| 65
|align="center"| [http://www.yotsubasociety.org/node/69 node/69]
| imageboardworld2_video
|-
|align="right"| 66
|align="center"| [http://www.yotsubasociety.org/node/70 node/70]
| Links and Resources
|-
|align="right"| 67
|align="center"| [http://www.yotsubasociety.org/node/71 node/71]
| russian_chanverse_notes
|-
|align="right"| 68
|align="center"| [http://www.yotsubasociety.org/node/72 node/72]
| lurkmore_to_briefing
|-
|align="right"| 69
|align="center"| [http://www.yotsubasociety.org/node/73 node/73]
| The_da_1chan_ru_came
|-
|align="right"| 70
|align="center"| [http://www.yotsubasociety.org/node/74 node/74]
| the_russian_chanverse_part_2
|-
|align="right"| 71
|align="center"| [http://www.yotsubasociety.org/node/75 node/75]
| savetheinternet_public_advisory
|-
|align="right"| 72
|align="center"| [http://www.yotsubasociety.org/node/76 node/76]
| chanverse_review
|-
|align="right"| 73
|align="center"| [http://www.yotsubasociety.org/node/77 node/77]
| two_major_updates
|-
|align="right"| 74
|align="center"| [http://www.yotsubasociety.org/node/78 node/78]
| Routine_archival_ceased
|-
|align="right"| 75
|align="center"| [http://www.yotsubasociety.org/node/79 node/79]
| 19393370_hallo_I'm_from_Futaba
|-
|align="right"| 76
|align="center"| [http://www.yotsubasociety.org/node/80 node/80]
| RIP_Yotsuba_Society_Archives
|-
|align="right"| 77
|align="center"| [http://www.yotsubasociety.org/node/81 node/81]
| YSArchives_4chan
|-
|align="right"| 78
|align="center"| [http://www.yotsubasociety.org/node/82 node/82]
| 4chan_YSArchives_inducted_to_Stanford_Digital_Repository
|-
|align="right"| 79
|align="center"| [http://www.yotsubasociety.org/node/83 node/83]
| YS_panel_presentations
|-
|align="right"| 80
|align="center"| [http://www.yotsubasociety.org/node/84 node/84]
| The_Complete_History_of_4chan
|-
|align="right"| 81
|align="center"| [http://www.yotsubasociety.org/node/85 node/85]
| Basic_Glossary_of_the_Chanverse
|-
|align="right"| 82
|align="center"| [http://www.yotsubasociety.org/node/86 node/86]
| The_Silent_WebM_revolution
|-
|align="right"| 83
|align="center"| [http://www.yotsubasociety.org/node/87 node/87]
| 2channel_Japanese_Wiki_translation
|}

I created this nice markdown table by taking the MySQL Table SELECT query, and changing the middle bar to Markdown format (changed all the <code>+</code> signs to <code>|</code>).

To ease the process of matching a node to a shortlink, I used a regex in the KDE Kate editor to match all <code>node/##</code> instances, and convert them into markdown links to the site in question. This way, I can just click a link as shown above to find the original title.

* '''Find:''' <code>node/(\d+)</code>
* '''Replace:''' <code>[node/\1](http://www.yotsubasociety.org/node/\1)</code>

=== Inject url_alias ===

Then, I open every single post dumped, and add <code>permalink: /page_name_to_use</code> in the YAML section. This can take a while.

I also use the handy [https://github.com/jekyll/jekyll-redirect-from Jekyll Redirect-from] gem to make the <code>/node/##</code> links work as well:

<pre class="yaml">redirect_from:
  - /node/1/
  - /Page_Name_In_Underscores/</pre>
<blockquote>'''Note:''' Make sure that the links all end in a <code>/</code>. This way, a folder with <code>/node/1/index.html</code> will be created, instead of <code>/node/1</code>, which is just spit at the browser as a downloadable binary.
</blockquote>
=== Choose a Jekyll Theme ===

Now that you have the data exported, choose a Jekyll theme that fits for you. Here's a nice listing of some [http://jekyllthemes.org/ free, amazing themes.]

Since I needed something simple, and since the [http://blog.bibanon.org Bibliotheca Anonoma Blog] and [http://archivis.me my own blog] uses the same theme, I used the very nice, simple, and responsive [https://github.com/mmistakes/minimal-mistakes Minimal Mistakes] theme.

All I had to do was <code>git clone</code> the theme, paste all the pages into the theme, and do a bit of configuration, and the Jekyll site is ready.

=== Hosting the Jekyll Site ===

For the most part, you will want to host your Jekyll Site using Github Pages. Github has the best support for Jekyll (they created it), and offers free limitless Static HTML hosting.

Just push your website to the <code>master</code> branch on your <code>username.github.io</code> repository, or to the <code>gh-pages</code> branch on any random Github repo. Github will automatically generate the website at <code>username.github.io</code> or <code>username.github.io/repository</code>.

For the Yotsuba Society, we had them create a new Github Organization (which is free), whereby we pushed the Jekyll website to the <code>master</code> branch on the repo: <code>yotsubasociety.github.io</code>. It was then instantly hosted at <code>http://yotsubasociety.github.io</code> without a hitch.

Notice that you can also use custom domains with Github Pages! We had to direct <code>http://yotsubasociety.org</code> to the Github Pages server, [https://help.github.com/articles/setting-up-a-custom-domain-with-github-pages/ following the instructions provided by Github.]

And now, the new Yotsuba Society Website is complete. What an amazing, difficult, but eye-opening journey.