Migrating .Text to WordPress
I recently bit the bullet and migrated my ancient DotText (.Text) blog to WordPress. It wasn’t painless, and involved writing some code, but I’m exceedingly happy with WordPress and finally feel like I’m on a modern blogging platform again.
I considered for months and months (years?) going to Community Server (CS), which is the natural descendant of DotText, but it just didn’t make sense. CS really serves a different purpose, and WordPress is so well designed for the task at hand.
Before starting on this adventure, you may want to take a moment to increase your script timeout value for PHP to something exceedingly long. Some of the import PHP scripts will run for a couple of minutes (if you have hundreds of posts) and you don’t want them killed in the middle. Change this in your php.ini.
Migrating Posts
This is actually pretty easy. There is no DotText importer for WordPress, so you have to resort to the lowest common denominator, RSS. WordPress has an importer that will take an RSS feed in a file and import the posts. The first step though is getting all of your posts in an RSS formatted XML file.
DotText obviously supports RSS, however it only outputs the last 10 or 20 posts in the RSS feed. You can get around this by altering DotText to output all posts in the RSS feed. You can find how to do this, along with some pre-compiled DLLs to alter the behavior at PinkJoint. Once you’ve dropped these DLL’s in when you hit your RSS feed it will return all posts. After that, save it to a file and you are ready to import using the RSS importer in WordPress.
I found it helpful to open the RSS/XML file up in a text editor and do some regular expression work to change the URL’s for referenced images to something more WordPress friendly. In my case, the path to images referenced in posts were all changing. It’s perfect to do this to the XML file before doing the import.
Now for an unfortunate item. RSS doesn’t have a means (in a standard way at least) to include things like categories. Importing your content via RSS means you lose all existing category associations. This didn’t bother me that much since I wasn’t happy with the existing comments. You can also get WordPress plug-ins that will allow you to assign categories in bulk mode making it easier to fix this after migrating.
Migrating Comments
Now that the posts are moved over, we need to deal with comments. At first I considered just starting fresh with no comments, but I have over 400 comments and that seemed like a lot of content to just throw away. The method below worked great for me. I purposefully focused on tools that I was comfortable with, this could be done many different ways. The basic approach is to export all the comments into a simple CSV file, then import them using a custom PHP import script for WordPress. The connection between the comment and the post is the post title, so it is critical that you do not edit the titles on any posts until you’ve imported your comments.
The simplest way to get the comments into a CSV file is to use the SQL Server DTS tool. I selected a CSV file as a destination and used this SQL query to get the relevant content.
SELECT posts.ID AS PostID,
posts.Title,
posts.DateAdded,
comment.ID AS CommentID,
comment.Title AS CommentTitle,
comment.DateAdded AS CommentDate,
comment.Author,
comment.Email,
comment.TitleUrl,
comment.Text
FROM blog_Content COMMENT
INNER JOIN blog_Content posts ON comment.ParentID = posts.ID
WHERE (comment.PostType = 3)
This will get us a simple file with all of our comments dumped into it. With this file in hand, we can now do the import.
<?php
class CommentsCSV_Import
{
var $file;
function header()
{
echo '<div class="wrap">';
echo '<h2>' . __('Import Comments from CSV') . '</h2>';
}
function footer()
{
echo '</div>';
}
function unhtmlentities($string)
{
// From php.net for < 4.3 compat
$trans_tbl = get_html_translation_table(HTML_ENTITIES);
$trans_tbl = array_flip($trans_tbl);
return strtr($string, $trans_tbl);
}
function greet()
{
echo '<p>' . __('Hello. This importer will load the comments from a previous blog that you have dumped to a CSV file into Wordpress. Find your special CSV file to upload and click Import.') . '</p>';
wp_import_upload_form("admin.php?import=commentscsv&step=1");
}
function import_comments()
{
global $wpdb;
/*
open up our file and loop through it…
the CSV file is expected to have these columns
0 = Original Post ID
1 = Post Title
2 = Post Date
3 = Original Comment ID
4 = Comment Title
5 = Comment Date
6 = Comment Author
7 = Comment Email
8 = Comment Author Website
9 = Comment Text
*/
set_magic_quotes_runtime(0);
$row = 1;
$handle = fopen($this->file, "r");
while (($data = fgetcsv($handle, 10000, ",")) !== false) {
echo "<p> <strong>Reading row $row.</strong><br /></p>\n";
$data[1] = str_replace('\'', '\\\'', $data[1]);
echo "<p> Comment ID $data[3] ($data[4]) for Post ID $data[0] ($data[1]).<br /></p>\n";
// get the ID of the post this comment is for
$post_id = $wpdb->get_var("SELECT ID FROM $wpdb->posts WHERE post_title = '$data[1]'");
echo "<p> Found new ID of $post_id.<br /></p>\n";
//get the dates in the right format
echo "<p> Comment from $data[6] ($data[7], $data[8]) on $data[5].<br /></p>\n";
// cleanup the comment text
$data[9] = str_replace('\'', '\\\'', $data[9]);
$data[6] = str_replace('\'', '\\\'', $data[6]);
$data[9] = str_replace('<br>', '<br />', $data[9]);
$data[9] = str_replace('<hr>', '<hr />', $data[9]);
echo "<p> Comment:<br/>$data[9]<br /></p>\n";
// insert comment
$ret_id = wp_insert_comment([
'comment_post_ID' => $post_id,
'comment_author' => $data[6],
'comment_author_email' => $data[7],
'comment_author_url' => $data[8],
'comment_author_IP' => '0.0.0.0',
'comment_date' => $data[5],
'comment_content' => $data[9],
'comment_approved' => 1,
'user_id' => 0,
]);
// increment counter
$row++;
}
fclose($handle);
}
function import()
{
$file = wp_import_handle_upload();
if (isset($file['error'])) {
echo $file['error'];
return;
}
$this->file = $file['file'];
$this->import_comments();
wp_import_cleanup($file['id']);
echo '<h3>';
printf(__('All done. <a href="%s">Have fun!</a>'), get_option('home'));
echo '</h3>';
}
function dispatch()
{
if (empty($_GET['step'])) {
$step = 0;
} else {
$step = (int) $_GET['step'];
}
$this->header();
switch ($step) {
case 0:
$this->greet();
break;
case 1:
$this->import();
break;
}
$this->footer();
}
function CommentsCSV_Import()
{
// Nothing.
}
}
$commentscsv_import = new CommentsCSV_Import();
register_importer('commentscsv', __('CommentsCSV'), __('Import posts from an CSV file of comments'), [$commentscsv_import, 'dispatch']);
?>
Copy the above CommentsCSV importer and place it in the importer directory. Go to the import tab and you will see CommentsCSV listed. Upload the file and watch it do it’s magic.
Note that CommentsCSV does a minimal effort to make things XHTML compliant, but don’t expect pretty XHTML at the end.
What’s Left?
So we now have all of our posts (without their categories) and they have all the relevant comments attached to them. We are sitting pretty at this point, but, there are some gotchas.
Articles don’t get sent in the RSS feed for DotText so you will not have those imported. There really isn’t an equivalent of an article in WordPress, and most DotText users have a small number of articles. I’m just moving mine by hand doing a copy/paste of the HTML into WordPress.
I hope that others find this helpful in their migration to WordPress. Feel free to contribute your own experience in the comments.