Markup Conversion

Lightweight markup is designed to be readily converted to HTML. WikiText provides a means to convert markup to:

Conversion In Eclipse

These conversions can be made by right-clicking any *.textile, *.tracwiki, *.mediawiki, *.twiki, or *.confluence resource in the Eclipse UI:

Performing a conversion from the UI will cause corresponding files (*.xml, *.html, *-toc.xml) to be created in the same folder as the selected file(s).

More control over the conversion process can be achieved by using Ant build scripts (described below).

Conversion using Ant build scripts

Ant build scripts may also be used to drive a markup conversion. The following is an example of how to drive conversion from Textile markup to Eclipse help format (to HTML and toc.xml):

	<property name="wikitext.standalone" value=""/><!-- path to wikitext standalone package -->

	<path id="wikitext.classpath">
		<fileset dir="${wikitext.standalone}">
			<include name="org.eclipse.mylyn.wikitext.*core*.jar"/>
		</fileset>
	</path>

	<taskdef classpathref="wikitext.classpath" resource="org/eclipse/mylyn/wikitext/core/util/anttask/tasks.properties" />
	
	<target name="generate-help" depends="init" description="Generate Eclipse help from textile source">
		<wikitext-to-eclipse-help markupLanguage="Textile" 
			multipleOutputFiles="true"
			navigationImages="true"
			helpPrefix="help">
			<fileset dir="${basedir}">
    				<include name="help/*.textile"/>
			</fileset>
			<stylesheet url="styles/help.css"/>
			<stylesheet url="styles/main.css"/>
		</wikitext-to-eclipse-help>
	</target>

Similar Ant scripts can be used to convert to HTML:

	<target name="generate-html" depends="init" description="Generate HTML from textile source">
		<wikitext-to-html markupLanguage="Textile">
			<fileset dir="${basedir}">
    				<include name="help/*.textile"/>
			</fileset>
			<stylesheet url="styles/main.css"/>
		</wikitext-to-html>
	</target>

Conversion using Ant is used by the WikiText project to create help content. We find that writing help content in Textile markup is much easier than writing DocBook or HTML.

The <stylesheet> entries in the above examples are optional; these cause an HTML link to one or more stylesheets to be added to the head of the generated HTML document.

The markupLanguage attribute accepts any of the following values (depending on your classpath):

common task options

Option Usage
markupLanguage The markup language to use, for example ‘Textile’, ‘Confluence’, ‘MediaWiki’, ‘TracWiki’, ‘TWiki’.
validate Indicate if the input file should be validated. Default is true.
failOnValidationError Indicate if validation errors should cause a build failure. true or false, default is true.
failOnValidationWarning Indicate if validation warnings should cause a build failure. true or false, default is false.
overwrite Indicate if target files should be overwritten even if the target document is newer than the source document. true or false, default is false.
sourceEncoding Indicate source file encoding. Example: UTF-8. Defaults to the platform default encoding as defined by java.nio.charset.Charset.defaultCharset(). See the IANA Charset Registry for valid charset names.
internalLinkPattern The pattern to use when creating hyperlink targets for internal links. The pattern is implementation-specific, however implementations are encouraged to use {link MessageFormat}, where the 0th parameter is the internal link. Example: @/wiki/{0} would cause internal links to page Help to be rendered as /wiki/Help

wikitext-to-html and wikitext-to-eclipse-help task options

Option Usage
title Specify the title of the output document. If unspecified, the title is the filename (without extension).
file The source file. Not required if a fileset is specified.
linkRel The ‘rel’ value for HTML links. If specified the value is applied to all generated links. The default value is null.
multipleOutputFiles Indicate if output should be generated to multiple output files (true/false). Default is false.
formatOutput Indicate if the output should be formatted (true/false). Default is false.
navigationImages Indicate if navigation links should be images (true/false). Only applicable for multi-file output. Default is false.
prependImagePrefix If specified, the prefix is prepended to relative image urls.
overwrite Indicate if output files should be overwritten. The default is false. When false output files are only overwritten if the output file timestamp is older than the markup source file.
helpPrefix The prefix to URLs in the toc.xml, typically the relative path from the plugin to the help files (wikitext-to-eclipse-help only). For example, if the help file is in ‘help/index.html’ then the help prefix would be ‘help’
defaultAbsoluteLinkTarget Specify that hyperlinks to external resources (<a href) should use a target attribute to cause them to be opened in a seperate window or tab. The value specified becomes the value of the target attribute on anchors where the href is an absolute URL.
xhtmlStrict Indicate if the builder should attempt to conform to strict XHTML rules. The default is false.
emitDoctype Indicate if the builder should emit a DTD doctype declaration. The default is true.
htmlDoctype The doctype to use. Defaults to <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">.

stylesheet

Nested <stylesheet> elements cause HTML to contain links to CSS stylesheets or CSS stylesheet content. When used with the url attribute the stylesheet element is linked. When used with the file attribute the stylesheet content is copied into the HTML document.

Stylesheets may have nested <attribute> elements with name and value. These attributes are copied verbatim to the HTML <link> element. Attributes named type, rel and href are ignored.

PDF and XSLFO

WikiText can convert wiki markup to XSL-FO. PDF is readily obtained from XSL-FO by using an FO processor such as the excellent Apache FOP project.

	<wikitext-to-xslfo markupLanguage="Textile">
		<fileset dir="help" includes="**/*.textile"/>
	</wikitext-to-xslfo>

WikiText conversion to XSL-FO is performed using the wikitext-to-xslfo task. In addition to common options listed above, the following options are available:

wikitext-to-xslfo task options

Option Usage
targetdir Specify a folder in which output files should be created.
title Specify a specific book title. If unspecified, the book title is the filename of the source file (without extension).
subTitle Specify a sub-title to appear under the book title.
fontSize Specify the default font size. The default is 10.0
showExternalLinks Indicate if external link URLs should be emitted in the text. The default is true.
underlineLinks Indicate if links should be underlined. The default is false.
pageBreakOnHeading1 Indicate if h1 headings should start a new page. The default is true.
panelText Indicate if the text ‘Note: ’, ‘Tip: ’, and ‘Warning: ’ should be added to blocks of type note, tip and warning respectively.
version A document version to emit on the title page, for example: ‘Version 1.0.23’
date A date to emit on the title page.
author An author to emit on the title page.
copyright A copyright to emit in the document page footer.
pageNumbering Indicate if pages should be numbered. The default is true.
pageMargin The page margin in cm. Defaults to 1.5.
pageHeight The page height in cm. Defaults to A4 sizing (29.7)
pageWidth The page width in cm. Defaults to A4 sizing (21.0)

PDF from XSL-FO Quick-Start

To convert the XSL-FO output files to PDF using the Apache FOP project, add the following to your Ant script:

	<property name="fop.home" value="/full/system/path/to/fop-0.95"/>
	<exec command="${fop.home}/fop">
		<arg value="${basedir}/help/MyFile.fo"/>
		<arg value="${basedir}/help/MyFile.pdf"/>
	</exec>

Refer to the Apache FOP documentation for more details.

DocBook

WikiText can convert markup to DocBook

	<wikitext-to-docbook markupLanguage="Textile">
		<fileset dir="${textile.root.dir}">
 			<include name="**/*.textile"/>
		</fileset>
	</wikitext-to-docbook>

You can use WikiText first to convert your Textile markup to DocBook then use the DocBook XSL stylesheets to convert the DocBook to Eclpse help content, HTML, pdf or other formats. For more information on using the DocBook XSL stylesheets please refer to the DocBook XSL project

wikitext-to-docbook task options

Option Usage
bookTitle Specify a specific book title. If unspecified, the book title is the filename of the source file (without extension).
overwrite true or false, default is true. Indicate if existing target files should be overwritten even if they are newer than the source file.
file The source file. Not required if a fileset is specified.
doctype Overrides the DTD doctype to use in the output file. Optional.

DITA

WikiText can convert markup to OASIS DITA. The conversion can either be used to convert a single input file to a bookmap and multiple topics, or to a single topic.

WikiText conversion to DITA is performed using the wikitext-to-dita task. In addition to common options listed above, the following options are available:

wikitext-to-dita task options

Option Usage
bookTitle Specify a specific book title. If unspecified, the book title is the filename of the source file (without extension).
overwrite true or false, default is true. Indicate if existing target files should be overwritten even if they are newer than the source file.
file the source file. Optional, not required if a fileset is specified.
doctype Overrides the DTD doctype to use in the target bookmap. Optional.
topicDoctype Overrides the DTD doctype to use in the target topic files. Optional.
topicFolder The relative folder name to use for topic files when producing multiple output files. Optional, defaults to ‘topics’.
topicStrategy Specify how multiple output files are generated. Optional, defaults to ‘FIRST’. Must be one of ‘FIRST’, ‘LEVEL1’ or ‘NONE’. ‘FIRST’ indicates that multiple topic files are to be created, split at the level of the first heading encountered in the file. ‘LEVEL1’ indicates that multiple topic files are to be created, split one file for each level-1 heading encountered. ‘NONE’ indicates that multiple topic files are not to be created. Only a single topic file is created, with no bookmap.
formatting Indicate if the XML output should be formatted. Defaults to ‘true’.

wikitext-to-dita – Multiple Files Example

To convert an input file to a bookmap and multiple topics, use the following:

	<wikitext-to-dita markupLanguage="Textile">
		<fileset dir="help" includes="**/*.textile"/>
	</wikitext-to-dita>

The output is created as multiple files: a bookmap and multiple topics, one topic for every level-1 heading.

wikitext-to-dita – Single Output File Example

To convert an input file to a single output file, use the following:

	<wikitext-to-dita markupLanguage="Textile"
		topicStrategy="NONE">
		<fileset dir="help" includes="**/*.textile"/>
	</wikitext-to-dita>

MediaWiki To Eclipse Help

Mylyn WikiText provides a means to generate Eclipse Help content from multiple MediaWiki pages, directly from the wiki. This feature takes into account cross-page hyperlinks, template expansion and downloading images that appear in the page. To use this feature use the <mediawiki-to-eclipse-help> Ant task as follows:

    	<mediawiki-to-eclipse-help
    		wikiBaseUrl="http://wiki.eclipse.org"
			validate="true"
			failonvalidationerror="true"
			prependImagePrefix="images"
			formatoutput="true"
			defaultAbsoluteLinkTarget="mylyn_external"
    		dest="${basedir}"
    		title="Mylyn"
    		generateUnifiedToc="false">
    		<path name="Mylyn/User_Guide" title="Mylyn User Guide" generateToc="true"/>
    		<path name="Mylyn/FAQ" title="Mylyn FAQ" generateToc="true"/>
			<stylesheet url="book.css"/>
    		<pageAppendum>

= Updating This Document =

This document is maintained in a collaborative wiki.  If you wish to update or modify this document please visit 
{url}</pageAppendum>
    	</mediawiki-to-eclipse-help>
    	

To use this Ant task you’ll need to add a <taskdef> to your Ant script as follows:

	<taskdef classpathref="wikitext.tasks.classpath" 
		resource="org/eclipse/mylyn/internal/wikitext/mediawiki/core/tasks/tasks.properties"/>

The following describes the Ant task and its configurable options:

Option Usage
dest The destination folder into which generated files should be placed. Typically this is the root folder of your bundle (plug-in) project.
wikiBaseUrl The base URL of the wiki. Example: http://wiki.eclipse.org
defaultAbsolutLinkTarget A default target attribute for links that have absolute (not relative) urls. By default this value is null. Setting this value will cause all HTML anchors to have their target attribute set accordingly.
emitDoctype Indicate if the resulting HTML should include a DTD. The default value is true.
fetchImages Indicate if images should be downloaded from the wiki. The default value is true.
formatOutput Indicate if generated HTML files should be formatted. The default value is false. If your generated files are to be stored in a version control system it’s recommended to enable this option.
generateUnifiedToc Indicate if a unified Eclipse help table of contents should be generated. Defaults to true.
helpPrefix The prefix to prepend to table of contents references if the help content is not generated into the root of your plug-in bundle. Defaults to null.
htmlDoctype The doctype to use when generating HTML. Defaults to <!DOCTYPE html PUBLIC \"-//W3C//DTD XHTML 1.0 Transitional//EN\" \"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd\">
htmlFilenameFormat The filename format to use when generating output filenames. Defaults to $1.html where $1 is the name of the page.
linkRel The ‘rel’ value for HTML links. If specified the value is applied to all links generated by the builder. The default value is null. Setting this value to “nofollow” is recommended for rendering HTML in areas where users may add links, for example in a blog comment.
multipleOutputFiles Indicate if wiki pages should result in multiple output files, split at top-level headings. Defaults to true.
navigationImages Indicate if navigation (next/previous) links should use images. Defaults to true.
prependImagePrefix The folder name to prepend to image references. Defaults to "images".
suppressBuiltInCssStyles Indicate if default built-in CSS styles should be suppressed. Built-in styles are styles that are emitted to create the desired visual effect when rendering certain types of elements, such as warnings or infos. Defaults to false.
templateExcludes Indicate MediaWiki template names to exclude. A comma-delimited list of names, may include ‘*’ wildcards. Defaults to null. Example: bug, navigationHeader
title The title of the generated help content.
tocFile The filename to use for the generated unified table of contents. Defaults to toc.xml in the dest folder.
useInlineCssStyles Indicate if built-in styles should be generated inline or in the document head. Defaults to true, resulting in inline styles.
xhtmlStrict Indicate if the generated output should attempt to conform to XHTML strict. Defaults to false.

One or more <path> tags must be nested, with attributes as follows:

Option Usage
name The name of the wiki page, which is typically the URL following the wikiBaseUrl. For example, ‘Mylyn/FAQ’
title The title of the page. If unspecified, defaults to the path name.
generateToc Indicate if an independent Eclipse help table of contents should be generated for this path. Defaults to false.
includeInUnifiedToc Indicate if this path should be included in the unified table of contents. Defaults to true.
tocParentName When specified causes the path to appear nested under another path in the generated unified table of contents. If unspecified this path will generate table of contents at the top level. Defaults to null.

A single <pageAppendum> tag can be nested, in which content may be specified that is appended to each wiki page during the generation process. A token @ is replaced with the original URL to the wiki page. In this manner users can be directed to the source location for editing the document. @<pageAppendum> may also be used to append arbitrary content, such as a copyright notice.

Table Of Contents

When using <mediawiki-to-eclipse-help> there are two modes of operation:

  1. either have the Ant task generate a table of contents containing links to headings from all generated files, or
  2. generate an independant table of contents for each wiki path and link them together by writing a master table of contents by hand and using <link> tags.

The first option requires less effort, but results in less control over the output. The second option is more flexible, but requires writing a master table of contents.

Ant Examples

See the examples for example Ant build scripts.

Markup Language Customization

Mylyn WikiText provides a means of customizing wiki markup languages for use with Ant tasks. This is useful for altering the markup language to include specialized markup rules specific to your needs.

To customize a markup language you may either extend a markup language using subclassing, or you may provide a MarkupLanguageConfiguration. The best option will vary depending on your needs. MarkupLanguageConfiguration provides a means of altering a markup language without subclassing the language itself, which makes it reusable with different markup languages.

Following is an example of providing a MarkupLanguageConfiguration configuration:

<wikitext-to-eclipse-help markupLanguage="org.eclipse.mylyn.wikitext.textile.core.TextileLanguage" ...>
	<markupLanguageConfiguration escapingHtmlAndXml="true"/>
</wikitext-to-eclipse-help>

You may decide to customize your markup language by subclassing MarkupLanguageConfiguration. In this case your Ant script may look more like this:

<taskdef resource="org/eclipse/mylyn/wikitext/core/util/anttask/tasks.properties" classpathref="wikitext.ant.classpath"/>
<typedef name="languageConfiguration" classname="com.example.wikitext.MyCustomizedMarkupLanguageConfiguration" classpathref="wikitext.ant.classpath"/>
		
<wikitext-to-eclipse-help markupLanguage="org.eclipse.mylyn.wikitext.textile.core.TextileLanguage" ...>
	<languageConfiguration escapingHtmlAndXml="true"/>
</wikitext-to-eclipse-help>

See the Mylyn WikiText Developer Guide for details on extending a markup language via subclassing.