A workflow for building, testing, and deploying apps

I put together this diagram to show the workflow I like to use for building, testing, and deploying applications.

Build and Deployment Process - New Page (2)

There are 4 stages:

Develop

A developer checks out source code into his local environment.  He builds the source code and runs the automated unit tests to verify it is working.  He then makes changes that can be viewed and tested interactively in his local setup.  When his changes are tested and completed, he checks them back in.

With git, this would involve a pull and a push — but not a push to master.  Every developer should have a remote repository that functions as a backup.  This could in theory be a branch, but I don’t like proliferation of branches.  Consistent naming makes it easier to keep track of what should be merged.

The developer then sends a merge request to the central project repository from his own repo.  So you have something that looks like:

pull request from fijiaaron/feature_branch to project/feature_branch

Package

The central project repository then pulls the changeset from the developer’s repo and does whatever automated and manual checks deemed necessary.

These could include code reformatting, style checks, static analysis, code coverage, code reviews, etc.  The project is built from scratch and unit tests are run.

If all checks pass, a package is built and pushed to the artifact repository.   If not, it is rejected and the developer is notified.  The developers master (or feature) branch still contains his commit, but the central repo remains untainted.

The artifact repository could be your git repo (but probably shouldn’t be) or a package tool such as maven’s artifactory, nuget, or an RPM repository.  It doesn’t matter as long as the packages are well named and versioned — and you have a way of keeping track of versions and a way to promote them (a simple database of artifact->version->promotion status).

The central source repository should be tagged for each package version created.

Test

Formal system testing occurs next.  I thought about naming this step “QA” to distinguish it from developer testing, but quality is everyone’s job, right?

At this stage, the source code is left behind, and a known good artifact is downloaded and deployed to a test environment.  Automated and/or manual tests are run that exercise the full system as it runs in a production-like environment.  How production-like is a decision best made by you.

At the end of the system test stage, the decision is made to promote it as ready for production or not.

Note that there can be several levels or stages of testing that run sequentially or in parallel.  This allows for a deployment pipeline that might include an environment with mocked services, ones for formal QA and stakeholder acceptance, performance & security testing, and staging environments.  The main idea is that there is a flag that denotes an artifact (or collection of artifacts) as ready for production deployment at the end of it.

Production

This is the final stage, and it’s really just another section in the deployment pipeline that happens to be the final one — or ones if you roll out in stages to some customers (eg. a beta site or A/B testing.)

Simpler and better text formatting than markdown

I was reading What’s Wrong with Markdown by Adam Hyde this morning.  Coincidentally, I’ve been researching and weighing my options for a simplified markup syntax for a Test Case Management system I’m working on.

While I agree with most of what he said, the thing that really struck home (and rang false) is that Markdown is meant as a way to visually markup text — not a shorthand syntax to translate into HTML.

When editing test cases (or comments, or really any simple form of documentation, you don’t want to get too fancy.  You don’t want to hide complexity, you want to eliminate it.  So, here is my proposal for a complete structured text format designed to be read as is … or translated into HTML or other inputs.

Text styles:

Forget about all those weenies who think they’re hip talking about semantic markup (which is really just semantics) nobody ever said, I wish I could tell people my text has emphasis or “strong”.  People want text that is bold, italic, and underlined.

*bold*

/italic/

_underline_

~strikethrough~

No further explanation needed.

Headings:

The same goes for headings. Who cares what an H6 is?  What you really care about is font size.  But, here, a little bit of semantics is useful for creating an outline or table of contents — or just a tiny bit for SEO.

= Heading 3 =

== Heading 2 ==

=== Heading 1 ===

Which heading is bigger? I bet you can tell.  A document really only has one main heading, and several nested under that.  So you should spend less time typing the headings you use more often.  Let the parser figure out which heading level is biggest and adjust accordingly.  HTML got the way headings are numbered wrong, but that’s not my problem.

And I don’t think you need more than 3 levels.  But you can make it bigger for more emphasis if you want:

================= You’ll really notice this heading (but you shouldn’t have to count dashes =================

Lists

This one isn’t hard.  But so many parsers screw it up — so does MS Word, but what’s your excuse?

Bulleted lists

* item a

* item b

* item c

Numbered lists

1. item 1

2. item 2

3. item 3

Indentation creates nesting.  That is all.

Indentation

Four spaces or a tab.  I’d restrict it to only tabs, but textareas can’t handle tabs (unless you paste them.)

indented

Links

If it looks like a url, it’s a link.  Too bad if the parser makes a mistake.  But you can create links with labels, and use anchors

[link:label]

[#anchor]

A footnote would look (surprisingly) like a footnote

see footnote [1]

[#1] This is my footnote

Images

Images (and why not, even flash or an HTML canvas if you really want) can be embedded with curly braces.  If a link looks like an image, you could embed it by default.

{embeded url}

Preformatted text and code

This is important, and github’s triple tilde is a good solution, but how about just a triple dash?

—single-line preformatted—


multi-line
prefomatted
text

You could also just use a HTML-like tag

<code>

This is a code block.

</code>

Tables

Why not?  If you’re willing to draw it, render it.  Along with alignment like github markdown uses

+------------+-----------+--------+
| :left      | :center:  | right: |
+============+===========+========+
| the above rows are headers      |
+---------------------------------+
| don't | worry | about | cells   |
+-------+-------+-------+---------+

Number of dashes determines width in ems — or just default to 100% — or something like that.

Do you really need anything else?  Especially because this should be a simple text block.  I’m not sure that embedding images or rendering tables is even called for.

Let me know what you think.

Setting up OpenDNS Family Shield on your router

You can protect your local network from unwanted adult content by changing the DNS nameserver settings on your router to use the OpenDNS FamilyShield DNS servers.  It’s a free service that blocks most adult content at the networking layer.

I have a Linksys WRT-54GL with DD-WRT installed.  Here’s a good video that explains how to set up DNS servers on your DD-WRT.  Add the Family Shield DNS servers under Settings->Basic Settings -> Network Address Server Settings (DHCP) Just make sure the first nameserver in your DD-WRT settings is your router’s IP address (e.g 192.168.0.1)

DD-WRT Family Shield DNS setup

You can also add these DNS settings to your local /etc/resolv.conf on Linux or TCP-IP Settings on Windows.

The IP Addresses of the OpenDNS FamilyShiled nameservers is (in resolv.conf format):

nameserver 208.67.222.123

nameserver 208.67.220.123