Recently I've been on the "I should write a blog post" to "spend 2 hours updating dependencies across 4 language ecosystems in my blog's Bazel monorepo" pipeline. I should still write that blog post though #hypstatic #bazel

On Tuesday, a weekly CI run triggered a Miri failure for a crate I maintain which has some unsafe code. Two days later I had a fix validated, reviewed, and released plus a RustSec advisory published at rustsec.org/advisories/RUSTSEC-2023-0048.html. From advisory being published to the dependabot PR was about 16 hours. #rust #artichoke #security

And proof that this setup is both good and bad – CI failed because I forgot to set the publish timestamp in the post YAML on the previous post. But CI ALSO failed because I forgot to run gazelle. #win #fail #bazel #hypstatic

My artisanally hand-crafted blog generator is an unholy mix of JavaScript, YAML, Markdown, assets distributed by npm package, Golang, Rust, and Python these days, glued together with Starlark in Bazel (deployed to GH Pages) #hypstatic #bazel

I recently published a demo Bazel workspace that shows off many of the rules and tools I use in the monorepo for this website. #hypstatic #bazel #github github.com/lopopolo/bazel_tools_demo

I did my first octopus merge today! #git #artichoke github.com/artichoke/project-infrastructure/commit/45b6926ba3…

Most frequently used commands, redux hyperbo.la/lifestream/560

Just used exiftool and lots of zsh globbing to strip all metadata from JPEGs and PNGs used to build the static hyperbola site. #hypstatic

hyperbola/logo repository was merged into the hyperbola-static monorepo! There is only one repo used to build this site now! #hypstatic #bazel #monorepo

force a rebuild #hypstatic

Woo! hyperbola no longer requires webpack to build. Hundreds of dependencies removed! The build uses eslint for bundling. #webpack #hypstatic

I just removed all pagination from the #hypstatic lifestream section #win this design choice dates all the way back to the first implementation of lifestream in 2010 #history

I've been toying with the idea of removing all pagination from #hypstatic

There is no more #webpack in #artichoke. All web properties have been migrated to esbuild, eta template engine, the Node fs API, and custom build scripts. This is simple, this is good. #hypstatic is next but there is a lot to unwind. #win

with the lopopolo IAM user gone, the only ones left were the IAM users in the #artichoke and #hypstatic GitHub organizations used for terraform CI in the project-infrastructure repos. I used the new GitHub Actions OpenID Connect provider to wire up AWS identity federation following this guide – scalesec.com/blog/identity-federation-for-github-actions-on-aws #security #github #aws #win

With AWS SSO in place, I started using aws-vault locally for #terraform and AWS CLI. I learned about this tool at work. No IAM access keys with inline IAM policies! SSO + assume role for administrator access! #security #win

In #aws things, I migrated both hyperbola and #artichoke infra to separate AWS organizations and set them up with AWS Control Tower's account vending machine. Audit logs! AWS Config! SCPs! AWS Cost and Usage Reports! AWS SSO! #win #security #cost

I'm not sure how long ago this happened, but I got ownership of the @hyperbola handle on #github to match the npm namespace. Some js libs, old infrastructure for dynamic hyperbola, and #hypstatic live there now. I've added a 'project-infrastructure' repo like in Artichoke which does infra as code for the GitHub organization and #aws setup.

I took a hacksaw to my homebrew installation. I'm not sure how this happened but the brewfile I've been carrying around at one point had the entire dependency graph in it rather than the explicitly installed deps ... which made everything on my new Mac an explicitly installed dep. I had hundreds of libs installed for no reason. Burned everything down and started from scratch. #fail #win github.com/lopopolo/dotfiles/blob/fb9af6bd19df2149dba5a63a8db…

macOS things – I tried out alacritty and tmux again but didn't switch away from iTerm2. I tried a bunch of fancy neovim LSP, floating pane, and lua config and then stripped all IDE bits out of vimrc to keep it just an editor. Finally enabled dark mode on my Mac (synced with the sunrise and sunset), switched to dark terminal and neovim color schemes. #win #vim

Another fun #rust update: `intaglio`, my string interning crate, recently got support for C strings (not yet released).

It's been a while since I've posted about #artichoke, but I recently landed a #rust implementation of #ruby's `String` class. #win github.com/artichoke/artichoke/pull/1222

yikes and pagintated navigation for archive pages had month and year mixed up in the link. #hypstatic #fail

ooof. While hacking on the lifestream part of the static site generator, uncovered that previous and next buttons for traversing lifestream permalinks had their polarity swapped. That bug has been there for over a year. #hypstatic #fail

I got a PR in artichoke suggesting to bump down the frequency of dependabot updates to monthly. I applied this change across all artichoke, hyperbola, and lopopolo repositories. It has been a big quality of life improvement and cuts down on a lot of churn in JS dependencies. Applying dep updates once a month is 👍 #win #artichoke

Yay! hyperbo.la is running Bootstrap v5. This upgrade was actually really small! Just some small changes to the Sass for customizing colors and updates to the navbar. #win

Most crates are no-std when possible, 100% documented, and I think pretty high quality. #patch #rust

focaccia and roe are UTF-8 case manipulation crates for implementing parts of `String` and `Symbol` in #artichoke. intaglio is Artichoke's symbol table, boba is an implementation of Bubble Babble Encoding which will be used in the `digest` stdlib package. #rust #patch

Published a few more #rust crates since I last checked in: boba, focaccia, intaglio, and roe. crates.io/crates/boba crates.io/crates/focaccia crates.io/crates/intaglio crates.io/crates/roe #patch

Since cutting hyperbo.la over to GitHub Pages and tearing down most of the AWS infra, monthly AWS costs have been about $1.25. The biggest two items have been ~$0.50 each for S3 and Route53. #aws #cost #hypstatic

This PR also took the opportunity to hand-optimize and hand-make retina variants of all images in the blog and lifestream. This eliminated most of the large asset warnings from #webpack #performance #hypstatic

Sharding the #webpack build meant `webpack-dev-server` was not longer an acceptable choice for a dev server. Replaced this with a #bash script and `python3 -m http.server`

There's some recursion depth error that causes #webpack to abort when using ~1500 `html-webpack-plugin` plugins that I worked around by sharding the webpack build.

In the process nukes 1000s of lines from package-lock.json #hypstatic

Just upgraded hyperbo.la's build pipeline to #webpack 5 #hypstatic

Correctness test that the lifestream handles rendering dates correctly when the week year and year are not the same. twitter.com/fasterthanlime/status/1342967204153876482

As of last night, all hyperbo.la AWS infrastructure is torn down. github.com/hyperbola/hyperbola/pull/111 #aws #terraform #devops #hypstatic

To make this change on dynamic hyperbola would have meant 5-10 Ansible deploys to a Vagrant VM. Iteration speed would have been terrible. #devops #a11y #lighthouse #hypstatic

The static site with local #webpack development environment is already paying off! Google Lighthouse accessibility score for hyperbo.la is now 100 with increased text contrast. #a11y #lighthouse #hypstatic

hyperbola is deployed to GitHub Pages now! Executed via DNS cutover with terraform. Now to destroy the old infrastructure in AWS. #github #hypstatic #aws #terraform #hypstatic

And just like that, dependabot is enabled for hyperbola-static, the WIP lifeastream branch is merged, and the CI is spruced up #hypstatic

There have been over 600 PRs in the last year of Artichoke. hyperbo.la/lifestream/737 github.com/artichoke/artichoke/pull/847 #artichoke #git

This is a setup that has worked well for artichokeruby.org. Set dependabot to autoupdate deps and the "maintenance" has been updating content. Deploys are automatic, regression testing of dep upgrades is automatic. #automation #hypstatic

There is Ansible, Packer, Terraform, JavaScript, Webpack, Python, Django, Ubuntu, nginx, EC2, Route53, ALB, S3. I think I can simplify this to GitHub Actions, GitHub Pages, Node, Webpack, and statically configured DNS with my registrar. #hypstatic

Looking at the commit history for Python hyperbola over the last 3 years shows that it hasn't been developed, only maintained. It is done, but the current repo is expensive to maintain. #hypstatic

Switching to a static site built with webpack at least affords the opportunity to have an integration test that the site compiles. #automation #hypstatic

There is no automated build and no test suite. #automation #hypstatic

Dependency management in Python makes me sad. #fail #python #hypstatic

I've lost my ability to develop locally since I don't want to install VirtualBox on my new laptop. #fail #hypstatic

I run an outdated version of Django. #django #fail #hypstatic

The terraform config for this project is on 0.12 and I have no desire to update it to 0.13. #fail #terraform #automation #hypstatic

I will miss the ease of adding lifestream posts via the Django admin UI, but given that I'm posting elsewhere these days, I don't think I'll miss it too much #hypstatic

Remaining pieces are implementing hashtag browsing pages and the date archive browsing pages #hypstatic

Most of my updates these days are either in the Artichoke Discord or @artichokeruby Twitter #hypstatic

The AWS infra that the current site runs on is $50 a month I do not need to spend. #aws #cost #hypstatic

I've had a work in progress fork of hyperbola to migrate to a static site hosted on GitHub pages for over 6 months. I can't find the time to finish it. #hypstatic

More #artichoke updates since March: a marketing site at artichokeruby.org, prebuilt containers on Docker Hub hub.docker.com/r/artichokeruby/artichoke, and prebuilt nightlies github.com/artichoke/nightly/releases/latest #win

Also Windows Terminal and the Cascadia Code font were a dream to use. I replaced Inconsolata with Cascadia Code on my Mac iTerm2 #terminal #font #windows #win

#vscode and LLDB in VSCode were SO amazing to use. Within a couple of iterations, I was able to track down the use-after-free: github.com/artichoke/artichoke/pull/674 #fail #win #artichoke

After repeated attempts of replicating my windows CI setup in a developer VM, I sloppily installed software via web installers. With every VS component, rustup, RubyInstaller, LLVM, choco, and winflexbison, I was running with a reproducer #artichoke

Once GH-670 was merged, I had a segfault that only (and reliably) reproduced on one test in Windows #artichoke #rust #windows

After 50 PRs, I was able to put GH-442 to bed and remove the Rc wrapper from the Artichoke state github.com/artichoke/artichoke/pull/670 #win This refactor took 4 months #fail #rust #artichoke

Nightly builds of Artichoke are available via ruby-build: rbenv install artichoke-dev #artichoke #win

The one dynamic bit I cannot truly replicate is shortlinks but I never used this feature #win

No more security updates, terraform, autoscaling group rolling deploys, packer and baking AMIs, Ansible deprecation warnings, RDS outages #win I can unsubscribe from nginx release notes listsrv lol

Big wins from switching to static: modifying content with a lightweight dev server, CI via GitHub Actions, automated deploys, better webpack integration and minification, site is free as in beer to operate #win

Partials tended to end up in the same places as before #win

Some bespoke filters I hand rolled before got pushed into dependencies, like hashtag parsing and linking moving to linkifyjs #win #yolo

There is about as much javascript as there is python in the dynamic, django-based hyperbola, which is to say not much #win

It mostly works and is reasonably speedy, although while iterating, a template error in the lifesteam post rendering code caused ~1000 templates to fail compilation. I let the build peg the CPU for 20 minutes before giving up #fail

The static site is based on webpack and webpack-html-plugin with a few preprocessor scripts that emit the templates #webpack #js

I made the mistake of exporting the database first AND not documenting how I transformed it to YAML, so I've been hesitant to post here #fail

for the past 2ish months I've been slowly working on porting hyperbola to a static site with the ultimate goal of winding down an #aws account

I published my first #rust crate (and package of any kind, ever)! rand_mt is a fork of an existing Mersenne Twister crate which adds compatibility with the latest rand_core and makes it no_std crates.io/crates/rand_mt #patch

I contributed a feature to #rust! Added an implementation to allow turning a &mut str into a String using the standard From trait #win #patch github.com/rust-lang/rust/pull/69661

Migrated all #artichoke CI to GitHub Actions #github #win Jobs and workflows are so much easier to reason about. And it's free 💪

I've been absent from the lifestream for a bit. I've been busy implementing!

hyperbola was down for 26 hours because the CA cert bundle on its backing RDS instance was not rotated before the 2015 bundle expired #fail #outage #aws

Pushing errors to the edge and forcing callers to handle them makes for better code #artichoke github.com/artichoke/artichoke/pull/434

Nothing like a little build breakage to start the weekend github.com/artichoke/artichoke/pull/417 #artichoke #fail

Lol following up on hyperbo.la/lifestream/743 ... github.com/artichoke/artichoke/pull/348 disabled most converters to improve compilation times and github.com/artichoke/artichoke/pull/397 added them back behind a feature

#artichoke RubyConf recording here: youtube.com/watch?v=QMni48MBqFw

I missed a couple of months posting! I was working on my RubyConf talk about #artichoke. slides here: artichoke.github.io/rubyconf/2019

Just explicitly shut down the frklft.tires site by doing a terraform destroy. Sad, but that code didn't need to live forever.

I added a feature to rust-bindgen to make a dependency optional to make the build lighter #github #patch github.com/rust-lang/rust-bindgen/pull/1615

Reported a critical bug in rustfmt #fail #github #patch github.com/rust-lang/rustfmt/issues/3770

Also added many more converter implementations with macros. There are 988 TryConvert implementations. #win #fail #artichoke

Led to reporting this #mruby bug: github.com/mruby/mruby/issues/4684 #github #fail although I was able to work around it #artichoke

This change added new functionality: Converting to and from byte and string slices #win #artichoke

The converters are central to #artichoke. Changing this core abstraction was painful: 84 files changed, 2000 lines added, 2800 lines removed. #fail #git

The converters allow the runtime to convert between Rust and Ruby types. They are the glue that the entire Ruby Core and Ruby Standard Library implementation is built upon. #artichoke

I'm separating the core of #artichoke from the #mruby backend specific glue. This step involved reimplementing the converters with the new traits in core.

This was a nasty PR github.com/artichoke/artichoke/pull/242 #artichoke #fail

Some folks have been contributing #Ruby and #Rust code to #artichoke! #win #github

I added a macro to oniguruma to enable it to build on clang for #wasm targets #patch #github #artichoke github.com/kkos/oniguruma/pull/150

I reported an undocumented panic in #rust that was fixed today #patch #win github.com/rust-lang/rust/issues/63456

Reported a build issue on #mruby with gperf 3.1 #ci #build #patch #github #artichoke github.com/mruby/mruby/issues/4628

#artichoke is the top trending repo on all of #github right now #win

I'm trying to improve Regexp performance in #artichoke by using the regex crate instead of oniguruma in some cases. It turns out not to be faster in all cases #patch #rust #fail github.com/rust-lang/regex/issues/604

This was hard to track down: emscripten linker error with a particular function signature #rust #wasm #patch #github #fail github.com/emscripten-core/emscripten/issues/9135

I built an #artichoke #Wasm playground in the browser artichoke.github.io/artichoke #win

That is a lot of code #artichoke #github #patch #win

That is a lot of code #artichoke #github #patch #win

I forked onig and hope to add support for the wasm-unknown-unknown build target. For #artichoke though, it's too soon. Once mruby-sys is pulled into #Rust I'll try again #ruby #mruby #fail #patch #Wasm

Neither mruby-sys nor onig can build with wasm-unknown-unknown or wasm-wasi, so I was stuck with wasm-unknown-emscripten. The linker on mruby-sys would dead code eliminate artichoke_backend::Artichoke #fail #Wasm #artichoke #mruby

One of the goals is to have a #Wasm build target. This is what nerdsniped me this weekend. #artichoke

The biggest accomplishment was redoing the #artichoke README github.com/artichoke/artichoke#readme Thought about project goals and differentiators from MRI. Added milestones to track progress in achieving goals #win #ruby #artichoke

Being forced to set up the repository infra from scratch in cactusref was a good way to fix everything I disliked about my dev environment. CircleCI build and scripts/lint.sh got overhauled #win #artichoke #shell #bash #node #lint

With renewed focus of building my own #Ruby instead of extending #mruby, I put in some effort to make mruby an implementation detail of #artichoke. Lots of refactoring with sed. #fail

ferrocarril had different goals than artichoke: it wanted to run Rails. To do that, it had a lot of extra bits in it like gems, a Rack server, and sample apps. Nuked all of it #win #artichoke

Step 3: create the #artichoke repository where the core #ruby development will take place. #artichoke

Step 2: transfer ownership of ferrocarril to artichoke organization #artichoke #github. Not much to do here, updated some links, fixed some branding, got CircleCI building again #artichoke

CactusRef is still an incredibly unsafe crate, but at least it aborts if it detects a use-after-free #fail #artichoke

Extracting cactusref required completely rewriting #git history, updating docs, adding a build, adding benches, importing my blog post, updating links in the blog post #artichoke

Step 1: extract CactusRef from ferrocarril into its own repository github.com/artichoke/cactusref #artichoke

This weekend I did the migration, which took place in multiple parts #artichoke #github

ferrocarril is all grown up. I've moved development of my #ruby to a dedicated #GitHub organization. The project is called Artichoke github.com/artichoke/artichoke

Every toggle switch in a UI is secretly an Option #design

Matz likes my code omg omg omg #win #ruby #mruby #patch github.com/mruby/mruby/pull/4560#issuecomment-509572113

I’ve been uncovering a few bugs in mruby trying to get ruby/spec to at least run to completion. This bug report fixed an infinite loop that unblocked that #mruby #patch github.com/mruby/mruby/issues/4555

Reported a bug in layout generation for structure with flexible array members to #rust bindgen that was recently fixed #patch github.com/rust-lang/rust-bindgen/issues/1589

Reported an uninitialized memory access to #mruby upstream that was recently fixed #patch github.com/mruby/mruby/issues/4556

That memory leak turned out to be quite the yak shave. setjmp/longjmp from C leaving #rust memory in inconsistent state #fail github.com/artichoke/ferrocarril/pull/168

I had a PR accepted in mruby! #patch #ruby #mruby #win github.com/mruby/mruby/pull/4560

#git bisect is why it's important that your repo be buildable at every commit. Currently fixing a massive memory leak in ferrocarril #fail

Optimized String#scan in ferrocarril to be comparable to CRuby performance #rust #ruby #mruby #performance github.com/artichoke/ferrocarril/pull/138

Added a feature (both a new capability and a compile time feature!) to rust-embed to allow it to embed sources relative to crate root which is useful in workspaces #rust #patch github.com/pyros2097/rust-embed/pull/67

Adding paragraph mode to String#each_line in mruby core #ruby #patch github.com/mruby/mruby/pull/4527

I've proposed a couple of PRs to speed up UTF-8 String handling in mruby github.com/mruby/mruby/pull/4529 github.com/mruby/mruby/pull/4531 #patch #ruby #github

ruby/spec is a set of specifications for the Ruby language shared across implementations. I had a fix accepted to the StringScanner spec! #patch #ruby github.com/ruby/spec/pull/671

I reported a compiler improvement for suggestion diagnostics #rust #patch github.com/rust-lang/rust/issues/61555

I have Regexp#match? github.com/artichoke/ferrocarril/pull/93 #win #rust #ruby

Filed a couple more issues I ran into while working on ferrocarril: github.com/SergioBenitez/Rocket/issues/1019 github.com/rust-onig/rust-onig/issues/102 #patch

It has been a really productive weekend. Merged 23 #github PRs for ferrocarril #win #rust #git github.com/artichoke/ferrocarril/pulls?utf8=✓&q=is:pr+created…

Despite all I talk about #aws #ec2, I cannot for the life of me type isntances correctly #fail

here's another Clippy bug #rust #fail github.com/rust-lang/rust-clippy/issues/4143

#rust Clippy bug reports: github.com/rust-lang/rust-clippy/issues/4139 github.com/rust-lang/rust-clippy/issues/4140

Adding #ci to a project is encouraging such better code hygiene. Because I want to make sure the build stays green, I actually make PRs even if it is only me approving them. Seeing the code in the browser makes it easier to review than #git diff #win

In a related note, I now peg the nightly version in the rust-toolchain file to a specific date archive #ci #rust #win

My #ci builds of ferrocarril caught a bug in rustyline that made compilation fail on the latest nightly #rust #win #patch github.com/kkawakam/rustyline/issues/217

I reported a #segfault in mruby and spoke directly with @matz! #win github.com/mruby/mruby/issues/4460 #patch

Excluding generated and vendored sources, ferrocarril is 8700 lines of #rust, #c, and #ruby. This is a lot of code. In very uncharacteristic fashion for a side project, a big chunk is tests #win github.com/artichoke/ferrocarril/commit/fe2febc

You can tell which parts of ferrocarril are new to me based on how many consecutive commits are dedicated to a feature. By this measure, the new (and hard) things were sys crates, #ci, and TryFrom traits #rust #win #fail

I tried to explain continuous integration to my Dad and he synthesized it as "spellcheck for code" which is pretty good tbh #win #ci

It only took 49 build jobs, but the ferrocarril build is passing on CircleCI circleci.com/gh/artichoke/ferrocarril/47 This is the first time I've ever set up #ci for a side project #win

ferrocarril is a new project I've been working on to embed #ruby on Rails in #rust github.com/artichoke/ferrocarril

The keyword "unsafe" appears 372 times in this codebase #rust

#patch got another PR accepted in the Ansible + ACME + Route53 role I use for the hyperbola dev env load balancer #win github.com/mprahl/ansible-role-lets-encrypt-route-53/pull/15

Using cargo:rerun-if-changed and cargo:rerun-if-env-changed to make most sys crate builds a noop. developer productivity #win #rust

About 6 weeks ago I reached out to two literary agents to see if they'd help me publish a book. I got an explicit rejection last week! A little bit #fail, but also definitely progress #win 😊

I just used #github to create a reproducer case for a panic in a #rust library #win github.com/lopopolo/rust-embed-panic github.com/pyros2097/rust-embed/issues/61 #patch

I generated FFI bindings for mruby with bindgen! I wrote a #c extension library for wrapping mruby macros! #win I wrote (a lot of) unsafe #rust code. Clippy helps a lot to make sure I'm not doing anything stupid. I have caused quite a few #segfault #fail

I implemented a #rust macro for the first time to implement some traits to convert between mruby values and Vec and Option containers #win

I overflowed the compiler (which didn't crash it) and crashed the linter with an ICE #win #fail

I've been working on creating an idiomatic, modern set of #rust bindings for mruby, an embedded #ruby interpreter. I am learning a ton and doing lots of code things I've never done before! #win

I found an ICE (internal compiler error) in clippy in #rust nightly #fail github.com/rust-lang/rust/issues/60067

looks like I didn't finalize the deploy in January so I had a few extra AMIs kicking around that I was needlessly paying for #aws #cost #fail #automation

The true motivation for getting me to mess with hyperbola today was an instance retirement notification from AWS. I had to muck with poetry to cycle my ASG #fail #aws

Uninstalling python 3.7.1 from pyenv broke my local poetry venv for hyperbola which prevented me from managing my deps #fail #python

Yikes haven't done a deploy since January 6. I've definitely been ignoring all of the USNs about Linux kernel vulnerabilities. #fail Django 2.2 release is what got me to get to upgrading #django #win

whoa throwback `chattr +i` to prevent puppet from overwriting files on a prod box that you were manually changing #devops

Deck making for an internal tech talk called "How to Implement the Chromecast Protocol in Rust When You Don't Know Rust" #rust futures and impl trait 😭 #fail

When asking someone to do something via email, the fact that they’ve even opened it is a big hurdle. Make their life easy: in-line as much as you can, minimize clicks, make links easy to scan, be direct, have a tl;dr #communication #email

I'm speaking at Monitorama on June 4-6. My talk is titled The AWS Billing Machine and Optimizing Cloud Costs. #conference #aws #cost

I'm speaking at DevOpsDays Seattle on April 23. My talk is titled The AWS Billing Machine and Optimizing Cloud Costs. #conference #aws #cost

Larson Media Training 101: Answer the question you wish you were asked. #communication

Spaceships don’t come equipped with a rear view mirror 🚀 #win

I live in Seattle now. First week at the Stripe office was quiet due to the snow. Working on expanding Stripe into Latin America.

I have eliminated all explicit casts in punchtop #rust #win github.com/lopopolo/punchtop/commit/1e41ca3

More #rust safety: removed a cast to usize with the new usize::from_be_bytes converter github.com/lopopolo/punchtop/commit/2263c80 #win

#marketing is easier if you have metrics to support your impact. I like to always tie my metrics back to dollars.

One common hangup I've encountered when discussing #marketing my work with other engineers is the notion that the work was easy or trivial to implement. That's not the important part! What the org cares about is impact. Tell a good story!

To be good at #marketing yourself, you need to be good at communication, both written and verbal. Don't be afraid to talk about your work, either to your manager, your skip level, your users, an email list, or the company all hands meeting.

As an engineer, I care very much about #marketing myself, my team, and my work. I am of the impression that my work does not speak for itself, I have to speak for my work. Being high impact means making sure the org knows it, too.

The game that I'm working on is punchtop github.com/lopopolo/punchtop #win #rust #powerhour

Making a mental note that I've decided to go static with hyperbola. Not sure when this project will get done, but here's to 2019. I have dreams of a custom #webpack and #markdown generator, S3 and CloudFront for distribution.

I made a small #rust crate called stream-util for a game I'm working on. github.com/lopopolo/punchtop/tree/master/stream-util allows graceful drains of tokio mpsc channels or canceling a futures Stream. Clippy pedantic and fully documented #win

I implemented a #rust client for the #chromecast protocol for a game I'm working on. I collected a fairly exhaustive set of protocol documentation: github.com/lopopolo/punchtop/tree/master/cast-client

The most expensive part of hyperbola's #aws infrastructure is the SSM PrivateLink endpoint in 3 AZs #fail #cost

First #rust #patch accepted github.com/asomers/futures-locks/pull/10 closing out 2018 with a bang

Optimizing #react bundle ... cut bundle size by 72KB. Biggest wins are turning an image into CSS + an emoji, removing unused deps, enabling mini-css-extract-plugin in release builds #win #webpack index.html is 333 KB

Took 4.5 years but I've finally started to learn #rust: hyperbo.la/lifestream/298. I'm implementing a power hour game that plays to a #chromecast with a #react webview UI.

Been using #ack for almost a decade. Installed #ripgrep today. Wow it's so fast! #win

I've now over-engineered an iTunes library integrity checker by turning a script into a module #win

Just accidentally truncated my .bash_history. Restored from backup but the latest was 55 days ago. #fail

I had a #patch accepted to an Ansible role I use in my Vagrant environment github.com/mprahl/ansible-role-lets-encrypt-route-53/pull/14

I promised a postmortem: hyperbo.la/w/secrets-in-parameter-store-postmortem

I was hard down for ~5min last night while rolling out secrets in parameter store. 0.149.0, 0.149.1, 0.149.2, and 0.149.3 were bad releases #fail. 0.149.4 is stable: github.com/hyperbola/hyperbola/compare/v0.148.0...v0.149.4. Postmortem pending.

41-commit weekend 🤩Feel much better about my #webpack , #ansible, and #packer code #win

The computers did exactly what I told them to do 😕 #fail

Add in some manual #terraform state edits and deleting things in the #aws console and we're recovered #fail #win

At least I was able to repro in local #vagrant once I figured out what was going on. #win

A red herring was adding a call to dd in the cleanup script to zero the free space on the disk. I thought I was somehow filling the disk and not reclaiming space.

The cleanup script didn't error because my set flags were in the shebang but #packer was invoking the script via bash instead of directly #fail So many yaks.

This change was introduced in 0.146.0 but did not manifest due to a bug in the cleanup script. I was not passing -y to apt autoremove, which caused the command to abort and end the script with an error. #fail

Removing just the dev package with #ansible #provisioning had no effect in local env, but combined with the apt purge in the #packer script, uninstalled mysqlclient

Root cause: My app depends on the python package mysqlclient, which in turn depends on the libmysqlclient system package. I was pulling this in transitively via the dev package required for building.

Undeployable manifested as healthz returning 502 when adding a new instance to the ALB, marking it as unhealthy and timing out #terraform

I recently started cleaning up after myself during #provisioning. There are two steps to this: #ansible uninstalls build deps and #packer executes a cleanup script that does an apt purge and autoremove

Got into an undeployable state due to differences in #provisioning between local and prod environments #fail github.com/hyperbola/hyperbola/commit/a914992

I completed removing build artifacts from source control. Static assets dist and document-root dirs: replaced with running #webpack on host. Third-party #ansible roles: installed from galaxy via #packer and #vagrant at provision time. #win

code yellow 😕

That was a 35-commit weekend. New features and improved code quality. #win github.com/hyperbola/hyperbola/compare/918f6d0f..4c331eee

Significantly refactored my #webpack static asset pipeline today. No longer build assets locally and check them in. Build happens as part of #ansible provisioning. #win github.com/hyperbola/hyperbola/commit/eaf5b3197

I added code block and syntax highlighting to my new #blog. Planning on using it for an upcoming post about #terraform.

#django is a joy to use. Making my new blog app was so easy. Each view is only two lines of code! #win

I accidentally skipped v0.139.0 today because prettier barfed during cutting the release and I forgot to reset my git tree. I guess I forgot to run prettier on my whole repo when I enabled it. #fail

I made a post on how your org chart shows up in your infrastructure: hyperbo.la/w/aws-org-chart #blog

I made a post on Prosperity's partnership with Finance: hyperbo.la/w/engineering-finance-partnership #blog

Further #cost optimized my #AWS infra. Saved $3/month by turning off CloudWatch monitoring and making my ASG out of spot instances github.com/hyperbola/hyperbola/commit/ffa0e34 #win

I had a #patch accepted to gunicorn github.com/benoitc/gunicorn/pull/1889

Jumped to latest #django 2.0.x and then to latest 2.1.x today. No deprecation warnings, smooth sailing. As a plus, I turned on PYTHONWARNINGS for my app in systemd #win

#AWS suggested for us to use a snowball to ship our data to a new region. This is an amazing product, but yea no

That was easy! hyperbola running on t3s now. #aws #terraform #win

docker lessons: github.com/hyperbola/hyperbola/pull/94

I also pruned a lot of config from my 12factor env, favoring convention for things like DB connection strings. In doing so, migrated to one hostname for DB across all environments. /etc/hosts alias in Vagrant, network in Docker, private hosted zone in AWS

Finally deployed a 2 month old branch incorporating lessons learned from my Docker experiment into my VM-based deploys. Big change is building from local source instead of pulling in a tarball from GitHub. Iteration speed is improved #win

One hack I've been using to enhance my productivity in the face of KTLO work is to write lots of things down. Project plans, system diagrams, user interviews. It helps organize the work that I have done and keeps me motivated.

The past 4ish months I've been a team of one. Been a decent slog. It's been hard to be productive when all of the KTLO work falls on me. Getting a new teammate in a couple weeks. Excited. 🤩

I've been retraining myself to say "Hey Google" instead of "OK Google"

I published a post about AWS Reserved Instances today stripe.com/blog/aws-reserved-instances

Optimizing for #cost and complexity, #docker and ECS/EKS are not worth it for my 1 node crud app

github.com/hyperbola/hyperbola/commit/5c36137, github.com/hyperbola/hyperbola/commit/fcd007c #HA

Saved me $17 a month. My primary #AWS #cost is now my ALB. I'd replace it with an nginx if not for ACM making certs so easy

Modified RDS to be single-AZ #HA

Set desired backend ASG capacity to 1, but added autoscaling alarms to allow scaling up to 3 instances #HA

Realized that hyperbola doesn't need to be super #HA

Last week I tried to build hyperbola with #docker. I ended up with 5 containers to deploy a stage environment. github.com/hyperbola/hyperbola/pull/92

hyperbola is ready for #django 2.1. github.com/hyperbola/hyperbola/commit/d92a79f. That was easy #win

LuaLaTeX is amazing. My documents look better than they did with XeLaTeX. Less hyphenation, less inter-section spacing. fontspec, polyglossia, selnolig, nowidow, and impnattypo packages are dope too. #LaTeX #win

The Makefile for a project like this defines two versions of all the tasks. One runs locally on my mac and "recursively" calls make using `vagrant ssh` setting a make var to indicate the task is running in the VM #make #LaTeX

I've been using make and vagrant for self-contained builds in other projects. I've been working with #LaTeX a lot and a bionic vm with TexLive installed creates a repeatable build env, takes 15 minutes to set up, and doesn't pollute my desktop #win

Upgrades are painful, so upgrade frequently. hyperbola now running Ubuntu 18.04 Bionic. 2 build config changes and 1 removed ansible task. #win

Switched from community PPA to official nginx-provided binaries. That was ... really easy: github.com/hyperbola/hyperbola/commit/5461837 #win #ansible

I am surprised that #django autolinked the .tires domain. We live in the future.

for frklft.tires, I stopped using #terraform for managing the static content of the site. It now lives outside of my terraform code in a public directory, published explicitly with a make target #win

I launched frklft.tires last week. Built with S3, CloudFront, and Lambda.

My current understanding of this column is that it is the instance family if the usage type is eligible for RI instance size flexibility

What they neglect to mention is that DedicatedUsage types do not have an instance family associated with them

AWS says that product/instanceTypeFamily is "The instance family that is associated with the given usage. For example, t2 or m4."

Sometimes using the #AWS cost and usage reports is just not fun, mostly due to the myriad of columns being undocumented. #fail

hyperbo.la/lifestream/347 was an anti-pattern which got fixed when I moved to pipenv

When all you have is a rock, everything looks like a hammer

This is a great article: rachelbythebay.com/w/2018/02/26/frame

Last week I shipped secondary attribution for Jenkins builds. Email featured lyrics from Bills, Bills, Bills by Destiny's Child #win

pandas and jupyter notebooks are my new favorite hammers

Semantic versioning is a lie (looking at you #packer). My config stopped working because a key was deprecated between 1.1.x and 1.2.x. Somehow this prevented the config from validating. #fail

So it turns out I shouldn't have ignored that MySQL backtrace when printing the help text of my new django management command in dev. That's why it hung when building the AMI. #fail One line fix: github.com/hyperbola/hyperbola/commit/728f1d68

I have pinned dependencies everywhere _except_ my AMI build pipeline. Bitten by the packer 1.2.0 upgrade breaking the ansible-local provisioner. #fail

it looks like prod peaks at 75 req/s #performance

Not to mention Let's Encrypt to Amazon back to Let's Encrypt again (for vagrant) for certs

I've had significant churn on tools in the past year for building hyperbola: pip to pip-tools to pipenv. gulp to webpack. linode to AWS. bespoke deployment and scripts to ansible. All good, just exhasuting.

vagrant-lb PR: github.com/hyperbola/hyperbola/pull/86

Ansible, Let's Encrypt, nginx, and Vagrant have combined to make my local env look more like prod. Spun up a new ALB-like VM with HTTPS. less divergence #win

Starting 2018 off right by fixing pbr installation, deploying django 2.0.1, upgrading Pillow, and removing dep on django-localflavor #win

Baby's first hadoop. Taken from long forgotten code written in 2005 #history

Removed some "bespokeness" from hyperbola: migrated from a shell script that exported env vars and exec'd to dotenv. Same concept, but now a standard mechanism #win

Put some investment into my #vagrant setup. MySQL running in a separate VM with automatically provisioned fixtures means I can go from zero to full replica of prod in 10 minutes. No more dep on laptop MySQL. #win

New in v0.122.0: python packaging actually works now. No .pth symlinks. No PYTHONPATH. setup.py and pbr install hyperbola directly into the venv. Finally. #win

hyperbola is now running #django 2.0. Added automigrate to hyperbola-app systemd unit, eliminating one of the last things I ever needed a bastion host for #win

Found a lifestream bug during my Django 2.0 upgrade that was never exercised on the live site because I've never had more than 40 posts in a month #fail

I suspect that NTP traffic was the trickle of traffic that traversed my recently decomissioned NAT

That was easy. Enabled #AWS Time Sync by adding one ansible role, reading some docs, and redeploying. #win

Accidentally deleted my private subnet route tables in the process though, which broke S3 access for ~20 minutes. Could've been much worse #fail #outage

Shaved another $35 (40%) off my #AWS bill by disabling the NAT on my app subnets. Yay immutable infrastructure and VPC endpoints #win

I made a thing! burnfastburnbright.com Bootstrap 4, route53 domains, and terraform made this really easy. went from 0 to 100 in about 1.5 hours. #win

New in v0.117.0: nuked time-elements webcomponents due to Firefox breakage (cut js payload by a factor of 4), infra improvements to resume handling #win

The v0.116.0 deploy was done using a spot instance with packer. A bigger instance for half the price #aws

New features in v0.116.0: bootstrap4, removed RSS and Atom feeds, 100% webpack frontend build, css purification improvements, and healthz middleware

Most frequently used commands, redux hyperbo.la/lifestream/146

LOL that was only six years ago ... don't let your dreams stay dreams: hyperbo.la/lifestream/51 #aws

welp that didn't last long. CloudFlare only queries a subset of NS records to check for liveness and has determined that I no longer use CloudFlare. Working on purging them from #terraform and registrar now #fail

It is a good thing that I've automated things well enough that I don't need the bastion #win

Even more cost savings: dynamically provisioned bastion cloudformation stack #terraform #aws

More cost savings. RAM footprint of a hyperbola backend is 143MB. Switch from t2.micro to t2.nano #aws #win

I accidentally created a CNAME (instead of an A record) for an IP today. Lots of confusing errors from nslookup, ssh, and host. Meanwhile dig appeared to resolve the record. #fail

hyperbola: now with multi-homed DNS. AWS Route 53 and CloudFlare, made possible by terraform. (In the process upgraded hyperbo.la mail to a 2048-bit DKIM key) #win #redundancy #devops

I accomplished this migration with ~no downtime #win. I spun up the new infrastructure and then deployed new AMIs with updated service records. I did have ~2 minutes of 500s when I accidentally overwrote old mysql DNS record due to a bad copypasta #fail

Switch from 3 to 2 backend machines. 1 is enough to handle the load I get, so use the bare minimum for redundancy #aws

Removed dependency on redis by switching to a django-provided database-as-cache adapter. My redis cluster was used only for admin sessions and caching a sidebar on the lifestream page. Unnecessary overhead #aws

Switched DB instance type from db.t2.small to db.t2.micro. From running my linode I know that MySQL never used more than ~400MB of RAM so I knew this was safe. My database is tiny #aws

Switched from Aurora to a multi-az RDS instance. I don't need the complex topologies that aurora allows and it forced me to use an overprovisioned instance type #aws

Now that I've shown I can go all out with the most expensive #AWS components, today I exercised my cost efficiency and right sizing muscles. I cut my AWS bill in half with the following steps:

3 AZs I feel so alive #aws

Just bumped backend ASG from 1 -> 3 t2.micros. With this change now all parts of hyperbola (redis, mysql, backend, lb) are multi-AZ #win

mysql_tzinfo_to_sql /usr/share/zoneinfo | mysql -u root mysql was the magic incantation required to get lifestream archive views working locally

Today's shipped email featuring subtly modified lyrics from Kanye's Flashing Lights

The magic command to make homebrew work after uninstalling Xcode: sudo xcode-select -switch /Library/Developer/CommandLineTools #win

this is just one example of the times #git has saved my life #win

#history throwback to the time that my wiki was spammed by a bot that turned all the pages into link spam for discount pharmaceuticals github.com/hyperbola/hyperbola/commit/1a3725b84bf82982945f68d… #fail

I've taken to opening shipped emails with playfully mutated rap lyrics. Super Nintendo. #win

Total upgrade time ~1 hour. Includes code changes, testing locally, cut release, deploy to vagrant, build AMI, terraform, smoke test #win

I skipped #django 1.11.4 and 1.11.5. Finally did an upgrade today to 1.11.6 #win. My dep upgrades for python, js, and ansible deps are too coarse grained. Pulled in ansible changes which blocked the deployment #fail

and no more chrome on iOS. Using safari there. The only value chrome brings is unified history and being logged in to my google account. I use neither of these features

I switched to Firefox Developer Edition today on my mac. It is pretty blazing fast. Looking forward to 58 making it to the dev channel in November

With @huff's help, I have discovered ETL's True Name. ETL is just indexes. Indexes are just caching. Caching is just named replication. Names are the only problem in computer science.

When sorting cards in a hand, I use multi-pass bubble sort #fail n is small i guess

#terraform is now a package manager. Great. #fail. For some reason plugin downloads hang if the download gets an IPV6 edge node in their CDN.

thinking of removing dependency on #cloudflare. currently only used for hyperbo.la DNS. Email records are the scary part. #terraform makes this mostly easy

I was first introduced to closures in summer '08 via #ruby blocks. This was probably the most magical moment I've ever experienced programming. That code was just another object you could pass around was amazing. Lisp would've been mind blowing. #history

when reading from stdin, ansible-vault encrypt_string does not trim trailing newlines, forcing one to use echo -n. #ansible knows this is a sharp edge and documents it, but they should do the right thing and make it consistent with password files #fail

in the quest to thin out the top-level directory sprawl in hyperbola, I got rid of .secrets. required rotating ansible vault password and rekeying everything because my password had single quotes, double quotes, and backticks (of course) #fail

#fail do not try to install ansible in a virtualenv in packer. you need a compiler. you don't want a compiler

the hyperbola + hyperbola-tools binary star monorepos is a common failure state, so I am told #fail

I just realized that by merging hyperbola-tools into hyperbola and converting my ad hoc ruby scripts to python, I moved to a monorepo and standardized on a language

6. addendum: since I already had a deploy script, it was straightforward to translate it to #ansible tasks

6. problem: bespoke deployment steps. deploy and cron run as lopopolo. deploy needs sudo password. solution: #ansible deploy_helper module

5. problem: environment names are inconsistent across tooling and deployment. solution: hyperbola_environment #ansible variable which parameterizes everything

4. addendum: I used #LetsEncrypt before migrating to AWS with a combination of cron, systemd timers, and dehydrated. ACM is easier, less error prone, and set-it-and-forget-it #win

4. problem: https is hard. solution: ACM + #terraform + ALB + CloudFront

3. problem: manual, bespoke server configuration. solution: #ansible, #vagrant, #packer, prebaked AMIs. immutable infrastructure

2. django-backup.py sucks. problems: email based, backup size is limited, unconfirmed delivery, plaintext transmission. solution: move media to versioned S3 bucket, daily RDS snapshots, logical backup json to S3

1. problem: python not running the latest 2.7.x release. solution: pyenv for local development and xenial (python3.5) + ansible + (future) deadsnakes ppa

I found a page in my wiki called hyperbola suckage 2015. This was a forward-looking list of gripes to fix as I moved from hyperbola1 to a new host #history

unexpectedly memory: I had to spoof my mac address to that of my xbox 360 so that I could register it on MIT's network #history

DNS is flipped and propagated! Live in #aws! #win

#aurora was much less forgiving with unique constraints than mysql. The schema for one of my utf8mb4 varchars had a max length of 255 and a unique index. It appears mysql silently truncates, whereas aurora complained the index was > 767 bytes. ~ #win

One source of difficulty was getting django, s3, vpc endpoints, and security groups to work together to enable s3 access from my backends #fail

my #terraform life became much easier by using name_prefix instead of name. name and name_prefix parameters were never interpolated. Instead, use interpolation in tags. In practice this means config can change without rebuilding the world #win

I initially went with the unclustered variants of elasticache and rds. Once I wrapped my head around the topology, #redis cluster mode and #aurora were much easier to work with in #terraform

buliding the #aws infra took about 30 commits, two #terraform destroys, and two terraform code rewrites. some fun bits in the following posts

The migration from a bespoke-bootstrapped, manual (scripted) deploy process to an #ansible playbook took about 20 commits. I deployed to a local #vagrant box first

And with post 506, I can now say that hyperbola is hosted on #aws #win

2am hot take: all systems problems are best solved with pointers and routing. aka dependency and service injection

The #webpack configuration, on the other hand, was not fun to get set up. I particularly struggled fighting with the gulp plugin, which pins webpack 1.x

#webpack is amazing. I added the time-elements web components to the lifestream and contact pages. Only took an hour. Before this would have been next to impossible. #frontend #win

Rebuilt everything and modulo some zombie deposed resources, everything is good again

Discovered I had duplicate stanzas in my tfvars file. Removed the extraneous one. Broke EVERYTHING. #fail The worst was my admin IAM account losing access in the midst of a terraform apply. destroyed module.network, module.iam, and module.hyperbola-wiki

Converted wiki from ELB to ALB this morning ... took a couple of hours. modified #terraform config and updated #ansible ... also converted from Let's Encrypt to ACM. github.com/hyperbola/hyperbola-tools/commit/23fb9a7 #win

💯💯💯💯💯 = 500 posts #win

related, using pip-tools to manage and pin python dependencies has removed uncertainty from my deploy process. Upgrade packages only when I intend to #win #django 1.11.3 upgrade went super smoothly in part due to this

this is why #AWS

2 minutes of #downtime for libc security upgrade ubuntu.com/usn/usn-3323-1

OMG just rewrote my #git PS1 which runs as part of my PROMPT_COMMAND. Now 20% faster both inside and outside a repo. terminal feels so much faster now #win #performance github.com/lopopolo/dotfiles/commit/2d5054c4ce

tried copying a 2TB Time Machine volume at the file system level using Finder drag and drop. #fail sadtimes. Was going on 6 hours and still resolving hard links. Currently attempting block-level copy with Disk Utility

I am living the dream with an n/ac-only network

Packer + Ansible + AWS + Terraform is really quite lovely #devops #win

I hope my next laptop has 32GB of RAM

I got a memory exhaustion pop up on my MBP earlier. I blame spotify, chrome, and the 2 VMs I carelessly had running. #fail

Migrated terraform state from a private github repo to a private, encrypted S3 bucket. State infra is bulkheaded from main app and protected with prevent_destroy lifecycle #win #terraform #aws

and the #monitoring even triggered when I took the box down. #win

All done. Downgraded from 8GB of RAM to a more reasonable 2GB of RAM. Went from 4 cores down to one though 😱 #devops #maintenance

It looks like I am a *tad* overprovisioned. brb taking some #downtime to downsize my VM

Also, I have a google analytics snippet on the site. I have never once checked the analytics.

Moving the wiki to #AWS was a different beast. Everything is self-contained in the AMI.

sure an ELB + managed MySQL & redis + redundant frontends are "better" but I'm not sure I need the complexity

Not sure if it is worth the effort to migrate hyperbola to #AWS. Maintenance burden is pretty low. Log in maybe once a month, run an apt upgrade, and do a fresh deploy. Takes less time than a packer/terraform cycle would. #maintenance

Code that is organized in pipelines is easier to grok than code that is organized in trees #functionalprogramming

Upgraded to #django 1.11 ... woo LTS

Tested a #django release candidate (1.11RC1) for the first time. Site continues to work. No deprecation warnings. #win

Software shouldn't be "delightful." It should be invisible.

I would not be surprised if #AWS VPC networks were all running some franken overlay protocol

Today I learned about octopus merges #git marc.info/?l=linux-kernel&m=139033182525831

ELB for wiki does a basic healthcheck of nginx, but a backend can be down while the ELB thinks the node is healthy #monitoring

Added liveness monitoring of healthz endpoints on wiki and hyperbo.la today #monitoring #devops #win healthz goes all the way through to rack/django

Media backups have been failing since I moved the site to the new server. I've been uploading empty, corrupted tarballs. #fail fix here: github.com/hyperbola/hyperbola/commit/859128 Thank you gitlab & national check your backups day

Immutable infrastructure is so much better than mutable infrastructure. Much more satisfying to build a new image and redeploy than to upgrade nginx and mysql in place, taking #downtime.

youtube.com/watch?v=oyLBGkS5ICk

Found this in the nginx logs of my wiki in ec2. hackers. #security

#django feature request and #patch accepted code.djangoproject.com/ticket/27541

Just freed up 350MB in my gmail by purging 35 emails. Did a search for size:5000000. removed emails with mp3s as attachments and event announcements with large images and pdfs #win

bastion is now in an ASG with an automatically bound (with user data) elastic IP. Yay fault-tolerant infra! #win #aws #terraform

Hit the 5 duplicate certs per week rate limit from let's encrypt by repeatedly rebuilding my vagrant box #fail

Yay refactoring! #python #django #win

Switched to building an ami with packer. Now an ASG roll takes 2 minutes #win #aws

Deployed hyperbola-wiki. Initial approach was to provision on boot with a user data script. This caused instances to take 15 minutes to come up (apt-get upgrade, compiling ruby) #fail

Provisioned a VPC, subnets in 3 AZs, and a bastion host #aws

Created an #aws account tonight

hyperbola-wiki is now fully deployed using #ansible. #vagrant made testing easy. #win

Added middleware to hyperbola app and wiki to inject a comment with the canonical hostname of the host that rendered the request. Debugging #win

Now have proper retina image support on lifestream and contact page. Generating @2x and @3x images. The flexibility of django-imagekit helped. This is a well-designed library. #django #ux

hyperbola, now with properly localized dates using window.Intl #win

Fourth most expensive query is selecting all lifestream items and pictures: a LEFT OUTER JOIN with ORDER BY DESC, LIMIT, and OFFSET. There is an index on the order by but MySQL prefers filesort. Table is only 500 rows though. #mysql

Most expensive queries on hyperbola are hashtag lookups because they use RLIKE. Top 3 queries are 4.3ms, 3.2ms, 2.1ms per query. #mysql

mucking around in settings.py I ended up doing a top-level import from debug_toolbar. Yay for staging. #fail github.com/hyperbola/hyperbola/commit/26c4e1d

diff of yesterday's backups and current backup confirm all that has been altered are filenames

I didn't notice this in dev because the front page of the lifestream is 20 of the same picture of Kendrick Lamar #fail

Fixing this required parsing a db dump (django fixtures much easier to read than mysqldump output) and manually running UPDATE queries in MySQL

Minor crisis when running the mangle media script. Resume and lifestream models have auto_now=True (an updated timestamp) and I have been using them as creation timestamps. Apparently there is an auto_now_add param I should use. #fail

just automated a spreadsheet (concatenating several columns) with filter #win filter(L6:L, L6:L<>"") vs manually updating ranges #automation

DOMContentLoaded in less than 200ms on lifestream index #performance #cdn

Enabled cloudflare cdn on hyperbolacdn.com today. Took 4 clicks. #win

Some changes since moving to the new host: assets and user uploads served off of hyperbolacdn.com; TLS; frontend deps managed with bower

hyperbo.la staging and production are TLS enabled. Still have to turn on HSTS. #win #letsencrypt

❤️ Emoji: 🔥🔥🔥

Successfully migrated hyperbo.la and staging.hyperbo.la to a new host, hyperbola3. Ubuntu 16.04 and 8GB of RAM. Just shut down hyperbola1. #win

Did my first #aws prod deploy today #win

reifying #aws infrastructure with terraform is pretty cool. power is scary though. yay for sandboxes!

I need to make these out of band releases more painful so I migrate hyperbola to my new host #fail

I started a new job a couple weeks ago. I'm working at #Citadel.

#throwback #cruft just cleared out MIT client certs from 4 years ago that were hanging around in my keychain

Also found the samba password to the file server named supersecret that I built

All this discovered while clearing out my OS X Keychain

That was when hyperbo.la ran on a reclaimed Dell workstation in a network closet at MIT

I think I also used to host a redmine instance on dev.hyperbo.la back in the day ~2010

#throwback dev.hyperbo.la:80 hyperbo.la subversion repositories

successfully did an out of band release not of master while in the process of migrating hyperbola to a new host #win #deployment #automation

Forgot to blog about this: My printer ran out of toner a week before my move. Had the printer since 2010. RIP printer

With systemd I am one step closer to #12factor app bliss since all service logs get logged to syslog #win

made the #nginx config a little better, converted thin to bind to a domain socket, and deployed with a dedicated app user with deploy keys #win

In the process, I've added #TLS with Let's Encrypt #win

The past few days have been spent migrating my #gollum wiki from hyperbola1 (old server) to hyperbola2 (new server)

And a 4 years newer OS (Ubuntu 16.04 LTS) and 64-bit #win

Project new VPS is underway. For the same price as my current 1G box, I'm getting a 4G box with more cores #win

nginx upgrade broke the init script. had to reboot to fix things. gunicorn failed to start after reboot due to log file perms #fail

I love linters #js #css #python

hahahahaha #fail Daemons in macruby #ruby

I enjoy golfing my minified javascript. Just shaved 19 bytes off of the inlined date formatter js I include on the lifestream page #js #win

The only times I have ever run ant as a build tool were a couple of CS classes back at MIT—4 years ago. Even today, it remains my 8th most frequently used command on my mac

Filed a site issue JIRA on my last day. It was eventually closed as invalid. By the time this happened, though, I had lost systems access and couldn't discuss it further

Today was the day of linters. Added eslint, flake8 config, and isort to hyperbola

"we successfully avoided a split brain scenario due to master/master replication" #mysql #fail

hyperbola prod is now running #py3 what a time to be alive

#scala takes the #objc std lib approach to collections: One public interface/factory w/ many optimized implementations underneath

My ruby version on my mac stopped working because homebrew updated libicu. Had to recompile/upgrade #fail

Today I upgraded node to 4.3.2 (from 4.2.2), python to 3.5.1 (from 2.7.3), and django to 1.9.4 (from 1.8.8). What fun! #win

Hyperbola staging now running python 3.5.1 #py3

Someone forked my senior thesis ... what? github.com/nmoutana/sr

I use #node in my asset build pipeline. I compile js and css with yuglify. Today I productionized my node install. Upgraded to latest LTS and added docs for upgrading node

This new #django admin UI is BEAUTIFUL!

Finally got around to getting my #django 1.9 upgrade branch over the line. Didn't have django-pipeline pinned and 1.6 introduced a breaking change to settings. All done now.

Yelp's search stemming needs some work. I searched for "used" and it is highlighting "us" in the search results. #fail

When I see L7 I think of the band instead of the OSI Model #fail

~.

Reading about the LMAX Disruptor martinfowler.com/articles/lmax.html ... pretty cool. I've seen similar patterns (at lower optimization levels) at Box.

Caught an issue in staging today because staging is more like prod than dev is. Dev has pipeline disabled. Yay for release process. Yay for testing. #win

python -Wall is a neat trick. Cleaned up a bunch of #django deprecation warnings

Time to switch to using the #python SDK! In the meantime, no new media uploads

Media directory backups have been failing since the 17th due to exceeding max attachment size. No alerts. #fail >>> SIZE=55759470 <<< 552 5.3.4 Message size exceeds fixed limit

Switching from yui-compressor to yuglify saved me 1KB on bootstrap.js and 30 bytes on bootstrap+hyperbola css #performance

With this latest release, hyperbola has surpassed 500 commits! #win github.com/hyperbola/hyperbola/tree/2015-11-21-lifestream-tem…

lifestream template refactor didn't yield any #performance wins, but the code is much cleaner now. #win

Front page warm nginx latency is 12ms; contact page is 20ms #performance

Current prod gunicorn time (measured at nginx) for the lifestream index page is 70ms with no partial caching and 40ms with the sidebar cached #performance

Tested rendering the lifestream index with all 3 interpreters. pypy is slower than python2.7 by 2x. python3.5 is faster than python2.7 by 2x. #performance

Local development lets me run cool experiments. I have python2.7, python3.5, and pypy virtualenvs.

Sped up the lifestream page by 30ms by caching the archive sidebar. More template speedups to be had by switching to python3 (str to unicode coercion in python2) #win #performance

Woo! I can run hyperbola on my mac. Local development! #win

Even better: precompiling app/hyperbola to pyc and getting to keep the deployment read-only. better #win

gunicorn workers get warm quicker now that I've allowed gunicorn write access to a deployment's app and virtualenv dirs #win

Root fs usage is down to 3.5G.

Finally started cleaning old deployments. After each deploy, my deploy script removes all but the latest 5 deployments for a given env. hyperbo.la/lifestream/352 can rest peacefully.

90mbps upload to Box from the corporate network is pretty nice when backing up my photos (all 25GB of them).

OG status: github.com/hyperbola/hyperbola/tree/og-hyperbola-v1

Did some archeology today to unearth an ancient version of hyperbo.la. Same color scheme as today. Yes, there was an assets domain. Had to do forensic analysis to reconstruct the index.html.

It continually amazes me at how much conflict is solved with "assume good intent."

Added a post-commit hook to my gollum wiki today to do a pull/push. Changes instantly synced to #github. No more stupid 5-minutely cron. #win

I feel like my #django site is futureproofed for at least the next two minor version upgrades now. Just converted a ton of render_to_response snippets to the new render hotness. Even feels faster.

Despite being stable, #django deprecates frequently. What they deprecate tends to have been the recommended way of doing it circa 1.4 ... feels like they are slowly rewriting everything.

15 commit night on hyperbola, 5 on hyperbola-tools, and 12 on my dotfiles. Mostly code and style cleanups, some correctness fixes.

Having a linter is so awesome. IntelliJ rocks. #win

Next major project is migrating to a new VM. 32-bit Ubuntu 12.04 is getting long in the tooth. I have eyes on 64-bit #Debian 8 and a shiny new #linode with 2GB of RAM

Last bits of major feature work were bootstrapifying several pages and adding automatic deployment (June 2014)

Just realized that hyperbo.la has been in maintenance mode for a while. Last few projects: upgrade to django 1.8, upgrade to django 1.7, upgrade vendored dependencies (bootstrap, retinajs).

#puppet is more fun when you know what you're doing.

I bought IntelliJ Ultimate and it has already been decently valuable: github.com/hyperbola/hyperbola/pull/28 ... fixing lots of warnings #win

It only took a debian VM and 4 hours of my time to reformat two new USB keys. #fail

Fixed a long outstanding bug in how the sidebar on the lifestream calculated monthly post counts #win Tickled by the upgrade to #django 1.8 which caused them to all display as 1. #fail

Finally upgraded to #django 1.8. Only an 8 commit adventure

Wondering why the response to some external asks isn't, "No, we're not ready yet."

Wow! usability fail. The crontab command operates in 3 modes, two of which are edit (-e) and remove (-r). Lovely that e and r are right next to each other on a QWERTY keyboard. #fail

This oncall cycle, I observed my first real hardware failure. A machine critical to the deployment pipeline spontaneously shutdown and failed to reboot, problems with mounting RAID, etc. #fail

We are loading the racks onto trucks and moving them to a real datacenter. Bye bye servers.

Responding "maybe" to a calendar invite is the equivalent of the SF "we should do lunch"

I want to live in a world where booting a machine doesn't cause config propagation to break #fail ghetto consensus algorithms

The only things that are truly unique in a relational DB are auto inc pks. Even uniques such as username may be duplicated across time.

I feel dirty doing pointer dereferences in #golang

One of the tools I've learned when writing #golang is how to coalesce errors behind an API boundary. Makes for cleaner code.

./unixtools gzcat ~/Desktop/f.gz.gz | ./unixtools gzip -d - ... having fun implementing parts of busybox using #golang. So far I've got gzcat, gzip, and yes

#quora ahh yes ... database systems

Services team get rekt #oncall pages from 9pm Friday to 8am Saturday ... something about the corp dc migration

So this is what a real oncall rotation feels like. So many things.

whoaaaaaaa ... an unsaved txt file from my work laptop showed up on my personal laptop. #cloud

This week at work I settled on a secret delivery mechanism that bootstraps with #kubernetes (or puppet if a service isn't containerized)

Just spent 5 minutes hopping through man pages trying to grok a script I wrote a while ago only to realize there were comments explaining exactly what was going on #fail #docs

took 1minute of downtime today for a #mysql 5.5 upgrade from ubuntu

still hanging around: 4GB of old staging installs and 2GB of old prod installs

Just did some disk usage cleanup on hyperbola. Had 4 old ruby installs hanging out (2GB), a 700MB gunicorn logfile that was being written to every second, and a very full apt cache (1GB)

even with a staging env, deploys still require a site check

I love Apple's "quit unexpectedly" euphemism for crash

... and I'm no longer dumping secrets to stdout due to `source` and `set -x` #12factor #fail

On the plus side my build script now dumps metadata about installed python packages to disk so I have one place to look instead of wondering

Finally subscribed to django-announce. I was running a super old version of 1.7 ... oops #django

Recently restructured my #dotfiles and added a Makefile so they don't live in $HOME (git clean terrifies me) #git

Playing with some JSON data and jQuery ... created a rudimentary VX points trip planner #javascript

ncbi.nlm.nih.gov/pmc/articles/PMC1311997/pdf/jaba00061-0143a.pdf

I don't like structured identifiers because they presume data fits into a hierarchy

Borg paper was a fun read. Kubernetes is really exciting.

feast or famine on the hyperbola microblog

TIL: Selecting 2 cells and then dragging to repeat causes google sheets to infer the increment #win

#ruby Fixnum is a weird beast. A class that doesn't have new.

chrome has #emoji now. such web. #win

A good chunk of my qualms about #scala is complexity resulting from laziness tricks.

sudo lsof | grep libssl | cut -d" " -f1 | sort | uniq -c | sort -rn #fail mta.openssl.org/pipermail/openssl-announce/2015-March/000020.…

Healed my first master-master data drift today #devops #mysql

#bug fixed github.com/hyperbola/hyperbola/commit/01b34d with minor staging break caused by django-pipeline renaming their templatetags #django

#bug: page links do not appear on #hashtag pages

Upcoming Xen vuln was the forcing function to get my gunicorn upstart scripts able to work after a reboot. There is some nasty in them github.com/hyperbola/hyperbola-tools/commit/8e5c4 #bash

This is how you get a macbook to page like crazy #fail

OMG #ruby is using 19.22GB of memory executing a one liner #fail

Ran time ruby -e 'def is_prime n; ("1" * n) !~ /^1?$|^(11+?)\1+$/; end; is_prime 982_451_653' #fail keyboard events don't fire, gfx glitches, windows don't repaint, one core pegged

Just spent the last 25 minutes installing homebrew packages on my work machine. My code is literally compiling. Took the time to do some scooter laps.

Rebooted hyperbola for the first time in a year due to the libc vuln. Minor panic ensued. Gunicorn failed to start due to log file perms, /var/run/gunicorn was wiped and had to be recreated #fail

I've been missing #ruby lately. I should make something.

(function _() {console.log('('+_+')()')})()

Answered a phone call on my computer for the first time. That was so cool. #win

I have an album with a non-square album art in #iTunes. The UI renders it 3 different ways #fail

Upgrade to Bootstrap 3.3.0 went really smoothly. Everything just worked #win

#hyperbola is down to 200 lines of #CSS, half of which is used to render the logo and navbar

Finally bootstrap-ified the last bits of #hyperbola: the frontpage and the lifestream entry panel #win

Now I have #utf8 support in #MySQL. I thought I did hyperbo.la/lifestream/174 but that was a #fail. Bitten by the difference between utf8 and utf8mb4. Alas, #Django 500's; no emoji for me

I still don't have zero-downtime #MySQL upgrades. Lost a nine #fail

Just added CORS headers for web-fonts on my 2 assets domains through cloudflare ... whoa. This has apparently been broken for a while #fail #win #hyperbola

I do not understand Box Engineering's blanket aversion to a build step. So many generated artifacts checked in. #fail

Started going through the Functional Programming in Scala book today #scala

why does any C program of sufficient complexity have its own allocator? Just use jemalloc?

TIL #nagios flips out when you reboot a host #devops

The admin site is slightly modernized in #django 1.7 ... looks nice #win

hyperbola, now with #django 1.7 ... I love how easy it has gotten to deploy this site.

Today I exceeded linux's max shebang length #fail it is 128 btw

I now understand the difference between teasing apart complexity versus simply moving it around

thinking of writing a toy in #rust or #golang

swift is the #scala to objective-c's java ... that switch statement looks an awful lot like scala's match construct

TIL that two trailing spaces + line break = br in the same p #markdown #win

lol at the #nginx empty_gif directive

heh, spoke too soon ... #fail Had forgotten to update #nginx config so when I deleted the legacy deployments, I lost static assets and media.

live site was just deployed automatically for the first time. Switched from legacy deployment to automated with no downtime! #win

Just did 2 fully automated deployments to staging! #win #automation

just did a dry run of a mostly automated hyperbola deployment. virtualenv, bash, git what fun :) Already staging and production have diverged. #fail next is to figure out how to bring it live

Oh no! just missed a deploy step #fail ... forgot to run pip install --upgrade ... new code was missing a dep

Woo! First 2 hyperbola releases with #git tags today #win. Also local development. dev + ops = #devops

PyCharm is neat. #python #django I found the code analysis to be useful.

Listened to a pretty intense #scala rant today: youtube.com/watch?v=uiJycy6dFSQ ... Highlights some of my gripes about the language, most notable implementation details leaking everywhere

Nothing like a little bit of #regex golf on a Saturday evening.

I just realized that when I first learned #java, there were no generics. Thanks Martin Odersky! #scala forever.

Killed it at #Box Dev today #metadata

60ms server-side latency on the lifestream page now #performance

"It's Not Right but It's Okay" -- A poem by Whitney Houston about continually evolving software projects.

Today I learned more about sockets and ephemeral port exhaustion than I ever wanted to know. I normally take TCP as a given. #webscale #box #metadata #fail

Next #devops steps for hyperbola: Rebuild machine from scratch on 64-bit kernel; use #docker and dockerize all services: nginx, staging django, prod django, MySQL; real deploy step; #git tag releases

#ruby has object tainting and security levels. So cool! ruby-doc.org/core-2.1.1/Object.html#method-i-taint

#django sure as hell doesn't make it easy to get at the database backend ... but the fact that I can is still awesome. Enabled post count badges on lifestream.

Hyperbola, now with retina graphics! The logo and feed icons will come through as retina.

Lack of agency is the thing I fear most as an engineer. It's something I need to get better at dealing with.

Ways you can tell we have a major release coming up: Being in the office until 10:30 and 9:30 on consecutive nights.

Upgraded to Mavericks ... relinked all homebrew formulae like this: gist.github.com/lopopolo/9427762

Did my first service deployment today. 6 nodes in 3 datacenters #box #metadata #devops

Open-source #patch: github.com/fge/json-patch/pull/7

it is a rare day that I don't get home and try to type my work password into my laptop #fail

#metadata about to enter the War Room for 2 months ... #Box /dev brings deliverables. Let's go!

next project: convert #hyperbola to UTC, server, #django, and #mysql

I have no idea why, but every time my backup disk spins up on my laptop, my entire system hangs for a few seconds #fail

got another big #performance win by not minifying HTML in python not doing so shaved ~100ms off response time which means my server was spending more than 100ms of CPU time for the pleasure #fail

about ~20% of server time for lifestream is spent reversing URLs for hashtags :/ #performance #fail

Latency at nginx for hyperbola: frontpage: 25ms, contact: 40ms, lifestream: 200ms #performance

Switching gunicorn to a domain socket instead of a TCP port sped up the site by 2x #performance

Hyperbola, now with more html5-boilerplate and bootstrap ... it made CSS so much easier than I normally find it to be ... and the site is now mostly responsive and looks good on mobile

Spent the last week optimizing, re-styling, and significantly refactoring hyperbola. The lifestream page loads ~300ms faster and DOMReady is ~600ms faster #performance

Get optimized, HTML! Just added some middleware that minifies Django template HTML output #performance Google pagespeed really likes my site now (on Desktops) ... 94/100 #win

My wiki is getting filled up with #devops documentation for #hyperbola #win Runbooks are fun!

The last bits of the #hyperbola deployment are gone from my home directory ... finally productionized a cron to do a #database and media backup #devops

Most interesting learning from 2013: when it is appropriate to resist my engineer's temptation to build the perfect thing. #lean #failfast #box #metadata

I'm getting ad targeted for foundationDB on YouTube during my vacation ... are we using it yet? #box #metadata #database

Needed: #mobile optimized #django admin skin. Posting from my iPhone is less than ideal

howfuckedismydatabase.com hehe database problems. #fail #scale

wow link tags and auto RSS/Atom feed discovery ... welcome to the internet Ryan ... #fail ... I feel like #django is missing a template tag here.

#nginx reverse proxying to django with HTTP/1.1 ... wish this config option would be the default.

#PHP is just netcat ... the language of the web does not have a good HTTP abstraction. I'm envious of golang's HTTP package

woo! #hyperbola is now #pep8 and #flake8 compliant! Woooo linting! #python

And with about 30 minutes of downtime I've now got 2x the ram #devops

running alter tables in production is terrifying #mysql ... just converted from MyISAM to InnoDB and added a bunch of #indexes

#django 1.6 upgrade was a breeze. Just a single deprecation warning. #win ... took the opportunity to refactor some old code too :)

so my resume link was broken for six months #fail stupid missing line in #nginx conf ... not enough exploratory testing during the refactor. What good is #staging for anyway?!

I reported this #github #outage #fail

Actors are overrated. So far, we've preferred to use future literals and ExecutorServices instead #scala #box #metadata

Finally added an upstart script for my gollum wiki #linux #ops One less thing to worry about when dealing with a reboot or upgrade

Only minor drama when upgrading hyperbola to 12.04 LTS ... #mysql failed to cleanly upgrade to 5.5 and I forgot the correct URL for my staging environment #linux #fail

Part of pushing #metadata to production meant we got to puppet our service across dev/staging/perfpod/production. #puppet is pretty cool #box #devops

6 months in the making, #box metadata made it to production today

The bare minimum I need on a server to feel comfortable is `set -o vi` #vim #bash

On stage at #BoxWorks ... metadata launched #Box #gocloud

Now it's time to figure out what part of the stack is preventing #concurrency from exceeding 100 connections #jetty #linux

Throughput on the #box #metadata backend is limited by the rate at which our load driver can make requests. 2ms latency at the client. This thing is #fast #performance

github.com/box/box-ios-sdk-v2/pull/22 #ios #objc #box #git

Won best performance hack at the #Box #Hackathon last night #win

Rule number 1 of operating at #scale: Your assumptions are never universally true.

Woo: hyperbola, now with thumbnailing #performance

Hello #nginx. Goodbye #apache

Upgraded #django from 1.4 alpha to 1.5.x stable tonight. It only took a couple hours. Mostly dealt with deprecated APIs and new template tag syntax

One of PHP's biggest problems is that it is too easy to create associative arrays. It discourages people from making proper objects. #php

mac #safari can attach to webviews running in the iOS simulator and open a web inspector. This is cool but ... what? #debugging

#databases Two things that amaze me: (1) idempotent writes, (2) idempotent and reorderable writes

git commit -m 'removed 2 chainz' #git #win

I am super excited to see the results of the move to the T3 #javascript architecture at #box

The Fundamental Theorem of Software Engineering: "We can solve any problem by introducing an extra level of indirection."

It makes me happy when I see people using If-None-Match sprinkled throughout the splunk logs at #box #win

currently having a real bad time importing ffmpeg into xcode #fail #indexing

just installed 500MB of software for a scanner #wtf #fail

I remember a few years ago when my primary reason for staying on #firefox vs #Chrome was that I preferred how Firefox highlighted text on selection. #fail

I have no idea why, but since I've been working at #box, I don't #git pull. I always fetch and merge --ff-only or rebase. Only time I ever use pull is via pull --rebase if I get ff-rejected on push

Participated in my first 24 hour hackathon last Thursday. It was awesome. Highlights: food trucks, caffeine, kreayshawn, and awesome hacks #box

Just forked, edited code, submitted a pull request, and got it merged all from the browser #win #git #github

#itunes 11 is beautiful

I had a cronjob launching every minute that updated remotes on about 40 #git repos. I've apparently had ~50 git processes running all the time for about a year now. #fail

I can't believe I ever liked #flex. To be fair though, #xcode and interface builder are basically the same thing

Running unit tests is the equivalent of waiting for code to compile.

Just updated the firmware on my Air. First two reboots = #kernelpanic. 3rd reboot = no mouse or keyboard. 4th reboot, everything works? #fail

9 months since the last reboot isn't too shabby. And now I have a 3.5 kernel!

#metaprogramming is awesome. In a new project, adding an API endpoint is as simple as defining a single constant

Changed my terminal and vim fontsize from 14pt to 24pt at work. zOMG so much better

alias jsonpp='python -mjson.tool' greatest alias ever for #json #api development

So I have some autocmds in my vimrc already, but tonight I wrote my own. It detects macruby in the shebang of a script and sets a var to tell syntastic to load a different syntax checker #vim

Just added #solarized and a #vim plugin (vrapper) to #eclipse. zOMG this is so awesome

#java gets #functional. Hooray chainable methods! datumedge.blogspot.com/2012/06/java-8-lambdas.html

Gollum finally updates! Woo! #ruby #rubygems

#versioncontrol, or the lack thereof. This was my first major software project. I was a junior in high school. I was making a symbolic math thing. #fail or the reasons any CS class should teach #git

#Songza's use of high-res album art alone makes the experience feel better than #Pandora. Add in the fun way of selecting playlists and we have a winner

songza.com Not only is it awesome, but logging in doesn't stop my music from playing. sweet #ux

My wiki was spammed and turned into a link farm for discount pharmaceuticals. Good thing its backed by #git -- fixing it was trivial

google docs for #LaTeX sharelatex.com

#notetoself: Next time you need to run more than 3 tasks that take 10 minutes or more to run, invest in figuring out how to script it #fail #thesis2012

A watched pot never boils. Neither does a long running task when you're not tailing the log file. #thesis2012

Running experiments. It's been 9 hours now. #thesis2012

ssh and an html/js terminal that will run anywhere I have chrome because of native client? Yes please #win #awesome chrome.google.com/webstore/detail/pnhechapfaindjhompbnflcldab…

T-minus 2.5 weeks #thesis2012 OMG I HAVE 70 EXPERIMENTS TO RUN,

screen wipes are the best things ever for both laptop screens and glasses #win #thingsineedtobuy

I wanna give a big shoutout to the #java jvisualvm, without whom figuring out my perf problems would have been much harder

#lessonlearned: Don't create a billion Timer objects. One is probably enough. Managed to get #eclipse to fail at repainting itself because it was running about 700 threads #java #fail

I feel like serializing procs to strings, passing them over HTTP and evaling them is an abuse of #ruby, but it is awesome that I can #win

I do not care whether your API is RESTful. Does it work and will it do what I want? #marketing #fail

I remember when I first upgraded from notepad to scite when I first installed #ruby. You had to modify this conf file to get monospace all the time ... #vim is so much better #nostalgia

all your heapspace are belong to me! #java #outofmemory #fail

The number of posts on #hackernews about people reinventing/whining about #git never ceases to amaze me #fanboy

github.com/lopopolo/dotfiles/blob/master/scripts/cron-update-… All of my problems with this script had to do with adding passphrases to my #ssh keys #fail

just discovered that once you're in cmd+TAB mode on OS X, cmd+` cycles backward. So much easier than cmd+shift+TAB #learnability? #fail #win

#ssh public key auth setup on hyperbola #womp #programmerresolutions

#golfed OR "why use ruby -e when there's uniq -c." It's 40 chars shorter than before: cat ~/.bash_history | cut -d" " -f1 | sort | uniq -c | sort -rn | head

Is it weird that my web server backups run at 4:04 AM? #lolz

I just saw a commercial for #IE9 with a dubstep music track. Um ... #browserwars?

You mean I have to implement hashCode()? I guess that means I'm doing some string concatenation #easyway #java

I don't ♥ manually managing character sets #fail Why doesn't #django ensure the #mysql db has #utf8 as its character set?

Cute ad on stackoverflow. It reads " Your Job" #adtargeted (apparently my db doesn't like unicode #fail)

Today I learned that #vim and #emacs treat newlines as line terminators. This means files written by them always end in a newline. #learnsomethingnew

That feeling when you go to empty your trash and you realize that there were over 14k files in it that account for 15GB of disk space. HOW DID THIS HAPPEN? #fail

So now that I got #airdrop working, I like it. It doesn't handle large transfers so well though. Transferring a gig of #music files has taken 15 minutes so far and I'm only 2/3 done. #fail and #win

Linus Torvalds is a boss harmful.cat-v.org/software/c++/linus #c

I'd post about how #adtargeted I feel every time I see a New Relic ad, but it'd only make it worse

I hate writing unit tests #junit #java #dbclass

Math m = null; m.sin(0.5); is valid #java and computes the sin of 0.5. #learnsomethingnew Type resolution is cool.

the newest xcode download slimmed down a lot. less than 1.5 gigs #thingsthataregood

Laptop is using full disk encryption and #hyperbola now backs up the db and all of its media to dropbox #swag #programmerresolutions

Process for rendering pset: Type in vim using markdown > render to html and open in chrome > print to pdf #doingitthehardway

After a struggle to import data from Firefox, I've switched to Chrome #thingsthatarenew The only extensions I'm running are 3 greasemonkey scripts I can't live w/o

I've never had to implement a hash table before #spoiled by standard libraries

a productive day: did something I've been meaning to do for a while: a playlist queue for iTunes #ruby

A productive day: made my PS1 better and fixed a bug in the hashtag regex on hyperbola (again)

Something something something #git ... something something something complete

Nokogiri::XML(file_bigger_than_1GB.xml) is a bad idea #fail

ok so setting up 4 VMs all at once was a pain in the ass sr-master.xvm.mit.edu sr-worker-1.xvm.mit.edu sr-worker-2.xvm.mit.edu sr-worker-3.xvm.mit.edu #thesis2012

Thank goodness xml compresses so well

I dislike experiencing bugs in my day-to-day usage of software I paid for. Saints Row: The Third and iPhoto, I'm looking at you #fail

cat ~/.*h_h*|cut -d" " -f1|ruby -e'h=Hash.new 0;h[$_]+=1 while gets;h.each{|k,v|puts"#{v} "+k}'|sort -rn|head #golfed This snippet prints out my most frequently used commands

#vim modelines are the best. Just added filetype modelines to all of my wonkily named #bash config files. Syntax highlighting rules

I don't understand why people think they need build scripts for their dotfiles. #fail Just keep your $HOME in #git: git init && git remote add ...

This is the longest-lived and most consistently updated #blog I've ever had. Averaged a post every 2.5 days. I still post to #twitter more often. #socialmedia

My most frequently used commands on my laptop

learn sometihng new about #ruby everyday patshaughnessy.net/2012/1/4/never-create-ruby-strings-longer-… #interpreter

Just exported 1GB of article dumps from #wikipedia #thesis2012 is on

stackoverflow.com/questions/7202157/why-does-return-the-strin… this is why #javascript is #awful

you can see the xcode in my eyes ... #allidoiscode

Switched to solarized color scheme in terminal and #vim. Everything looks different, I love it though. I'll get used to it. Also, Inconsolata rocks.

lol my site looks like this twitter.github.com/bootstrap/examples/container-app.html #bootstrap

^(void) { NSLog(@"Closures are cool"); } spicedcocoa.wordpress.com/2010/06/16/working-with-blocks-in-o…

history of version control. An entertaining read flourish.org/2011/12/astonishments-ten-in-the-history-of-vers… woo #git

so after hacking around in #objc all day, the syntax is starting to make sense. I actually kinda like it. #macruby is so awesome though.

johnkary.net/git-1-7-8-changes-for-the-everyday-developer #git grep is pretty cool, but I think i'll stick to #ack

sweet, there's been a patch since may, but no need to put out a bugfix release or anything github.com/github/gollum/issues/147 #fail #git

#firefox dims the favicons of inactive tabs. That's so nice.

this is a major #fail deadmemes.net/2010/10/19/fear-and-loathing-in-debianubuntu-or…

printed over 600 pages in an athena cluster today #win

#hack to fix someone else's #PHP #fail foreach ($_POST as $key => $value) { $_POST[$key] = mysql_real_escape_string($value); }

what I've been working on: sandboxing #chrome extensions

apache, quit installing sites into my sites-enabled directory. You're taking my site offline #fail

Best commit message ever #git #win

a CSS rule to make images sane in fluid gmail: html > body > img { max-width: 100%; max-height: 100%; }

I have iTunes autoname my files based of their tags. Apparently if a track starts with "(", it won't prepend the track number to the file name. #fail

#music curating has reached a new milestone. All albums in iTunes are complete. Next, get rid of all those 128 kbps tracks.

* 4 * * * means every minute of the 4 o'clock hour #cron #fail

speaking of proxies ... hyperbo.la, now with 100% more reverse proxying (apache to gollum) #gemsanity

I first used Charles this past summer. A very valuable tool for network observation and debugging charlesproxy.com

Google plus, you are no longer app tabified. slow #fail

Just did an ubuntu server upgrade from hardy #linux #fail

Why dynamic languages suck sometimes: I spent the last 45 minutes debugging a python script. I thought I had logic errors. What actually was wrong was that I renamed a variable and missed one. #fail

when you're at pid 400000, it's probably time for a reboot #unix

I don't know why, but I am excited about home automation today. Z-Wave looks really cool

A libc-free world, eh? blogs.oracle.com/linux/post/hello-from-a-libc-free-world-part-1 #overkill

I have 3 spare computers lying around. What should I do with them? One idea is to turn them into a cluster with one node running a shared kernel for the entire cluster. #rpc #linux

6 doesn't byte 00110110 00100001 00111101 01100010 01111001 01110100

#backintheday, before I understood how the relational part of MySQL worked, I made 20 columns to hold metadata about a record. 20 columns wasn't enough. Foreign keys #ftw. learning #fail

So on this one server, my default shell was /bin/sh, i'm not a sudoer, root owns my home directory, and another user owns /home. #linux #fail

This article is so cool en.wikipedia.org/wiki/List_of_company_name_etymologies #wikipedia

so in order to access Mail.app's preferences to make it not be the default mailto: handler, I first have to configure it #fail

Way to steal my MEng thesis idea Twitter github.com/nathanmarz/storm/wiki/Rationale

the goes to operator (x --> 0) makes #C feel more like #ruby! #fail

Seriously, Office? You rm the backup from the disk when I close it instead of doing the sane thing and moving it to my trash? #fail #hard

why does iChat think it's ok to grow as large as it wants vertically? #no, I'll manage my windows by myself.

#timeboxed this gcc cross compiler nonsense. Using debathena in a VM is easier. #hammer

#compiling #gcc from source to get an ELF cross-compiler on OSX. This is so #fail

its amazing how much quicker a script runs when you don't create 60,000 Hashes and compile a regex 30k times #ruby

Because kernel.org is down, I used airdrop to copy over a cached version of the git source and formula from another computer so I could install it with homebrew #fail

#java gets #lambda syntax mail.openjdk.java.net/pipermail/lambda-dev/2011-September/003… #finally

bookmarking for later: useful defaults for OS X apps. github.com/mathiasbynens/dotfiles/blob/master/.osx

#UPnP stopped working on my router. Flashed it to fix.

I got to 100 #tweets a hell of a lot faster than I did here (still not there yet)

So I used #github socially to review someone's code and got flamed. That's the last time I do that.

Abiding by the principle of least surprise is, to me at least, least surprising.

I remember when I wanted one of these #sonymylo

here's the #plan: 63 units, 6 classes, 3 of which are grad H. It's gonna be a bumpin term

stabyourself.net/mari0 #mario + #portal = awesome

Just finished deploying my own #gollum wiki.

I'm going to miss #ruby's hash rocket blog.peepcode.com/tutorials/2011/rip-ruby-hash-rocket-syntax

for the number of times i ssh'd into my iMac this sumer, you would think that I'd have just put my ssh key on it #fail #doingitthehardway

developer.ibm.com/articles/wa-ruby #ruby on #android. This is pretty awesome, as is the name.

I was not able to access google plus for about a week. Figured they were just having issues because I was still able to access email fine. Ended up having to recover my account. #fail

It's been real California; can't wait to come back

So #rails caches column names across the database and generates SQL for them even if they are never used. Why does this make sense? #fail

Finished my internship at #ooyala. Had an awesome summer; learned so much.

Just demoed my Custom Events analytics project at #ooyala. It went well: "This is the future of freemium analytics."

RSS and Atom feeds now render posts the same way I render them on the lifestream page. Thanks to my one reader derenrich for the feature request.

Woo! my #django #patch got accepted. code.djangoproject.com/changeset/16609

this is way cooler than rvm: github.com/sstephenson/rbenv #ruby

next project: install rvm and homebrew

Got a #django bug accepted: code.djangoproject.com/ticket/16573

yet again, #vim is awesome: danielchoi.com/software/vitunes.html

#vim omni completion + #supertab = #vim #bliss. I'm never using an IDE again

And so I wait for the dns change to propagate ... soon, we'll be live here from NJ

Disabled #root login over ssh. Have no idea what the password is. This is the #ubuntu way.

I haven't posted about #music in a while: #songkick is the best. I'm going to so many more concerts now. I get too immersed in #turntable for it to be a regular thing.

#thisisa.pathological#testcase.#dealwithit

first post on the new server. It runs. I'm trying to make this #django thing leaner and less hacky. Still have a ways to go. Boy do I need to set up a dev env.

What a busy friday. Switched to iTerm. 256 colors is nice. Set up a git repo with all my dotfiles. Got real #serious with my #bash config.

got a new #server. It's in Newark. It's some lonely VM. It's time to get serious.

duplicity: duplicity.gitlab.io #backups

finally got around to giving my #vim config some love. MacVim is pretty cool.

#mashup #idea: quova + mixpanel. Give it the ability to scope by region/state/country/county

the hyperbola repos have been migrated to github. and so begins the death of dev.hyperbo.la

I avoid adding punctuation after my #hashtags because there's a #bug in my regex that parses them. #thingsishouldfix #django

After working with #rails for a bit now, I kinda like the #magic. DB interations seem so much more natural than they do in #django

My new favicon welcomes my site to 1996 #itsgreattobehere #fail

oh #quora, you sly kitten, requiring me to sign up to view all the answers to a question

Next birthday present to myself: CrashPlan+. Offsite #backup of all of my media? Yes, please.

Thinking about migrating this site to EC2. Probably gonna stick with #django. dev.hyperbo.la will probably die; github does it way better. Moving all media assets to s3: maybe. ssl: probably not

checked my Activity Monitor, had 2 #ruby processes each at 90% cpu which had been running for hours. trapping signals #fail

open("|-"), you are a tricky beast. Successfully fork bombed myself 5 times before I sorted that out.

why `svn status` prints nothing when you have a clean working directory is beyond me. #git ftw

hyperbola, now with 500% more cache-control headers

I need to get around to resetting up this server. I want to switch from svn to git and redo the whole apache config. why did I put the site in /var where I have to sudo all the time?? #linux #fail

one day I'll set up a #django dev environment again. Until then, we'll do it live!

Finally fixed the css on my site to be less of an abomination. width: auto, you are wonderful

rebased some already pushed commits to clean up my history and forced the push. I feel so dirty. #git #fail

wrote my first MapReduce job today!

have access to one of ESPN's private repos on github

finally broke down and got a github account. My username is lopopolo

Should I upgrade 10.04 LTS to 11.04? #linux

this weekend's project, get all my config files on github

vi mode is the best thing I have ever discovered about the command line

pushed my first bugfix today!!!!

lesson learned: never muck around with mysql's database directory; you will screw up #fail #linux

this site: now with 5 times fewer 500 errors #django #fail

for some reason every part of the #django admin worked except the root page. had to turn on debug mode to see I was improperly configured #fail

first day of work tomorrow #excited

I got accepted to the EECS MEng program!!! woooo!!

sysadmin ing is fun. hello beautiful browser based svn repo browsing (insurrection) and web-based svn admining (svn-admin) #linux #win

ruby's splat is just python's tuple (un)packing #win #fail

broing out is somehow making studying for algorithms not suck

its amazing how the time melts away when you're playing portal

unintentional side effect of my server's firewall: I can't traceroute it. #fail

it's amazing how the time melts away when ur mucking around on a server

I need a 512GB iPhone

killed my own email solution because I had no confidence it would work reliably. Rolling with Google Apps now

lol. edited the site live again while working on a new app. 500 errors abound. #django #fail

got my offer today. will be working for ooyala for 3 months this summer.

lesson learned: never edit a site live. #fail #django

#idea a new NFL stat - average number of plays to achieve a first down (both intra- and cross-drive). I think it'd be interesting to compare this to average drive lengths, points/drive, and defenses

Found out that my raid array not mounting a couple months ago was due to a failed drive. Can't recover it. I lost so much data. #linux #fail

relaxing during IAP. I've started working on a side project: a flash-based dj mixer that uses #music from youtube. #flash

I HATE FLEX SO MUCH #fail

This is why I like django's pluggable apps. I can get distracted and not finish a project, but the site still works. #django #distractions

Just set up three HD cable boxes and they look sweet. #tv

working on a sort of app store for projects i've done, a glorified portfolio

lots of code refactoring going on right now. One drawback of the ease and speed of #django is that it allows you not to think.

props to a friend for giving me some tips on how to make my logo better. this is the tweaked version.

Had a bad run-in with rm -rf. lost the sqlite database for the site. on the bright side, I'm using mysql now. #linux #fail