Recent Posts

Accepted talk proposal: Learning from the mistakes that even big projects make

  • Post author:
  • Post published:
  • Post category:OpenStack

This proposal was submitted for pyconau 2018. It was accepted, but hasn’t been presented yet. The oblique references to OpensStack are because pycon had an “anonymous” review system in 2018, and I was avoiding saying things which directly identified me as the author.

Since 2011, I’ve worked on a large Open Source project in python. It kind of got out of hand – 1000s of developers and millions of lines of code. Yet despite being well resourced, we made the same mistakes that those tiny scripts you whip up to solve a small problem make. Come learn from our fail.

(more…)

Continue ReadingAccepted talk proposal: Learning from the mistakes that even big projects make

Mirroring all your repos from github

So let me be clear here, I don't think its a bad thing that Microsoft bought github. No one is forcing you to use their services, in fact they make it trivial to stop using them. So what's the big deal. I've posted about a few git mirror scripts I run at home recently: one to mirror gerrit repos; and one to mirror arbitrary github users. It was therefore trivial to whip up a slightly nicer script intended to help you forklift your repos out of github if you're truly concerned. Its posted on github now (irony intended). Now you can just do something like: $ pip install -U -r requirements.txt $ python download.py --github_token=foo --username=mikalstill I intend to add support for auto-creating and importing gitlab repos into the script, but haven't gotten around to that yet. Pull requests welcome.

Continue ReadingMirroring all your repos from github

How to maintain a local mirror of github repositories

Similarly to yesterday’s post about mirroring ONAP’s git, I also want to mirror all of the git repositories for certain github projects. In this specific case, all of the Kubernetes repositories.

So once again, here is a script based on something Tony Breeds and I cooked up a long time ago for OpenStack…

(more…)

Continue ReadingHow to maintain a local mirror of github repositories

How to maintain a local mirror of ONAP’s git repositories

  • Post author:
  • Post published:
  • Post category:ONAP

For various reasons, I like to maintain a local mirror of git repositories I use a lot, in this case ONAP. This is mostly because of the generally poor network connectivity in Australia, but its also because it makes cloning a new repository super fast.

Tony Breeds and I baked up a script to do this for OpenStack repositories a while ago. I therefore present a version of that mirror script which does the right thing for ONAP projects.

(more…)

Continue ReadingHow to maintain a local mirror of ONAP’s git repositories

Head On

  • Post author:
  • Post published:
  • Post category:Book

A sequel to Lock In, this book is a quick and fun read of a murder mystery. It has Scalzi's distinctive style which has generally meshed quite well for me, so it's not surprise that I enjoyed this book.  

Continue ReadingHead On
Read more about the article A first program in golang, with a short aside about Google

A first program in golang, with a short aside about Google

  • Post author:
  • Post published:
  • Post category:golang

I have reached the point in my life where I needed to write my first program in golang. I pondered for a disturbingly long time what exactly to write, but then it came to me... Back in the day Google had an internal short URL service (think bit.ly, but for internal things). It was called "go" and lived at http://go. So what should I write as my first golang program? go of course. The implementation is on github, and I am sure it isn't perfect. Remember, it was a learning exercise. I mostly learned that golang syntax is a bit bonkers, and that etcd hates me. This code stores short URLs in etcd, and redirects you to the right place if it knows about the short code you used. If you just ask for the root URL, you get a list of the currently defined short codes, as well as a form to create new ones. Not bad for a few hours hacking I think.

Continue ReadingA first program in golang, with a short aside about Google

etcd v2 and v3 data stores are separate

  • Post author:
  • Post published:
  • Post category:etcd

Just noting this because it wasted way more of my time that it should have... So you write an etcd app in a different language from your previous apps and it can't see the data that the other apps wrote? Check the versions of your client libraries. The v2 and v3 data stores in etcd are different, and cannot be seen by each other. You need to convert your v2 data to the v3 data store before it will be visible there. You're welcome.

Continue Readingetcd v2 and v3 data stores are separate
Read more about the article pyconau 2018 call for proposals now open
hdr

pyconau 2018 call for proposals now open

  • Post author:
  • Post published:
  • Post category:Conference

The pyconau call for proposals is now open, and runs until 28 May. I took my teenagers to pyconau last year and they greatly enjoyed it. I hadn't been to a pyconau in ages, and ended up really enjoying thinking about things from topic areas I don't normally need to think about. I think expanding one's horizons is generally a good idea. Should I propose something for this year? I am unsure. Some random ideas that immediately spring to mind: something about privsep: I think a generalised way to make privileged calls in unprivileged code is quite interesting, especially in a language which is often used for systems management and integration tasks. That said, perhaps its too OpenStacky given how disinterested in OpenStack talks most python people seem to be. nova-warts: for a long time my hobby has been cleaning up historical mistakes made in OpenStack Nova that wont ever rate as a major feature change. What lessons can other projects learn from a well funded and heavily staffed project that still thought that exec() was a great way to do important work? There's definitely an overlap with the privsep talk above, but this would be more general. a talk…

Continue Readingpyconau 2018 call for proposals now open

End of content

No more pages to load

Newer Posts
Older Posts