Tools & Methods

  • submit to reddit

Finding Pixels with No Variance Using R

I’ve written previously about our attempts at the Kaggle Digit Recogniser problem and our approach so far...

0 replies - 1677 views - 01/10/13 by Mark Needham in Articles

What is Streamdrill Good For?

A few weeks ago, we released the beta (oh, sorry, the ”β”) of streamdrill. One question we heard quite often was, “Well, what is it good for?” So...

0 replies - 1755 views - 01/10/13 by Mikio Braun in Articles

Bash: Parse Options And Non-Options With Getopts

Parsing script or function options and non-option arguments is easy in Bash with getopts but there are some catches, such as the need to reset...

0 replies - 2210 views - 01/10/13 by Jakub Holý in Articles

Not Complex Enough

One time a professor asked me about a problem and I suggested a simple solution. He shot down my idea because it wasn’t complex enough. He said my idea would...

9 replies - 2433 views - 01/10/13 by John Cook in Articles

Bash Magic: List Hive Table Sizes in GB

To list the sizes of Hive tables in Hadoop in GBs: sudo -u hdfs hadoop fs -du /user/hive/warehouse/ | awk '/^[0-9]+/ { print int($1/(1024**3)) "...

0 replies - 1981 views - 01/10/13 by Jakub Holý in Articles

Top 10 Pops and Drops with Splunk - Part 1

In real-time operational contexts, it’s important to monitor system metrics for major swings in value. Such swings, whether upward (“pops”) or downward...

0 replies - 2127 views - 01/10/13 by Willie Wheeler in Articles

Some Thoughts on Gamification and Software

On the recommendation of J.B. Rainsberger I’ve been reading ‘Reality is Broken‘ – a book which talks about how we can apply some of the...

0 replies - 3548 views - 01/09/13 by Mark Needham in Articles

Sonnet Primes in Python

A while back I wrote about sonnet primes, primes of the form ababcdcdefefgg where the letters a through g represent digits and a is...

0 replies - 1646 views - 01/09/13 by John Cook in Articles

Writing Hive Tables from MapReduce

This article is by Stephen Mouring Jr, appearing courtesy of Scott Leberknight.This is part one of a two part blog series on how to read/write Apache Hive data...

0 replies - 2473 views - 01/09/13 by Scott Leberknight in Articles

Statisticians Promote Contributions to Society During the International Year of Statistics in 2013

The comSysto GmbH and more than 1,400 organizations in 111 countries are combining energies in 2013 to promote the International Year of Statistics...

0 replies - 1253 views - 01/09/13 by Daniel Bartl in Articles

A Trip to the Math Museum

This Saturday, we had two interesting museum experiences, with the kids. Kids are 10, 7 (and a half as she keeps saying) and 2 (and a half, too). In the...

0 replies - 1594 views - 01/09/13 by Arthur Charpentier in Articles

DevOpsCast: Chef Server Installation

Following up on his tutorial on getting started with Chef Solo, DevOpsCast's Mat Schaffer helps you install your Chef Server:

0 replies - 1320 views - 01/09/13 by Eric Gregory in Articles

"Please Login to Your Facebook Account" - Behind a Data Mining Scam

So someone sends you a link to the latest Gangnam parody / cat meme / man jumping on frozen pool video and the link looks something like...

0 replies - 2633 views - 01/08/13 by Troy Hunt in Articles

Dabbling in Home Automation

A Swedish colleague of mine once told me that Clas Ohslon is termed a “husband kindergarten” by Swedish woman and I have to admit that if I’m ever nearby...

0 replies - 1930 views - 01/08/13 by Gareth Llewellyn in Articles

Gazzang Predicts This Will Be the Year of Big Data

SOA World magazine points to a 2013 prediction from Gazzang, a company dealing with Linux data security. Gazzang reckons that 2013 will be the year...

0 replies - 1020 views - 01/08/13 by Eric Gregory in Articles