Mar
16th
Wed
16th
tip: hadoop
in pig, count number of tokens in a chararray with ((to is NULL) ? 0 : COUNT(TOKENIZE(text).$0)) AS num_tokens
Jan
14th
Fri
14th
tip: hadoop
use -inputformat WholeFileInputFormat to process full files as records http://bit.ly/dHFWBm
Jun
4th
Fri
4th
tip: hadoop
access input file names in streaming using $MAP_INPUT_FILE http://bit.ly/cRfB6k (more here: http://bit.ly/9EzL1u)
Mar
26th
Fri
26th
tip: hadoop
to call a url upon job completion, use -Djob.end.notification.url=’http://…?jobid=&jobStatus=’
Mar
23rd
Tue
23rd
tip: hadoop
to update a counter in streaming, write reporter:counter:
May
13th
Wed
13th
tip: hadoop
use job.end.notification.url to specify a url to be called at job completion http://bit.ly/3PMKd
Apr
30th
Thu
30th
tip: hadoop
streaming jobs can access jobconf vars, e.g. mapred.map.tasks->$MAPRED_MAP_TASKS http://bit.ly/3wEkTZ (via @tlipcon)
