Author: robin

0

Kafka on OSX / macOS

Source: https://dtflaneur.wordpress.com/2015/10/05/installing-kafka-on-mac-osx/   Apache Kafka is a highly-scalable publish-subscribe messaging system that can serve as the data backbone in distributed applications. With Kafka’s Producer-Consumer model it becomes easy to implement multiple data consumers that do live monitoring as well persistent...

0

top command on linux

Usage Basic $ top View by process name # top -p $(pgrep -d’,’ <process name>) # sample below, top -p $(pgrep -d’,’ http) View by user top -u <user name>   Sort by mem # Inside top Shift+m View command...

0

Pretty print JSON on mac

Using python with json.tool, $python -m json.tool <filename.json> Or use something like in line 2, below echo ‘{“employee_id”:1,”full_name”:”Sheri Nowmer”,”first_name”:”Sheri”,”last_name”:”Nowmer”,”position_id”:1,”position_title”:”President”,”store_id”:0,”department_id”:1,”birth_date”:”1961-08-26″,”hire_date”:”1994-12-01 00:00:00.0″,”end_date”:null,”salary”:80000.0000,”supervisor_id”:0,”education_level”:”Graduate Degree”,”marital_status”:”S”,”gender”:”F”,”management_role”:”Senior Management”}’ > /tmp/emp.json cat /tmp/emp.json | python -m json.tool     Related posts: AWK quick reference How-to: Install Hue...

0

Apache drill – No current connection

After reading multiple posts, it seems that this is a problem of conflicting jars. My current setup has apache drill installed using $brew install apache-drill and upon executing $drill-embedded or $drill-localhost, I see below error (line 10) robin@MacBook-Pro:~$ drill-localhost Java HotSpot(TM)...

0

AWK quick reference

Tips Original article Tips awk regex awk ‘/[0-9]+ /{print}’ file.txt   not beginning with an expression awk ‘!/^anexpression/{print}’ file.txt   containing x and not containing y awk ‘/x/ && !/y/’ file.txt   Mixing single and double quotes $ awk ‘BEGIN...

0

VI quick reference

Introduction vi  pronounced as ” vee eye ” is a unix editor available on almost all the unix  operating systems , solaris , bsd ,aix , hpux etc. This document is a quick reference to vi editor and will be...

0

Crontab quick reference

Crontab generators http://www.crontab-generator.org/ http://www.openjs.com/scripts/jslibrary/demos/crontab.php http://corntab.com/     Source: http://www.adminschoice.com/crontab-quick-reference Setting up cron jobs in Unix and Solaris cron is a unix, solaris utility that allows tasks to be automatically run in the background at regular intervals by the cron daemon. These...

0

Uninstalling Xamarin Studio

Source: https://developer.xamarin.com/guides/cross-platform/getting_started/installation/uninstalling_xamarin/#Uninstall_Xamarin.Mac   Uninstall script – xamarin_uninstall.sh #!/bin/bash # This is a simple script to uninstall Xamarin from your machine. # Uninstall Xamarin Studio rm -rf “/Applications/Xamarin Studio.app” rm -rf ~/Library/Caches/XamarinStudio-* rm -rf ~/Library/Logs/XamarinStudio-* rm -rf ~/Library/Preferences/XamarinStudio-* rm -rf ~/Library/XamarinStudio-* # Uninstall...

0

Hive ORC files – Pro Tips

Extract text from ORC files (source) Hive (0.11 and up) comes with ORC file dump utility. dump can be invoked by following command, $ hive –orcfiledump <location-of-orc-file> Create hive table definition using ORC files on HDFS $ hive –orcfiledump hdfs:///data/location/of/the/ORC/file.orc...

0

Bash alias and functions for hadoop users

Functions Beeline Usage: Beeline username [queuename] export beeline_jdbc=”jdbc:hive2://servername.fqdn:10000″ Beeline(){ if [ -z “$beeline_jdbc” ]; then echo “Error: beeline_jdbc var not available” fi if [ -z “$1” ]; then echo -e “No user specified.\nUsage: Beeline <user> [<queue>]” return 1 fi queue=”default”...