Knowledge is Power
Yarn jobs hangs on local mac environment Missing node in Resource manager UI There are no nodes in the node list http://192.168.68.145:8001:8088/cluster/nodes File: yarn-site.xml Location: /usr/local/Cellar/hadoop/2.7.3/libexec/etc/hadoop/yarn-site.xml <property> <name>yarn.resourcemanager.hostname</name> <value>localhost</value> </property> Resource Manager UI displaying ipv6 for local address Hadoop does...
At times we need to setup local development domains for our test environment. I use it to maintain a local copy of my hosted website. It is very convenient to make changes to local and then export to hosted website...
brew packages Basic Apps $ brew install bash $ brew install bash-completion $ brew install maven $ brew install openssl $ brew install ssh-copy-id $ brew install wget $ brew install gawk Big data Apps $ brew install hadoop $...
Pre-requisites User account for which passwordless ssh will be setup, should be present on all nodes Password of the account should be same across all nodes pdsh and ssh-copy-id commands should be available Prepare 2 files file_of_hosts.txt – containing all...
Apr 2017 As of Apr, 2017 SNX + Firefox ESR, fails to connect with Java version 1.8.0_131. Resolution Downgrade Java version to 1.8.0.121 Steps Delete JDK, $ sudo rm -rf /Library/Java/JavaVirtualMachines/jdk1.8.0_131.jdk Delete JavaAppletPlugin.plugin, $ sudo rm -rf /Library/Internet Plug-Ins/JavaAppletPlugin.plugin Download older version...
Source: https://dtflaneur.wordpress.com/2015/10/05/installing-kafka-on-mac-osx/ Apache Kafka is a highly-scalable publish-subscribe messaging system that can serve as the data backbone in distributed applications. With Kafka’s Producer-Consumer model it becomes easy to implement multiple data consumers that do live monitoring as well persistent...
Usage Basic $ top View by process name # top -p $(pgrep -d’,’ <process name>) # sample below, top -p $(pgrep -d’,’ http) View by user top -u <user name> Sort by mem # Inside top Shift+m View command...
Using python with json.tool, $python -m json.tool <filename.json> Or use something like in line 2, below echo ‘{“employee_id”:1,”full_name”:”Sheri Nowmer”,”first_name”:”Sheri”,”last_name”:”Nowmer”,”position_id”:1,”position_title”:”President”,”store_id”:0,”department_id”:1,”birth_date”:”1961-08-26″,”hire_date”:”1994-12-01 00:00:00.0″,”end_date”:null,”salary”:80000.0000,”supervisor_id”:0,”education_level”:”Graduate Degree”,”marital_status”:”S”,”gender”:”F”,”management_role”:”Senior Management”}’ > /tmp/emp.json cat /tmp/emp.json | python -m json.tool Related posts: AWK quick reference How-to: Install Hue...
Tips Original article Tips awk regex awk ‘/[0-9]+ /{print}’ file.txt not beginning with an expression awk ‘!/^anexpression/{print}’ file.txt containing x and not containing y awk ‘/x/ && !/y/’ file.txt Mixing single and double quotes $ awk ‘BEGIN...
Introduction vi pronounced as ” vee eye ” is a unix editor available on almost all the unix operating systems , solaris , bsd ,aix , hpux etc. This document is a quick reference to vi editor and will be...
More
