adhocshare Blog

0

Crontab quick reference

Crontab generators http://www.crontab-generator.org/ http://www.openjs.com/scripts/jslibrary/demos/crontab.php http://corntab.com/     Source: http://www.adminschoice.com/crontab-quick-reference Setting up cron jobs in Unix and Solaris cron is a unix, solaris utility that allows tasks to be automatically run in the background at regular intervals by the cron daemon. These...

0

Uninstalling Xamarin Studio

Source: https://developer.xamarin.com/guides/cross-platform/getting_started/installation/uninstalling_xamarin/#Uninstall_Xamarin.Mac   Uninstall script – xamarin_uninstall.sh #!/bin/bash # This is a simple script to uninstall Xamarin from your machine. # Uninstall Xamarin Studio rm -rf “/Applications/Xamarin Studio.app” rm -rf ~/Library/Caches/XamarinStudio-* rm -rf ~/Library/Logs/XamarinStudio-* rm -rf ~/Library/Preferences/XamarinStudio-* rm -rf ~/Library/XamarinStudio-* # Uninstall...

0

Hive ORC files – Pro Tips

Extract text from ORC files (source) Hive (0.11 and up) comes with ORC file dump utility. dump can be invoked by following command, $ hive –orcfiledump <location-of-orc-file> Create hive table definition using ORC files on HDFS $ hive –orcfiledump hdfs:///data/location/of/the/ORC/file.orc...

0

Bash alias and functions for hadoop users

Functions Beeline Usage: Beeline username [queuename] export beeline_jdbc=”jdbc:hive2://servername.fqdn:10000″ Beeline(){ if [ -z “$beeline_jdbc” ]; then echo “Error: beeline_jdbc var not available” fi if [ -z “$1” ]; then echo -e “No user specified.\nUsage: Beeline <user> [<queue>]” return 1 fi queue=”default”...

0

Deleting users from Ranger database (mysql)

Once you sync users in Apache Ranger they will stay in the database even if we sync ranger users from a different source. All those users will clutter up the Ranger user interface. Following two scripts will help in deleting...

0

Compiling Hue on CentOS

Tested on CentOS 6.8 Minimal ISO install with Hue 3.11 Downloads Hue 3.11   Steps Download Hue tarball Install dependencies yum install python-devel libffi-devel gcc openldap-devel openssl-devel libxml2-devel libxslt-devel mysql-devel gmp-devel sqlite-devel openldap-devel gcc-c++ rsync Compile You can either compile...

0

Performance of Hive tables with Parquet & ORC

Source: http://stackoverflow.com/questions/32373460/parquet-vs-orc-vs-orc-with-snappy Datasets Table A – Text File Format- 2.5GB Table B – ORC – 652MB Table C – ORC with Snappy – 802MB Table D – Parquet – 1.9 GB Parquet was worst as far as compression for my table...

0

less command

less packs more power than “more” or “tail” commands tail -f like functionality Usage: $ less +F file.log If only $ less file.log is invoked pressing F will switch back to mode similar to tail -f Enable row number -NR inside less enables...

0

Hadoop security practices

References http://hortonworks.com/hadoop-tutorial/manage-security-policy-hive-hbase-knox-ranger/ http://hortonworks.com/blog/best-practices-in-hdfs-authorization-with-apache-ranger/ http://hortonworks.com/blog/best-practices-for-hive-authorization-using-apache-ranger-in-hdp-2-2/ http://hortonworks.com/blog/author/balajiganesan03/ http://www.slideshare.net/hortonworks/ops-workshop-asrunon20150112 Related posts: Deleting users from Ranger database (mysql) Apache Ranger tips and tid bits Remotely debug hadoop Good looking .hiverc file