Monthly Archive: September 2019

0

VirtualBox tips

Increase size of VDI file (Windows) Go to Virtualbox folder > cd “C:\Program Files\Oracle\VirtualBox” Run resize command (unit size is MB) Below command will make the disk size grow up to 16GB > VBoxManage modifyhd “C:\Users\robin\C:\Users\v737050\VirtualBox VMs\Centos 6\Centos 6.vdi” –resize...

0

Extract query time from hiveserver2 Interactive log

Got in a situation where you were asked to extract hive queries and the time they took to execute? Steps On log files run below 2 extracts awk ‘match($0, “^([^ ]+).*Completed executing command\\(queryId=([0-9a-z_-]+)\\); Time taken: (.*)”, a) {print “COMPLETE\t” a[1]...

0

HDFS data sizing

Below is data storage estimator based on message size and throughput. Input HDFS replication and the amount of data end users will generate over time using raw data. Hope this helps you. Data calculator Message size in bytes Message per...