Knowledge is Power
1, 2 & 3 .. Lets go! 1. SHELL echo “1345653,110909316904:1341894546|221065796761:1341887508” > /tmp/20170317_array_inputfile.txt hdfs dfs -mkdir -p /tmp/20170317/array_test/input hdfs dfs -put /tmp/20170317_array_inputfile.txt /tmp/20170317/array_test/input rm /tmp/20170317_array_inputfile.txt 2. HIVE drop table SAMPLE; CREATE external TABLE SAMPLE( id BIGINT, record array<struct<col1:string,col2:string>> )row format...
Syntax used for connecting to Hbase using sqlline through phoenix is as listed below. ./sqlline.py 10.10.20.60:2181:/hbase-unsecure 10.10.20.60 – My Zookeeper 2181 – Zookeeper client port hbase-unsecure – value configured as zookeeper.znode.parent in hbase-site.xml Sample query /usr/hdp/current/phoenix-client/bin/psql.py zookeeperserver:2181:/hbase-unsecure /usr/hdp/current/phoenix-client/doc/examples/WEB_STAT.sql...
Okay, so lately in Jan 2017 I upgraded to macOS Sierra 10.12.4 as I have the bug to stick to latest and the greatest…. and, hell broke loose!! really! No sudo !! Yes, no SUDO! No matter how much I yelled,...
Vertex failure while running Hive queries? Let’s see what can be done… Not sure..Change, hive.fetch.task.conversion=more; to hive.fetch.task.conversion=none; Was the data on hdfs in ORC files? and error being similar to below? Vertex failed, vertexName= at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java: ) Try changing...
Table Partitioning in MySQL: (Version 5.1.6 or above) Note: Before starting backup/restore please stop all running application which usage XA_ACCESS_AUDIT table. this will be help for keeping snapshot of XA_ACCESS_AUDIT for particular timestamp. Table Partitioning in MySQL:- Partitioned tables created...
Manual steps overview Export all databases except mysql & information_schema $ mysqldump -u root -p ranger_audit > /backup_directory/db_ranger_audit_<currdate>.sql Drop all databases except mysql & information_schema mysql> drop database ranger_audit; Stop mysql $ service mysqld stop Edit /etc/my.cnf...
Something like below will help in finding a value in a master list and report if the input is missing or found in the master list. Sample =IF(ISNA(MATCH(C2,A2:A15,0)), “Missing”, “Found”) Format =IF(ISNA(MATCH(value,array,0)), “Missing”, “Found”) References Related posts: Excel –...
Source: http://www.nifi.rocks/developing-a-custom-apache-nifi-processor-json/ Developing A Custom Apache Nifi Processor (JSON) Feb 7, 2015 • Phillip Grenier The list of available Apache Nifi processors is extensive, as documented in this post. There is still a need to develop your own; to pull...
Source: https://palant.de/2014/02/14/crazy-hacks-changing-wine-key-mappings-on-mac-os-x Remap CMD keys on wine (MacOS) One of the biggest quirks of using a Mac is its keyboard — in addition to the usual Control (⌃) and Alt a.k.a. Option (⌥) keys you also have the Command (⌘) key. Unlike...
Split program output to console and to a file Basic usage $ command | tee out_file.txt Appending to the output file using -a $ command | tee -a out_file.txt Redirecting stderr and stdout $ command |& tee -a out_file.txt Example...
More
