Knowledge is Power
There are times when we want to parse a string that is actually a JSON. Usually that could be done with built in functions of Hive such as get_json_object(). Though get_json_object cannot parse JSON Array from my experience. These array...
Using JsonSerDe in Hive Download JSON Serde – https://github.com/rcongiu/Hive-JSON-Serde Compile command for hive 1.2.1 – “mvn -Pcdh5 -Dcdh5.hive.version=1.2.1 clean package” . change hive version per the environment Copy json-serde/target/json-serde-1.3.8-SNAPSHOT-jar-with-dependencies.jar (or similar) to hive/lib Restart hive Sample JSON with test HiveQLs...
Following expect script uses beeline interface to fetch statistics of tables within a database. Use username and queuename with your environment values. #!/usr/bin/expect -f # hive_statistics, v0.1, 2016-05, [email protected] # Usage: ./hive_statistics [database_name] set _database [lindex $argv 0] if {...
Following shell script will get the schema information from Hive using WebHCat server. #!/bin/sh # fetch_webhcat.sh, v0.1, 2016-04-00, [email protected] # Pre-requisites: jq, curl, python (json.tool) _WEBHCAT_SERVER=”server:50111″ _USER_NAME=”JohnDoe” while [[ $# > 1 ]] do key=”$1″ case $key in -u|–user)...
Misc: 32 bit ODBC on 64 bit windows – c:\windows\syswow64\odbcad32.exe Source: http://blogs.msdn.com/b/karang/archive/2013/01/04/hdinsight_2d00_on_2d00_windows_2d00_building_2d00_powerpivot_2d00_report_2d00_from_2d00_hive_2d00_in_2d00_a_2d00_few_2d00_easy_2d00_steps.aspx Karan Gulati (SSAS Maestro) 4 Jan 2013 3:20 PM 0 What are we Covering: Hive Create table Load Data Query Data Configure ODBC Create PowerPivot With DataSource as HDInsight Import...
More
