Cannot connect to Amazon Redshift
I am not able to connect to Redshift and getting error [Amazon](500310) Invalid operation: no pg_hba.conf entry for host user SSL off;
🙁 🙁
adhocshare Blog
Keypirinha settings
Need to stash my Keypirinha settings, [app] hotkey_run = Alt+Space launch_at_startup = yes [gui] theme = MediumLayout, SolarizedDarkColors geometry = persistent always_on_top = yes escape_always_closes = yes retain_last_search = yes No related posts.
Connecting to remote server using a jump server (SSH tunneling)
Problem statement There are 3 hosts, Host-user – one that you are on Host-jump – one that has connectivity to database server Host-database – database server Host-user wants to connect to Host-database using Host-jump. Solution Setup ssh tunnel with local...
Fetching Redshift table DDLs
So lately I got stumped by not having the ability to extract DDL/ table definition for a table in Redshift. Quick searches on the internet resulted in… below query, SELECT * FROM pg_table_def WHERE tablename = ‘table_name’ AND schemaname =...
Cleanup hdfs directory having too many files and directories
At times some directories on hdfs has too many inodes (files and folders) and it is really hard to delete. Some instances also lead to out of memory (OOM) errors such as the following error, INFO retry.RetryInvocationHandler: java.io.IOException: com.google.protobuf.ServiceException: java.lang.OutOfMemoryError:...
Querying Hive Metastore
Querying hive metastore tables can provide more in depth details on the tables sitting in Hive. This article is a collection of queries that probes Hive metastore configured with mysql to get details like list of transactional tables, etc. More...
Microsoft SQL Server query tips
Get column details of a table Get column details of a table select name from sys.columns where object_name(object_id)=’table_name’ No related posts.
Cluster filesystem utilization alerts
This is a quick and raw method to setup alerts when the filesystem fill above threshold. Pre-requisites Monitored filesystems should be consistent, meaning available across all nodes passwordless ssh should be setup between the nodes. Node where the alert script...
Check version of installed python packages
Below bash command will let you find the version of packages for your python interpreter. Make sure you are running the correct version of python enterpreter. Update: 2020-05-14 for i in pandas numpy sqlalchemy logging logging.handlers datetime sys re os...
