HBase SQL statement fails with Insufficient permissions for user

ISSUE: Below error comes up when creating new hbase table hbase(main):001:0> create 'anoop','cf1' ERROR: org.apache.hadoop.hbase.security.AccessDeniedException: org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'anoop' (global, action=CREATE) at org.apache.hadoop.hbase.security.access.AccessController.requirePermission(AccessController.java:426) at org.apache.hadoop.hbase.security.access.AccessController.preCreateTable(AccessController.java:563) Solution: - Once the cluster has been secured, a user has to authenticate itself to kerberos by doing a kinit. By default, hbase is a superuser who was … Continue reading HBase SQL statement fails with Insufficient permissions for user


HBASE snapshots How To

What is a Snapshot? A snapshot is a set of metadata information that allows an admin to get back to a previous state of the table. A snapshot is not a copy of the table; it’s just a list of file names and doesn’t copy the data. A full snapshot restore means that you get … Continue reading HBASE snapshots How To

Creating multiple spark sessions in kerberos enabled cluster throws error

ISSUE:Creating multiple spark sessions in kerberos enabled cluster throws below error Py4JJavaError: An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext. : org.apache.hadoop.ipc.RemoteException(java.io.IOException): Delegation Token can be issued only with kerberos or web authentication at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getDelegationToken(FSNamesystem.java:7519) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getDelegationToken(NameNodeRpcServer.java:548) Solution: Use the keytab and principal wihin spark code as below   spark = SparkSession\     .builder\     .appName('asdf')\     … Continue reading Creating multiple spark sessions in kerberos enabled cluster throws error

Crontab not working for kerberized hadoop

ISSUE:- Cronjobs not working for kerberos enabled hadoop. Throwing below error. ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)];   Solution:- This is because there is no TTY, Profile setup for the … Continue reading Crontab not working for kerberized hadoop

Enabling the Oozie Web Console

While accessing oozie console it show the below error ========== Oozie web console is disabled. To enable oozie web console install the Ext JS library ========= Follow the steps below to solve this in cloudera distribution   Download ext-2.2.zip  from https://archive.cloudera.com/gplextras/misc/ext-2.2.zip and Extract the contents of the file to /var/lib/oozie/ on the same host as … Continue reading Enabling the Oozie Web Console

Using cloudera API to view the service configurations such as password

Using Cloudera API we can view the configurations of the hadoop  services. For example to view the hive metastore password use the command as below #curl -u cm_username:cm_password "http://cloudera_manager:7180/api/v14/clusters/cluster_name/services/hive/config" We can see this information directly in browser by accessing the link  http://cloudera_manager:7180/api/v14/clusters/cluster_name/services/hive/config directly. You should know the CM admin login