HBase SQL statement fails with Insufficient permissions for user

ISSUE: Below error comes up when creating new hbase table hbase(main):001:0> create 'anoop','cf1' ERROR: org.apache.hadoop.hbase.security.AccessDeniedException: org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'anoop' (global, action=CREATE) at org.apache.hadoop.hbase.security.access.AccessController.requirePermission(AccessController.java:426) at org.apache.hadoop.hbase.security.access.AccessController.preCreateTable(AccessController.java:563) Solution: - Once the cluster has been secured, a user has to authenticate itself to kerberos by doing a kinit. By default, hbase is a superuser who was … Continue reading HBase SQL statement fails with Insufficient permissions for user


Spark2, PySpark and Jupyter installation and configuration

Steps to be followed for enabling SPARK 2, pysaprk and jupyter in cloudera clusters. 1.INSTALL ORACLE JDK IN ALL NODES Download and install java. It should be jdk 1.8+ # cd /usr/java/ # wget –no-cookies –no-check-certificate –header “Cookie: gpw_e24=http%3A%2F%2Fwww.oracle.com%2F; oraclelicense=accept-securebackup-cookie” “http://download.oracle.com/otn-pub/java/jdk/8u144-b15/jdk-8u144-linux-x64.tar.gz” # tar xzf jdk-8u144-linux-x64.tar.gz   2.Install java with Alternatives # cd /usr/java # alternatives … Continue reading Spark2, PySpark and Jupyter installation and configuration

Unable to view job logs with error user, [Dr. Who] is not authorized to view the log

ISSUE: Unable to see logs via Resource Manager UI due to incorrect permissions for the default user dr.who in ACL enabled clusters SOLUTION: Add/change  the below property in core-site.xml to solve the issue. Other values such as hdfs or mapred will also solve the issue. hadoop.http.staticuser.user=yarn


Enabling the Oozie Web Console

While accessing oozie console it show the below error ========== Oozie web console is disabled. To enable oozie web console install the Ext JS library ========= Follow the steps below to solve this in cloudera distribution   Download ext-2.2.zip  from https://archive.cloudera.com/gplextras/misc/ext-2.2.zip and Extract the contents of the file to /var/lib/oozie/ on the same host as … Continue reading Enabling the Oozie Web Console


Using cloudera API to view the service configurations such as password

Using Cloudera API we can view the configurations of the hadoop  services. For example to view the hive metastore password use the command as below #curl -u cm_username:cm_password "http://cloudera_manager:7180/api/v14/clusters/cluster_name/services/hive/config" We can see this information directly in browser by accessing the link  http://cloudera_manager:7180/api/v14/clusters/cluster_name/services/hive/config directly. You should know the CM admin login