Configuring HDFS and YARN

To configure HDFS and YARN for your Kerberos integration of Team Studio, follow these steps.

Perform this task in the files core-site.xml , hadoop-policy.xml, and yarn-site.xml.

In the following tasks, When * is used as a value, it represents the most broad settings for each key-value pair. Whenever you see SERVICEUSER, replace that with the proper user name for your account (for example, johndoe).

Prerequisites

You must have write access to the configuration files on the computer where Team Studio server is installed.

Procedure

  1. Find and open for editing the file core-site.xml.
  2. Add the following properties to the core-site.xml .
    Remember to customize your SERVICEUSER accordingly. 
    <property>
<name>hadoop.proxyuser.SERVICEUSER.groups</name>
<value>*</value>
<description>* Allows the superuser <SERVICEUSER> to impersonate any members of any groups. Limit groups as desired by specifying a different value.</description>
</property>
<property>
<name>hadoop.proxyuser.SERVICEUSER.hosts</name>
<value>*</value>
<description>* Allows the superuser to connect from any hosts to impersonate a user. Limit hosts as desired by specifying a different value.</description>
</property>
<property>
<name>hadoop.security.authorization</name>
<value>true</value>
</property>
  3. Save your changes and close the file.
  4. Find and open for editing the file hadoop-policy.xml.
  5. Add the following properties to hadoop-policy.xml.
    Remember to customize your SERVICEUSER accordingly. 
    <property>
<name>security.job.submission.protocol.acl</name>
<value>yarn, mapreduce, SERVICEUSER</value>
<description>yarn, mapreduce, and SERVICEUSER are allowed to submit jobs. Specifying the "*" value would allow any user to submit jobs.</description>
</property>
<property>
<name>security.datanode.protocol.acl</name>
<value>*</value>
</property>
<property>
<name>security.client.protocol.acl</name>
<value>*</value>
</property>
  6. Save your changes and close the file.
  7. Find and open for editing the file yarn-site.xml.
  8. Add the following properties to yarn-site.xml. 
    <property>
<name>yarn.nodemanager.container-executor.class</name>
<value>org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor</value>
</property>
<property>
<name>yarn.nodemanager.linux-container-executor.group</name>
<value>yarn</value>
</property>
  9. Save your changes and close the file.
Related tasks