Big data cluster service CDH startup and shutdown sequence

Original link: https://chegva.com/5781.html

I just finished relocating the computer room recently, and I am busy continuing to relocate the big data Hadoop cluster. This cluster has been running online for more than five years, and two or three waves of people have been changed in the middle. There is no way to do it. I stepped on many pits in the middle and encountered many problems. Fortunately, it is nearing the end.

The old online cluster uses CDH 5.14, so you have to take it easy when you shut down and go offline. It will be offline next week, and this week, the overall resources and shutdown plan of the old cluster will be adjusted.

CDH start and stop sequence:

First, stop all applications and jobs to make sure there are no running tasks in the cluster.

Stop:

1 .cm web

a.stop Cluster1 stops the Cluster cluster service

b.stop Cloudera Management Service Stop CM service

2.stop agent and server Stop the Agent on each node, and then stop the Server on the master node

3. stop cm database

The startup sequence is just the opposite:

Start:

1.start cm database

2.start server and agent wait for the server to get up and then start the agent

3. cm web

a. start Cluster1

b. start Cloudera Management Service

If the web interface appears, host and other chart information are read incorrectly, then manually restart Cluster1 or Cloudera Management Service

NN expansion ideas:

1. Stop the service on the standby node NN1 → shut down → expand related resources → start the machine → restart the service → confirm whether the synchronization status of various services on the standby node is normal (wait for a while)

2. Manually switch the active node NN2 to the standby state (NN1 will switch to the active state) → stop the service on NN2 → shut down → expand related resources → start the machine → restart the service → confirm whether the synchronization status of various services on the node is normal

refer to:

This article is transferred from: https://chegva.com/5781.html
This site is only for collection, and the copyright belongs to the original author.