Hadoop Services Start and Stop Order

Hadoop Services Start and Stop Order

Common question while working on a Hadoop cluster is what is the order to start or stop services running in my cluster.

Many distributions provide their management tools which has options to “Start All” or “Stop All” services. However, when you want to work on the cluster manually or during some maintenance you might want to perform the starting and stopping of the services manually.

I am not going to be specific for any Hadoop distribution here. This will be generic for all Hadoop distributions.

Hadoop Services Start and Stop Order – Start Services

The following should be the order to start the services in a Hadoop cluster.

  • Knox
  • – Start Knox first, if you have it installed.

  • ZooKeeper
  • – Start ZooKeeper on all the ZooKeerp hosts.

  • HDFS
  • In non-HA mode:

    – Start Namenode.
    – Start Secondary Namenode.
    – Start Datanode.

    In HA mode:

    – Start Journalnode on Journalnode hosts.
    – Start Namenode.
    – Start Standby Namenode.
    – Start ZKFC.
    – Start Datanode.

  • YARN
  • – Start ResourceManager on ResourceManager host.
    – Start History Server on Job History Server host machine.
    – Start NodeManagers on hosts which are part of YARN Cluster.

  • HBASE
  • – Start HBase Master
    – Start the RegionServer on all the RegionServer hosts.

  • Hive
  • – Start Hive MetaStore Service.
    – Start HiveServer2.

  • WebHCat
  • – Start WebHCat.

  • Oozie
  • – Start Oozie server on host running Oozie.

  • Storm
  • – Start Storm

  • Kafka
  • – Start Kafka.

  • Hue
  • – Safe to start Hue now.

    Hadoop Services Start and Stop Order – Stop Services

    The following should be the order to stop the services in a Hadoop cluster.

  • Hue
  • – Stop hue.

  • Knox
  • – Stop Knox.

  • Oozie
  • – Stop the Oozie server.

  • WebHCat
  • – Stop WebHCat Services.

  • Hive
  • – Stop HiveServer2
    – Stop Hive MetaStore Service.

  • HBASE
  • – Stop all RegionServers for HBase.
    – Stop HBase Master service.

  • YARN
  • – Stop NodeManager on all Nodemanager hosts.
    – Stop JobHistory Server
    – Stop ResourceManager on Resourcemanager host.

  • HDFS
  • In non-HA mode:

    – Stop Datanodes.
    – Stop Secondary Namenode.
    – Stop Namenode.

    In HA mode:

    – Stop Datanodes.
    – Stop ZKFC.
    – Stop Standby Namenode.
    – Stop Namenode.
    – Stop Journalnodes.

  • ZooKeeper
  • – Stop ZooKeeper on all Zookeeper hosts.

  • Storm
  • – Stop Storm.

  • Kafka
  • – Stop Kafka.

    Hadoop Services Start and Stop Order

    No Comments

    Post a Comment

    Time limit is exhausted. Please reload CAPTCHA.