{"id":7642,"date":"2024-05-31T17:51:36","date_gmt":"2024-06-01T00:51:36","guid":{"rendered":"https:\/\/ioflood.com\/blog\/?p=7642"},"modified":"2024-05-31T17:51:36","modified_gmt":"2024-06-01T00:51:36","slug":"install-etcd-linux","status":"publish","type":"post","link":"https:\/\/ioflood.com\/blog\/install-etcd-linux\/","title":{"rendered":"Etcd Quickstart Guide | Installation and Usage on Linux"},"content":{"rendered":"
\n
\"Depiction<\/figure>\n<\/div>\n

Enhancing system reliability and fault tolerance on Linux servers at IOFLOOD<\/a> is important to maintain the infrastructure of our customer’s dedicated servers<\/a>. While working to improve our systems, we have found that installing etcd alleviates the process of managing shared configuration data and coordinating distributed applications. This article aims to share our tips and processes so that others may implement a resilient and highly available distributed key-value store.<\/p>\n

In this guide, we will navigate the process of installing etcd<\/code> on your Linux system.<\/strong> We are going to provide you with installation instructions for Debian, Ubuntu, CentOS, and AlmaLinux, delve into how to compile etcd<\/code> from the source, and install a specific version. Finally, we will show you how to use the etcd<\/code> command and ascertain that the correctly installed version is in use.<\/p>\n

Let’s get started with the step-by-step etcd installation on your Linux system!<\/p>\n

TL;DR: How Do I Install etcd on Linux?<\/h2>\n

\n You can install etcd<\/code> on Linux by downloading the latest release from GitHub. You can extract the downloaded file using the command tar -xvf etcd-vX.Y.Z-linux-amd64.tar.gz<\/code>. After extraction, move the etcd<\/code> and etcdctl<\/code> binaries to \/usr\/local\/bin<\/code> using the command sudo mv etcd etcdctl \/usr\/local\/bin\/<\/code>.\n<\/p><\/blockquote>\n

# Download the latest release\nwget https:\/\/github.com\/etcd-io\/etcd\/releases\/download\/v3.5.0\/etcd-v3.5.0-linux-amd64.tar.gz\n\n# Extract the tarball\ntar -xvf etcd-v3.5.0-linux-amd64.tar.gz\n\n# Move the binaries\nsudo mv etcd-v3.5.0-linux-amd64\/etcd* \/usr\/local\/bin\/\n\n# Verify the installation\netcd --version\n\n# Output:\netcd Version: 3.5.0\nGit SHA: Not provided (use .\/build instead)\nGo Version: go1.16.3\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
This is a basic way to install etcd<\/code> on Linux, but there’s much more to learn about installing and using etcd<\/code>. Continue reading for more detailed information and advanced usage scenarios.<\/p>\n
How to Install etcd on Linux<\/h2>\n
Etcd is a distributed key-value store that provides a reliable way to store data across a cluster of machines. It\u2019s primarily used in distributed systems to hold and manage configuration details and service discovery. It is a core component in Kubernetes for storing and replicating all cluster data.<\/p>\n
Now, let’s get into how to install etcd on Linux using different package managers.<\/p>\n
Installing etcd using APT<\/h3>\n
For Debian-based systems like Ubuntu, we use the Advanced Packaging Tool (APT) to install etcd. Here’s a step-by-step guide:<\/p>\n
# Update your system\nsudo apt-get update\n\n# Install etcd\nsudo apt-get install etcd-server\n\n# Verify the installation\netcd --version\n\n# Output:\netcd Version: 3.2.26\nGit SHA: 8cb03b6\nGo Version: go1.10.4\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
This will install etcd on your Linux system and you can verify its installation by checking the version.<\/p>\n
Installing etcd using YUM<\/h3>\n
For RHEL-based systems like CentOS or AlmaLinux, we use the Yellowdog Updater, Modified (YUM) to install etcd. Here’s a step-by-step guide:<\/p>\n
# Update your system\nsudo yum update\n\n# Install etcd\nsudo yum install etcd\n\n# Verify the installation\netcd --version\n\n# Output:\netcd Version: 3.3.11\nGit SHA: 2fb27896e\nGo Version: go1.10.3\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
This will install etcd on your Linux system and you can verify its installation by checking the version. Remember, the version might differ based on the repository of your Linux distribution.<\/p>\n
Installing etcd using DNF<\/h3>\n
For Fedora-based systems, we use the Dandified YUM (DNF) to install etcd. Here’s a step-by-step guide:<\/p>\n
# Update your system\nsudo dnf update\n\n# Install etcd\nsudo dnf install etcd\n\n# Verify the installation\netcd --version\n\n# Output:\netcd Version: 3.3.10\nGit SHA: 27fc7e2\nGo Version: go1.11.2\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
This will install etcd on your Linux system and you can verify its installation by checking the version. Remember, the version might differ based on the repository of your Linux distribution.<\/p>\n
Installing etcd from Source Code<\/h2>\n
If you prefer to install etcd directly from its source code, you can do so by cloning the etcd repository and building it using Go. This method requires Go to be installed on your system.<\/p>\n
Here’s how you can do it:<\/p>\n
# Install Go\nsudo apt install golang\n\n# Verify Go installation\ngo version\n\n# Output:\ngo version go1.16.3 linux\/amd64\n\n# Clone the etcd repository\ngit clone https:\/\/github.com\/etcd-io\/etcd.git\n\n# Switch to the etcd directory\ncd etcd\n\n# Build etcd\nmake\n\n# Verify the installation\nbin\/etcd --version\n\n# Output:\netcd Version: 3.5.0\nGit SHA: Not provided (use .\/build instead)\nGo Version: go1.16.3\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
Installing Different Versions of etcd<\/h2>\n
Different versions of etcd can be installed depending on your requirements. You might need to install a specific version due to software compatibility, feature availability, or stability reasons.<\/p>\n
Installing Specific Versions from Source<\/h3>\n
You can checkout to a specific version of etcd using git and then build it. Here’s an example of how to install version 3.3.10:<\/p>\n
cd etcd\n\ngit checkout v3.3.10\n\nmake\n\nbin\/etcd --version\n\n# Output:\netcd Version: 3.3.10\nGit SHA: 27fc7e2\nGo Version: go1.10.3\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
Installing Specific Versions using Package Managers<\/h3>\n
You can also install a specific version of etcd using package managers like apt and yum. However, the available versions might be limited based on the repository of your Linux distribution.<\/p>\n
Using apt<\/h4>\n
sudo apt install etcd-server=3.2.26\n\netcd --version\n\n# Output:\netcd Version: 3.2.26\nGit SHA: 8cb03b6\nGo Version: go1.10.4\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
Using yum<\/h4>\n
sudo yum install etcd-3.3.11\n\netcd --version\n\n# Output:\netcd Version: 3.3.11\nGit SHA: 2fb27896e\nGo Version: go1.10.3\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
Version Comparison<\/h3>\n
Different versions of etcd come with their own set of features, improvements, and bug fixes. Here’s a brief comparison:<\/p>\n\n\n\n\n\n\n\n\n
Version<\/th>\nKey Features<\/th>\nGo Version<\/th>\n<\/tr>\n<\/thead>\n
3.2.26<\/td>\nStable, widely used<\/td>\ngo1.10.4<\/td>\n<\/tr>\n
3.3.11<\/td>\nImproved performance, added features<\/td>\ngo1.10.3<\/td>\n<\/tr>\n
3.3.10<\/td>\nImproved performance, added features<\/td>\ngo1.11.2<\/td>\n<\/tr>\n
3.5.0<\/td>\nLatest, comes with the newest features and improvements<\/td>\ngo1.16.3<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
Basic Usage of etcd<\/h2>\n
Once you’ve installed etcd, you can start using it. Here are some basic commands to get you started:<\/p>\n
Using etcd<\/h3>\n
# Start etcd\netcd\n\n# Output:\n2021-09-30 10:43:09.276629 I | etcdmain: etcd Version: 3.2.26\n2021-09-30 10:43:09.276663 I | etcdmain: Git SHA: 8cb03b6\n2021-09-30 10:43:09.276669 I | etcdmain: Go Version: go1.10.4\n2021-09-30 10:43:09.276674 I | etcdmain: Go OS\/Arch: linux\/amd64\n2021-09-30 10:43:09.276680 I | etcdmain: setting maximum number of CPUs to 4, total number of available CPUs is 4\n<\/code><\/pre>\n
This command starts etcd. You’ll see logs that indicate etcd is running.<\/p>\n
Verifying the Installation<\/h3>\n
You can verify the installation of etcd by checking its version:<\/p>\n
etcd --version\n\n# Output:\netcd Version: 3.2.26\nGit SHA: 8cb03b6\nGo Version: go1.10.4\nGo OS\/Arch: linux\/amd64\n<\/code><\/pre>\n
This command will display the installed version of etcd along with the Go version used to build it.<\/p>\n
Installing etcd with Docker<\/h2>\n
Docker provides an alternative method to install etcd. It’s a platform that allows you to automate the deployment, scaling, and management of applications using containerization. Here’s how you can install etcd using Docker:<\/p>\n
# Pull the latest etcd image\nsudo docker pull quay.io\/coreos\/etcd\n\n# Run an etcd container\nsudo docker run -d -p 2379:2379 -p 2380:2380 --name etcd quay.io\/coreos\/etcd\n\n# Verify the installation\nsudo docker exec etcd \/bin\/sh -c \"ETCDCTL_API=3 etcdctl version\"\n\n# Output:\netcdctl version: 3.5.0\nAPI version: 3.5\n<\/code><\/pre>\n
This will pull the latest etcd image from Docker Hub and run it in a new container. You can verify the installation by checking the version of etcd inside the container.<\/p>\n
Installing etcd with Kubernetes<\/h2>\n
Kubernetes is an open-source platform for managing containerized applications. If you’re running a Kubernetes cluster, you can install etcd using a Kubernetes Deployment or a StatefulSet. Here’s an example of how to install etcd using a Kubernetes Deployment:<\/p>\n
# Create a deployment.yaml file\n\ncat <<EOF > deployment.yaml\napiVersion: apps\/v1\nkind: Deployment\nmetadata:\n  name: etcd\nspec:\n  replicas: 1\n  selector:\n    matchLabels:\n      app: etcd\n  template:\n    metadata:\n      labels:\n        app: etcd\n    spec:\n      containers:\n      - name: etcd\n        image: quay.io\/coreos\/etcd\n        ports:\n        - containerPort: 2379\nEOF\n\n# Create the Deployment\nkubectl apply -f deployment.yaml\n\n# Verify the Deployment\nkubectl get pods -l app=etcd\n\n# Output:\nNAME                    READY   STATUS    RESTARTS   AGE\netcd-7b8f6d49f7-qw4k7   1\/1     Running   0          1m\n<\/code><\/pre>\n
This will create a Kubernetes Deployment that runs an etcd container. You can verify the Deployment by checking the status of the pod.<\/p>\n
Comparison of Installation Methods<\/h2>\n
Different methods of installing etcd have their own advantages and disadvantages. Here’s a brief comparison:<\/p>\n\n\n\n\n\n\n\n\n
Method<\/th>\nAdvantages<\/th>\nDisadvantages<\/th>\n<\/tr>\n<\/thead>\n
Package Manager<\/td>\nEasy, quick, managed by the system<\/td>\nLimited versions, not always up-to-date<\/td>\n<\/tr>\n
Source Code<\/td>\nLatest version, more control<\/td>\nRequires Go, more steps<\/td>\n<\/tr>\n
Docker<\/td>\nIsolated, easy to manage and update<\/td>\nRequires Docker, not as integrated with the system<\/td>\n<\/tr>\n
Kubernetes<\/td>\nScalable, managed by Kubernetes<\/td>\nRequires Kubernetes, more complex<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
Choose the method that best fits your needs and environment. If you’re just getting started with etcd, using a package manager might be the easiest option. If you need the latest version or more control, installing from source code might be better. If you’re using Docker or Kubernetes, installing etcd using these platforms could provide additional benefits.<\/p>\n
Common etcd Install Issues<\/h2>\n
While installing etcd on Linux, you might encounter some common issues. Here, we discuss these issues and provide solutions to ensure a smooth installation process.<\/p>\n
Issue: Unable to Locate Package<\/h3>\n
This error occurs when the package manager can’t find the etcd package in its repositories. Here’s an example of this error:<\/p>\n
sudo apt install etcd-server\n\n# Output:\nReading package lists... Done\nBuilding dependency tree\nReading state information... Done\nE: Unable to locate package etcd-server\n<\/code><\/pre>\n
Solution:<\/strong> Update your package manager’s repository and try again. If the issue persists, consider adding a repository that contains the etcd package.<\/p>\n
Issue: Incorrect etcd Version<\/h3>\n
Sometimes, you might find that the installed version of etcd is not what you expected. This could be due to the package manager installing an outdated version, or you might have multiple versions of etcd installed.<\/p>\n
Solution:<\/strong> Check the version of etcd using etcd --version<\/code>. If it’s not the version you want, consider installing etcd from source or using Docker to get the specific version you need.<\/p>\n
Issue: etcd Service Not Starting<\/h3>\n
After installing etcd, you might encounter issues with starting the etcd service. This could be due to various reasons, such as incorrect configuration or port conflicts.<\/p>\n
Solution:<\/strong> Check the status of the etcd service using systemctl status etcd<\/code>. Look at the logs to identify any issues. Ensure that the ports etcd uses (typically 2379 and 2380) are not being used by other services.<\/p>\n
Considerations for Using etcd<\/h2>\n
When using etcd, there are several considerations to keep in mind:<\/p>\n
    \n
  1. Security:<\/strong> etcd stores sensitive data, so it’s crucial to secure your etcd installation. Consider using SSL\/TLS for client-server communication and peer-to-peer communication.<\/p>\n<\/li>\n
  2. \n
    Backup:<\/strong> Regularly back up your etcd data to prevent data loss. You can use the etcdctl snapshot save<\/code> command to create a snapshot of the etcd data.<\/p>\n<\/li>\n
  3. \n
    Performance:<\/strong> Monitor the performance of etcd using metrics exposed by the etcd server. You can use tools like Prometheus and Grafana for this purpose.<\/p>\n<\/li>\n
  4. \n
    Updates:<\/strong> Regularly update etcd to benefit from the latest features and security updates. However, ensure to test the updates in a non-production environment first.<\/p>\n<\/li>\n<\/ol>\n
    What are Distributed Key-Value Stores<\/h2>\n
    Before diving deeper into the usage of etcd, it’s important to understand the concept of distributed key-value stores and their importance in system administration.<\/p>\n
    A key-value store is a simple database that uses an associative array as the fundamental data model where each key is associated with one and only one value in a collection. This data structure is designed to store, retrieve, and manage associative arrays.<\/p>\n
    # Example of a key-value pair\n\nKey: 'Username'\nValue: 'admin'\n<\/code><\/pre>\n
    In this example, ‘Username’ is the key and ‘admin’ is the value. This pair can be stored in a key-value store and retrieved using the key.<\/p>\n
    A distributed key-value store extends this concept across multiple machines, ensuring that the data is always available even if a single machine fails. This is achieved through data replication and partitioning.<\/p>\n
    # Example of data replication in a distributed key-value store\n\nMachine 1:\nKey: 'Username'\nValue: 'admin'\n\nMachine 2:\nKey: 'Username'\nValue: 'admin'\n<\/code><\/pre>\n
    In this example, the same key-value pair is stored on two different machines. If Machine 1 fails, the data can still be retrieved from Machine 2.<\/p>\n
    System Administration and etcd<\/h2>\n
    Etcd plays a crucial role in system administration as a distributed key-value store. It is used to hold and manage configuration details and service discovery, making it an essential component in distributed systems.<\/p>\n
    Etcd provides a reliable way to store data across a cluster of machines. This data is accessible to all nodes in the cluster, which makes etcd a great choice for implementing distributed systems coordination primitives like leader election, distributed locks, and distributed barriers.<\/p>\n
    Etcd is also used by Kubernetes as a backing store for all cluster data. It’s the place where Kubernetes stores all its cluster state, including the configuration data of the cluster, the state of the system, and the metadata about the deployed applications.<\/p>\n
    In conclusion, understanding the concept of distributed key-value stores and their implementation in etcd is crucial for effective system administration. This knowledge forms the basis for installing and using etcd on Linux, which we will explore in the following sections.<\/p>\n
    Practical Uses of Key-Value Stores<\/h2>\n
    Distributed key-value stores like etcd are not just for system administration. They play a pivotal role in the architecture of large-scale applications. The ability to store, retrieve, and manage data across a cluster of machines makes them a powerful tool for maintaining consistency and high availability.<\/p>\n
    Data Replication and Consistency<\/h3>\n
    One of the key advantages of distributed key-value stores is data replication. By storing the same data on multiple machines, they ensure that the data remains available even if one machine fails. This is crucial for large-scale applications that need to be up and running 24\/7.<\/p>\n
    # Example of data replication in a distributed key-value store\n\nMachine 1:\nKey: 'Username'\nValue: 'admin'\n\nMachine 2:\nKey: 'Username'\nValue: 'admin'\n<\/code><\/pre>\n
    In this example, the same key-value pair is stored on two different machines. If Machine 1 fails, the data can still be retrieved from Machine 2.<\/p>\n
    However, data replication also raises the issue of consistency. If the data is updated on one machine, it needs to be updated on all the other machines as well. This is where etcd shines. It uses the Raft consensus algorithm to ensure that the data remains consistent across all machines.<\/p>\n
    Exploring Related Concepts<\/h3>\n
    If you’re interested in learning more about distributed systems and key-value stores, you might want to explore related concepts like data partitioning, consensus algorithms, and distributed transactions. These concepts provide a deeper understanding of how distributed systems work and how they maintain consistency and availability.<\/p>\n
    Further Resources for Mastering etcd<\/h3>\n
    There are many resources available online to learn more about etcd and distributed key-value stores. Here are a few recommendations:<\/p>\n
      \n
    1. CoreOS etcd GitHub Repository<\/a>: The official GitHub repository of etcd where you can find the source code, issues, and discussions related to etcd.<\/p>\n<\/li>\n
    2. \n
      etcd Documentation<\/a>: The official documentation of etcd provides a comprehensive guide on how to install, use, and troubleshoot etcd.<\/p>\n<\/li>\n
    3. \n
      Distributed systems for fun and profit<\/a>: This book provides a great introduction to distributed systems, including key-value stores and consensus algorithms.<\/p>\n<\/li>\n<\/ol>\n
      Recap: etcd Linux Quickstart<\/h2>\n
      In this comprehensive guide, we’ve explored the ins and outs of installing and using etcd, a distributed key-value store, on Linux systems. We’ve delved deep into the world of distributed key-value stores, discussing the role of etcd in system administration and its importance in large-scale applications.<\/p>\n
      We began with the basics, guiding you through the process of installing etcd on Linux using a package manager. We then ventured into more advanced territory, demonstrating how to install etcd from source code, and how to install specific versions of etcd. We also discussed how to use etcd, providing you with basic commands to get started.<\/p>\n
      Moving further, we explored alternative approaches to installing etcd, such as using Docker and Kubernetes. We also discussed common issues you might encounter when installing and using etcd and provided solutions to help you overcome these challenges.<\/p>\n
      Here’s a quick comparison of the installation methods we’ve discussed:<\/p>\n\n\n\n\n\n\n\n\n
      Method<\/th>\nAdvantages<\/th>\nDisadvantages<\/th>\n<\/tr>\n<\/thead>\n
      Package Manager<\/td>\nEasy, quick, managed by the system<\/td>\nLimited versions, not always up-to-date<\/td>\n<\/tr>\n
      Source Code<\/td>\nLatest version, more control<\/td>\nRequires Go, more steps<\/td>\n<\/tr>\n
      Docker<\/td>\nIsolated, easy to manage and update<\/td>\nRequires Docker, not as integrated with the system<\/td>\n<\/tr>\n
      Kubernetes<\/td>\nScalable, managed by Kubernetes<\/td>\nRequires Kubernetes, more complex<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
      Whether you’re just starting out with etcd or you’re looking to level up your system administration skills, we hope this guide has given you a deeper understanding of etcd and its capabilities.<\/p>\n
      With its efficient management of key-value pairs and its crucial role in distributed systems, etcd is a powerful tool for system administration. Now, you’re well equipped to install and use etcd on Linux. Happy coding!<\/p>\n","protected":false},"excerpt":{"rendered":"
      Enhancing system reliability and fault tolerance on Linux servers at IOFLOOD is important to maintain the infrastructure of our customer’s dedicated servers. While working to improve our systems, we have found that installing etcd alleviates the process of managing shared configuration data and coordinating distributed applications. This article aims to share our tips and processes […]<\/p>\n","protected":false},"author":1,"featured_media":20808,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-7642","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-linux","cat-3-id","has_thumb"],"_links":{"self":[{"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/posts\/7642","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/comments?post=7642"}],"version-history":[{"count":11,"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/posts\/7642\/revisions"}],"predecessor-version":[{"id":20699,"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/posts\/7642\/revisions\/20699"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/media\/20808"}],"wp:attachment":[{"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/media?parent=7642"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/categories?post=7642"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ioflood.com\/blog\/wp-json\/wp\/v2\/tags?post=7642"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}