AWS provides Elasticsearch service along with Kibana which makes developer’s work easy and simple. This article will guide on how to provision an AWS ElasticSearch Service and connect with an EKS cluster for log monitoring.

Photo by Andrea Piacquadio from Pexels

Article content

  1. Provision the ES Cluster
  2. Configure Fluent-Bit in EKS
  3. Deploy Fluent-bit
  4. Access Kibana Dashboard

Introduction to Elasticsearch Service

Elasticsearch can be installed on-premise, on Amazon EC2 or AWS Elasticsearch service. When you install Elasticsearch on-premise or on Amazon EC2, you have to be responsible for installing, provision infrastructure and managing the cluster. But with AWS Elasticsearch amazon takes care of everything. It is a fully managed service.

Along with Elasticsearch, AWS provides Kibana. It is deployed automatically with your Elasticsearch Domain as a fully managed service, automatically taking care of all the heavy lifting to manage the cluster.

AWS provides two types of endpoints in…

Google Artifact Registry is a container registry service provided by Google Cloud for developers to store, manage, and secure their build artifacts. It helps to manage container images and language packages (such as Maven and npm). This article will guide you on how to manage helm charts in Google Artifact Registry.

Artifact Registry is not just a repository to store and manage Kubernetes artifacts or images like the GCR. It also supports Maven, npm, and Apt, language packages. So, developers can easily store them in a private or public repository. It is very easy and simple to create and publish artifacts.

In this article, we will discuss how to manage Helm charts with Google Artifact Registry. Helm is a tool that helps you to manage Kubernetes applications. Helm Charts help you define, install, and upgrade even the most complex Kubernetes application. Charts are easy to create, version, share, and publish. Helm…

Helm is a Kubernetes package managing tool, widely using in the industry. Developers can create Kubernetes packages with Helm and install in repositories same as docker images. So, whenever developers want to install the package, you can simply pull the chart from the repository and proceed.

In Docker, we build docker images and store them in a remote repository such as Docker Hub, GCR or ECR. Same with Helm you can generate Kubernetes packages with Helm called Charts. These charts can package into archive (tgz) files and store them in a remote or local repository.

There are 03 main components in Helm.

  1. Chart — a bundle of information necessary to create an instance of a Kubernetes application
  2. Config — contains configuration information that can be merged into a packaged chart to create a releasable object
  3. Release — a running instance of a chart, combined with a…

Google Cloud (GCloud) provides 100+ features, which makes developers’ work easy and simple. In this article, we are going to talk about how to work with Google Container Registry (GCR). At the end of this tutorial, you will learn how to configure GCR and publish docker images.

Most of the time, developers store their docker images in the Docker Hub. If you are working on a project and you have private images that need to be stored in a private place, most of the time developers configure a nexus server and store it there.

But Google Cloud’s GCR is a perfect solution to this problem. With GCR, you can store, manage, and secure your Docker container images easily. All you want is a service account with proper access permission. GCR is not just a docker repository. …

Kubevious is a new tool used in Kubernetes, which makes developers’ work easy with a dashboard. It is an ongoing open-source project This article is a quick introduction to Kubevious.

We all have exercised to use the terminal when interacting with Kubernetes. Kubevious is a tool that helps to visualize all the resources in a Kubernetes cluster. As in the above picture, we can simply check a number of namespaces, applications, pods, nodes, and many other details used in the Kubernetes cluster. This makes developers work easier and interactive.

The most important thing in this tool is, it can be installed in the cluster easily with simple 3 steps. Kubevious can be installed using helm.

First, you need to have helm installed in your local machine. …

Hey folks, welcome back with a new chapter of the Kubernetes for Beginners tutorial series. In the last article, we discussed Kubernetes config maps, and today we are going to discuss Kubernetes Secrets.

Photo by Life Of Pix from Pexels

When we develop applications, we keep our passwords and other sensitive data such as usernames, keys etc secured. Security is one of the main factors we need to consider when developing enterprise applications. Most of the time developers encode and save them. In the last article, we discussed how to move variables into a ConfigMap and store them. But the issue is these values are stored there in a plain text mode. This is definitely not the best method to store a password.

So, there come Kubernetes secrets. Secrets are used to store sensitive data. …

Hello all, welcome back to Kubernetes for Beginners tutorial series. So far we learned to deploy and expose Kubernetes pods and configure environmental variables to them. In this tutorial, we will discuss how to use configuration data in Kubernetes.

Photo by cottonbro from Pexels

In the last article, we discuss how to use environmental variables in Kubernetes definition files. Now, we will see how to use a separate configuration file to manage environmental data. ConfigMaps are used to store these environmental configuration data in Kubernetes. It is a file in the form of key value pair. After configuring the configMap, you need to inject it into the pod definition in Kubernetes. So, the configuration data in the configMap file will be available as environmental variables in the application hosted inside the container in the pod.

Below is a code snippet copied from the previous…

AWS is a trending cloud platform used in the industry. This series is for beginners to learn AWS from zero. Last article we discussed AWS messaging and queueing services. This article will discuss how to choose the perfect region for your AWS deployments.

Photo by slon_dot_pics from Pexels

When running applications in your own data centers you need to have proper disaster recovery techniques. Having a duplicate second datacenter is one method for disaster recovery. But when working enterprise-level, maintaining a second datacenter cost a lot.

AWS provides a cost-effective solution for this issue. AWS has large datacenter groups named “Region”. An AWS region is build to be closest to the business traffic demand. Each region is connected with high-speed fiber networks controlled by AWS.

Every region is isolated from each other. In other terms, no data can go in or out from the datacenter unless granting permission…

AWS is one of the biggest cloud computing platform providers. This tutorial series is for beginners to AWS. In the last article, we discussed how to create an AWS EC2 instance and access it with your local machine terminal. Today we will cover two messaging and queueing services provided by AWS — Amazon Simple Notification Service (Amazon SNS) & Amazon Simple Queue Service (Amazon SQS)

Photo by Vlada Karpovich from Pexels

Let’s start with an example. You have a system with two services as worker and master. The worker sends messages to the master. The system works fine. Suddenly the master becomes unavailable to receive the messages from the worker. So, when the worker sends messages it waits for the master to show up, but as it is not available the worker start dropping the messages.

This happens because the master and worker have a tightly coupled architecture. A tightly coupled architecture means whenever one of the services fails, the entire system breaks down.

Hey folks, welcome back with the third article of the AWS Basics tutorial series. In the last article, we discussed AWS EC2 service and types of pricing methods. In this article, we will be covering methods of accessing AWS Console.

Photo by olia danilevich from Pexels

First, you go to the link and create an AWS account. If you already have an account you can log in to the console.

Nethmini Romina

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store