Smartetx

Hi, I am Ethan. This is my note.

amisartifactsAWSCDNCICDData InfrastructureDBgitlabgolangkubernetesLinuxMongoDBObservability

etcd install
etcd install

https://etcd.io/docs/v3.6/install/ Install pre-built binaries Download the compressed archive file for your platform from Releases ETCD_VER=v3.6.6 # choose either URL GOOGLE_URL=https://storage.googleapis.com/etcd GITHUB_URL=https://github.com/etcd-io/etcd/releases/download DOWNLOAD_URL=${GOOGLE_URL} curl -L ${DOWNLOAD_URL}/${ETCD_VER}/etcd-${ETCD_VER}-linux-amd64.tar.gz -o /tmp/etcd-${ETCD_VER}-linux-amd64.tar.gz Unpack the archive file. This results in a directory containing the binaries. tar xvf etcd-${ETCD_VER}-linux-amd64.tar.gz Add the executable binaries to your path. For example, rename and/or move the... » read more

0
Read
ethan
AWS ECR Token auto-refresh
AWS ECR Token auto-refresh

1. Issue AWS ECR authentication tokens are valid for 12 hours. After expiration, you need to re-execute docker login or aws ecr get-login-password. 2. Solution Use ECR Credential Helper to automatically call the AWS API to obtain the latest token when Docker pulls an image. Applicable scenarios: Development machines, CI/CD, servers, and any environment with... » read more

0
Read
ethan
NATS Server Setup and Clustering
NATS Server Setup and Clustering

Install a NATS Server on Debian/Ubuntu refer to: Installing, running a NATS Server Create the user nats sudo useradd nats -r -s /sbin/nologin Download NATS binary curl -fsSL https://binaries.nats.dev/nats-io/nats-server/v2@v2.11.6 | sh Add NATS to /usr/local/sbin sudo mv nats-server /usr/local/sbin/ Add NATS to systemd Create /etc/nats-server.conf. No need to add content to it, since it is... » read more

0
Read
ethan
Loki Configure: S3 Single Store
Loki Configure: S3 Single Store

Loki v3.5.x install using APT Add the Grafana Advanced Package Tool (APT) or RPM Package Manager (RPM) package repository following the linked instructions. Install Loki apt-get update apt-cache madison loki apt-get install loki=3.5.8 S3 Single Store config.yaml auth_enabled: true # true, multi-tenant mode server: http_listen_port: 3100 grpc_listen_port: 9096 log_level: info grpc_server_max_concurrent_streams: 1000 common: #instance_addr: 127.0.0.1... » read more

0
Read
ethan
Loki Architecture
Loki Architecture

Architecture Reference Documentation: https://grafana.com/blog/2018/12/12/loki-prometheus-inspired-open-source-logging-for-cloud-natives/ Distributor Once promtail collects and sends the logs to Loki, the distributor is the first component to receive them. Now we could be receiving millions of writes per second and we wouldn’t want to write them to a database as they come in. That would kill any database out there. We... » read more

0
Read
ethan
gitlab Job Artifacts AND Runners
gitlab Job Artifacts AND Runners

Prerequisite: You have a GitLab account deployed on an AWS EC2 instance and have the necessary permissions to manage it. Enable Job Artifacts and use an S3 bucket ### Job Artifacts # gitlab_rails['artifacts_enabled'] = true # gitlab_rails['artifacts_path'] = "/var/opt/gitlab/gitlab-rails/shared/artifacts" ###! Job artifacts Object Store###! Docs: https://docs.gitlab.com/ee/administration/job_artifacts.html#using-object-storage # gitlab_rails['artifacts_object_store_enabled'] = false # gitlab_rails['artifacts_object_store_proxy_download'] = false #... » read more

2
Read
ethan
Go语言中的迭代器和 iter 包
Go语言中的迭代器和 iter 包

很多流行的编程语言中都以某种方式提供迭代器，其中包括 C++、Java、Javascript、Python 和 Rust。Go 语言现在也加入了迭代器。iter 包是 Go 1.23 新增的标准库，提供了迭代器的基本定义和相关操作。 为什么需要迭代器 在 Go 1.18 引入泛型之后，便可以很方便的定义一些泛型容器类型来提升编码效率。 例如我们可以基于 map 类型定义了一个集合类型—— Set。 // Set 基于 map 定义一个存放元素的集合类型 type Set[E comparable] struct { m map[E]struct{} } // NewSet 返回一个 Set func NewSet[E comparable]() *Set[E] { return &Set[E]{m: make(map[E]struct{})} } // Add 向 Set 中添加元素 func (s *Set[E]) Add(v E) {... » read more

0
Read
ethan
Elasticsearch single node deployment
Elasticsearch single node deployment

1. install es Install with Debian package configuring es elasticsearch.yaml: cluster.name: es-test node.name: es-test-1 node.roles: [ master, data ] path.data: /var/lib/elasticsearch path.logs: /var/log/elasticsearch # Lock the memory on startup: bootstrap.memory_lock: true network.host: 172.20.133.158 discovery.type: single-node Systemd configuration [Service] LimitMEMLOCK=infinity reload units: sudo systemctl daemon-reload 2. Reset user password Reset the elastic superuser password /usr/share/elasticsearch/bin/elasticsearch-reset-password -u... » read more

0
Read
ethan
Preventing broken connections during pod shut-down
Preventing broken connections during pod shut-down

Ensuring all client requests are handled properly You now have a good sense of how to make pods shut down cleanly. Now, we’ll look at the pod’s lifecycle from the perspective of the pod’s clients (clients consuming the service the pod is providing). This is important to understand if you don’t want clients to run... » read more

2
Read
ethan
The Kubernetes termination lifecycle
The Kubernetes termination lifecycle

The Kubernetes termination lifecycle Once Kubernetes has decided to terminate your pod, a series of events takes place. Let’s look at each step of the Kubernetes termination lifecycle. The container termination sequence 1 – Pod is set to the “Terminating” State and removed from the endpoints list of all Services At this point, the pod... » read more

0
Read
ethan