Page 4 - Gary' Blog

A script to test MySQL port is running

2023-05-03 116 Technical MySQL Leave a Comment

#!/bin/bash ip="<MySQL HOST>" port="<MySQL PORT>" output_file="<Log File Path>" while : do nc -zv "$ip" "$port" > /dev/null datetime=$(date +"%Y-%m-%d %H:%M:%S") if [ $? -eq 0 ]; then echo "$datetime: Port $port is open on $ip…

From PHP to Python In 10 Minutes

2023-04-11 186 Technical PHP, Python Leave a Comment

PHP and Python are both high-level, interpreted programming languages with a variety of applications, but they have some significant differences in terms of syntax, design philosophy, and use cases. Here's a detailed comparison of the two languages: 1. Purpose and Use Cases PHP: Created by Rasmus Lerdorf in 199…

How to compress mp4 in one command with ffmpeg

2023-03-28 118 Technical ffmpeg, mp4 Leave a Comment

With ffmpeg, we can create a free video compresser on our local machine. First, create a shell function on you .bashrc or .zshrc: function mp4-compress() { filename=$(basename -- "$1") extension="${filename##*.}" name="${filename%.*}" ffmpeg -i "$1" -vcodec libx265 -crf 2…

How to transfer data between different mongodb instance?

2023-03-25 81 Technical MongoDB Leave a Comment

Here is the python code to transfer data between different mongo instance: def transfer(source_collection, dest_collection, batch_size: int): offset = 0 total = source_collection.count_documents({}) total_inserted = 0 while True: documents = source_collection.find().skip(offset).limit(batch_size) data = list(do…

How to config logging output to file and stdio/console with basicConfig() in one line?

2023-03-22 131 Technical Python Leave a Comment

import logging logging.basicConfig(format='[%(asctime)s] [%(levelname)s] %(message)s', datefmt='%Y-%d-%m %I:%M:%S', level=logging.DEBUG, handlers=[logging.FileHandler('app.log'), logging.StreamHandler()])

Linux multiple threads download from file with wget

2023-03-20 554 Technical Linux, wget Leave a Comment

Assume we have a file that have all the urls to download. sed 's|^|https://data.commoncrawl.org/|' wet.paths | xargs -n 1 -P 15 wget --timeout=1800 --retry-connrefused --waitretry=10 -nc &

KeyCloak vs Authelia

2023-02-15 3.8k Technical Authelia, Keycloak Leave a Comment

Category Detailed KeyCloak Authelia Star Github 14,776 15,346 Technical Language Java Go Database for dev H2 (file and memory) SQLite Database MariaDB, MSSQL, MySQL,Oracle, PostgreSQL MySQL, PostgreSQL Cache for dev local Memory Cache Infinispan Redis Redis Sentinel Connections Protocols OpenID Connect, OAuth …

Special Character and Symbol Names on Keyboard

2023-02-03 119 Technical Leave a Comment

~: tilde `: push, open quote, left quote, grave, back quote !: bang, exclamation @: at #: hash, sharp $: dolor %: percent ^: caret, circumflex &: and *: star, asterisk (: left parenthesis ): right parentthesis -: dash, hyphen, minus _: underscore +: plus =: equal {: curly bracket, open brace }: curly brack…

How to assert if Python enum contains specific string key or value

2023-01-05 559 Uncategorized Python Leave a Comment

To assert if Python enum contains specific string key or value, we need helper function. class BaseEnum(Enum): @classmethod def has_name(cls, name): return name in cls._member_names_ @classmethod def has_value(cls, value): return value in cls._value2member_map_ class StatusEnum(str, BaseEnum): PUBLISHED = 1 PEN…

Solved gitlab-runner error: Failed to pull image with policy “always”: Error response from daemon

2022-11-30 17.2k Uncategorized GitLab 1 Comment

I met the issue while running gitlab pipleline. I can docker pull the image at the host and any other environments, but the pipeline running in docker container still failed. I could not fetch the image from remote Docker repository. Here is the detail of the error message: Using Docker executor with image <…