Page 4 - Gary' Blog

How to compress mp4 in one command with ffmpeg

2023-03-28 114 Technical ffmpeg, mp4 Leave a Comment

With ffmpeg, we can create a free video compresser on our local machine. First, create a shell function on you .bashrc or .zshrc: function mp4-compress() { filename=$(basename -- "$1") extension="${filename##*.}" name="${filename%.*}" ffmpeg -i "$1" -vcodec libx265 -crf 2…

How to transfer data between different mongodb instance?

2023-03-25 81 Technical MongoDB Leave a Comment

Here is the python code to transfer data between different mongo instance: def transfer(source_collection, dest_collection, batch_size: int): offset = 0 total = source_collection.count_documents({}) total_inserted = 0 while True: documents = source_collection.find().skip(offset).limit(batch_size) data = list(do…

How to config logging output to file and stdio/console with basicConfig() in one line?

2023-03-22 128 Technical Python Leave a Comment

import logging logging.basicConfig(format='[%(asctime)s] [%(levelname)s] %(message)s', datefmt='%Y-%d-%m %I:%M:%S', level=logging.DEBUG, handlers=[logging.FileHandler('app.log'), logging.StreamHandler()])

Linux multiple threads download from file with wget

2023-03-20 549 Technical Linux, wget Leave a Comment

Assume we have a file that have all the urls to download. sed 's|^|https://data.commoncrawl.org/|' wet.paths | xargs -n 1 -P 15 wget --timeout=1800 --retry-connrefused --waitretry=10 -nc &

KeyCloak vs Authelia

2023-02-15 3.7k Technical Authelia, Keycloak Leave a Comment

Category Detailed KeyCloak Authelia Star Github 14,776 15,346 Technical Language Java Go Database for dev H2 (file and memory) SQLite Database MariaDB, MSSQL, MySQL,Oracle, PostgreSQL MySQL, PostgreSQL Cache for dev local Memory Cache Infinispan Redis Redis Sentinel Connections Protocols OpenID Connect, OAuth …

Special Character and Symbol Names on Keyboard

2023-02-03 112 Technical Leave a Comment

~: tilde `: push, open quote, left quote, grave, back quote !: bang, exclamation @: at #: hash, sharp $: dolor %: percent ^: caret, circumflex &: and *: star, asterisk (: left parenthesis ): right parentthesis -: dash, hyphen, minus _: underscore +: plus =: equal {: curly bracket, open brace }: curly brack…

How to assert if Python enum contains specific string key or value

2023-01-05 546 Uncategorized Python Leave a Comment

To assert if Python enum contains specific string key or value, we need helper function. class BaseEnum(Enum): @classmethod def has_name(cls, name): return name in cls._member_names_ @classmethod def has_value(cls, value): return value in cls._value2member_map_ class StatusEnum(str, BaseEnum): PUBLISHED = 1 PEN…

Solved gitlab-runner error: Failed to pull image with policy “always”: Error response from daemon

2022-11-30 16.8k Uncategorized GitLab Leave a Comment

I met the issue while running gitlab pipleline. I can docker pull the image at the host and any other environments, but the pipeline running in docker container still failed. I could not fetch the image from remote Docker repository. Here is the detail of the error message: Using Docker executor with image <…

Spring Boot + Thymeleaf form validation error not displaying

2022-11-28 1.4k Uncategorized spring boot, Thymeleaf Leave a Comment

Check these by these steps. Make sure BindingResult just follows up with the object variable @PostMapping("/save") public String save(@Valid Product product, BindingResult bindingResult, RedirectAttributes attributes) { // th:object = "${product}" } Here, it follows up producrt object. use @…

How to use Gmail to send email in Python

2022-10-29 342 Technical Gmail, Python Leave a Comment

1 Add "App password" Go to Google account "Security", navigate to "Signing in to Google" and click "App passwords". Then select a type, here we use "Mail" and custom the device name. Type device name as "airflow", or you can choose any other name. Then…