Page 3 - Gary' Blog

How to run ML/DL model on remote GPU server in Jupyter notebook

2023-11-07 105 Jupyter, keras, sklean, tensorflow Leave a Comment

If your AWS, Azure or any other remote server has GPU, you would like to run you model on them. Maybe tensorflow, keras, or sklean. Just follow these steps: Step 1 Install Docker and Cuda driver on your server. Step 2 Run tensorflow and jupyter container on your server. docker run -p 8888:8888 quay.io/jupyter/s…

Complete Guide: Sending Emails via AWS SES using SMTP

2023-10-16 132 AWS, Email, SES, SMTP Leave a Comment

While I started to send email via AWS SES, it took me a long time to config it to make it working. So I wrote it down once I success doing it. Here are the important poinits: Verified identities Create SMTP credentials Send email with smtplib Raise ticket to AWS (default the SMTP is in sandbox, you can only sen…

Python solved SMTP ssl.SSLError: [SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:1002)

2023-10-10 706 Email, SMTP Leave a Comment

Usually, we send email by SMTP using: def send_email(receivers, subject, body): msg = EmailMessage() msg['From'] = SMTP_USER msg['Bcc'] = receivers msg['Subject'] = subject msg.add_alternative(body, subtype='html') with smtplib.SMTP_SSL(SMTP_HOST, SMTP_PORT) as server: se…

Selenium infinite scrolling to bottom using python

2023-09-19 311 Crawler, Python, Selenium Leave a Comment

We have 3 kinds of infinite scrolling to bottom while using selenium. Simply scrolling - Stop until there is no more content. Meet scrolling - Stop until we meet a speciy element. Partial scrolling - Scrolling content in specify html container, stop until there are no more content. All these 3 scenses will use …

How to install OS and connect to NanoPi-R2S (rk3328)

2023-09-12 466 Leave a Comment

Official wiki page OS image on Google Drive Install OS Go to google drive, navigate to: 01_Official images/01_SD card images. Download any image, e.g., "rk3328-sd-debian-bullseye-core-5.15-arm64-20230529.img.gz". Unzip it to "rk3328-sd-debian-bullseye-core-5.15-arm64-20230529.img". importat…

The most commonly used functions in machine learning data cleaning

2023-09-05 76 Data Cleaning, Machine Learning, ML Leave a Comment

1. Get null percentage of columns def get_null_percentage(df): count = df.isnull().sum() percent = (df.isnull().mean() * 100).round(2) summary = pd.DataFrame({'count': count, 'percentage': percent}) return summary[summary["count"] > 0].sort_values(ascending=False, by="perce…

How to find all indicators and country codes while using imf api

2023-08-08 445 Leave a Comment

When following the imf api service to query data, you have to specify the indicators. You must have viewed this 2 posts: How to Use the API (Python and R) IMF API (Python) But both of them do not explain how to get full list of indicators as well as the country code. Get full list of imf indicators We have to a…

What is OpenAI Function Calling and How to Use it?

2023-06-17 211 ChatGPT, OpenAI 1 Comment

Simply put, OpenAI / ChatGPT function calling can identify the intent and entities in a sentence through a language model. For example, when the user asks "I want to recharge my phone100 USD". The model should recognize the intent recharge and it's 2 entities recharge amont: 100 currency:USD Back to O…

A script to test MySQL port is running

2023-05-03 114 MySQL Leave a Comment

#!/bin/bash ip="<MySQL HOST>" port="<MySQL PORT>" output_file="<Log File Path>" while : do nc -zv "$ip" "$port" > /dev/null datetime=$(date +"%Y-%m-%d %H:%M:%S") if [ $? -eq 0 ]; then echo "$datetime: Port $port is open on $ip…

From PHP to Python In 10 Minutes

2023-04-11 177 PHP, Python Leave a Comment

PHP and Python are both high-level, interpreted programming languages with a variety of applications, but they have some significant differences in terms of syntax, design philosophy, and use cases. Here's a detailed comparison of the two languages: 1. Purpose and Use Cases PHP: Created by Rasmus Lerdorf in 199…