How ChatGPT works – Architecture illustrated

OpenAI LLM models

In the post of Google Translate, I explained Natural Language Processing (NLP), encoder-decoder architecture, and Transformer model. In this post, OpenAI’ s Large language models GPT-3, InstructGPT, ChatGPT and GPT-4 are explained. Table of Content GPT-3: Introduce Large Language Model InstructGPT: Reinforcement learning with human feedback ChatGPT: Utilization is the …

Continue reading

Google neural machine translation – Architecture illustrated

Google translate

Google Translate is an application to translate one language to another in real-time. The google Translate App can translate from handwriting, voice and camera, and outputs speech and text-over-image. Google translate is using google neural machine translation. This post explains google translate architecture and technologies, especially explains how Google Translate …

Continue reading

Big O notation cheat sheet – leetcode cheat sheet

Big O notation cheat sheets

Big O notation cheat sheet provides the Big O notations for data structures and algorithm, including arrays, linked list, trees, hash tables, graphs, sorting, search, recursion, DFS and BFS, and memoization, Dynamic programming etc. It also includes leetcode Big O cheat sheet for common interview questions. The links are provided …

Continue reading

How TikTok works – Architecture illustrated

Tiktok feature

TikTok is a video-sharing app that let users create and share short videos. It impresses users with its personalized recommendations just “for you” precisely. It is highly additive and very popular among young people. Behind it, it is powered by artificial intelligence technologies. Table of Content TikTok Architecture Big data …

Continue reading

Algorithm types and algorithm examples – illustrated

algorithms examples

An algorithm is a set of rules that instruct the computer how to perform a task. This post lists the most used algorithms and their examples, such as Binary search, sorting, Divide and conquer, Two pointers, Greedy, Recursion, Backtracking and Dynamic programming. The algorithms illustrated provides glimpse of algorithms in …

Continue reading

Data structures and Java collections

data structures and java apis

Java collections are Java built-in library provided by JDK. You don’t have to implement your own data structures classes and methods. You can directly call the library. Before we list the Java Collections, the original data structures are introduced. There are arrays, linked lists, stacks, binary trees, hash tables, graphs …

Continue reading

How Zoom works – Architecture illustrated

zoom feature

Table of Content Zoom Architecture Distributed cloud-native infrastructure Network technologies Security Back-of-the-envelope calculation 1. Zoom Architecture The key components are Zoom client, Data Centers, Public Cloud, Web infrastructure. 1. The Zoom Client is the software on computers and devices to access the Zoom servers. It performs the video content processing, …

Continue reading

Software Engineering – Fundamental concepts

SW overview

Here is an illustrated explanation of Software engineering concepts and terminologies. It helps you to decide which areas you would like to specialize in. Table of Content Mathematics Systems Programming Networks Data Applications Artificial intelligence Download Software Engineering Poster 1. Mathematics Mathematic is important foundation for all science and engineering …

Continue reading

Eclipse settings you must know

eclipse feature

Eclipse is one of the most popular IDE for java development. Some of the settings are “hidden” and take time for you to find out. Some problems, such as eclipse remove red mark on project, are annoying. Here I list some eclipse java settings that will help you save time. …

Continue reading