Key Questions Before Starting an LLM Startup

Before diving into an LLM-based startup, you should think through these five questions carefully. Failing to do so is a recipe for trouble down the road. ...

Posted on 2023-12-21 ·  In NLP ·  5 min read

Phi-2: The Surprising Power of Small Language Models

Microsoft released Phi-2, a 2.7 billion parameter language model that demonstrates outstanding reasoning and language understanding capabilities, achieving state-of-the-art performance among base language models with fewer than 13 billion parameters. On complex benchmarks, Phi-2 matches or outperforms models roughly 25 times its size, thanks to innovations in model scaling and training data curation. ...

Posted on 2023-12-14 ·  In NLP ·  3 min read

Textbooks Are All You Need: Key Takeaways

Microsoft recently proposed an intriguing approach: training models on synthetic textbooks instead of the massive datasets typically used. Paper: https://arxiv.org/abs/2306.11644 ...

Posted on 2023-12-13 ·  In NLP ·  2 min read

Spaghetti Code: Traps and Lessons in Development

In software development, there’s a term that resonates with almost every developer — “spaghetti code.” It vividly describes code that is chaotic, hard to understand, and nearly impossible to maintain. This post digs into what spaghetti code is, why it happens, and how to prevent it. ...

Posted on 2023-12-11 ·  In Coding ·  3 min read

The Lessons of History: Key Takeaways

The Lessons of History was written by Will Durant and Ariel Durant, first published in 1968. It is a work of historical philosophy that examines the development and evolution of human society from a historical perspective, attempting to extract valuable lessons from history. ...

Posted on 2023-12-11 ·  In Insights ·  5 min read

Open Hyperlinks from Outlook in Chrome

When I click a link in Outlook, it opens in Edge even though Chrome is the default web application. I’ve verified that in Apps > Default Apps that Google Chrome is the default web browser. Here is the solution: Change the default browser for Outlook: Open Outlook File Options Advanced File and browser preferences Open hyperlinks from Outlook in: Choose Default Browser Restart Outlook Change the default browser for Windows 11: ...

Posted on 2023-12-07 ·  In Misc ·  1 min read

A ChatGPT-Written Hospital Appointment Bot

Anyone who’s tried booking an appointment at Peking University School of Stomatology knows how difficult it is. So let’s have ChatGPT write an appointment bot. Unfortunately, the booking logic it produced is hilariously superficial — basically a no-op: ...

Posted on 2023-12-06 ·  In Misc ·  1 min read

Introduction to Retrieval-Augmented Generation (RAG)

Retrieval-Augmented Generation (RAG) is a natural language processing approach that combines pretrained parametric and non-parametric memory to improve performance on knowledge-intensive NLP tasks. This post covers the RAG framework and its potential applications. ...

Posted on 2023-12-06 ·  In NLP ·  3 min read

Everyone Works Based on Their Time Zone

New York is 3 hours ahead of California, but it does not make California slow. ...

Posted on 2023-12-05 ·  In Insights ·  1 min read

WordPress Permalinks 404 Issue Solution

The issue: Cannot change Permalink structure to any one except Plain. Otherwise, the post will return 404. Update any post will fail with message: “Updating Failed. The Response is Not a Valid JSON Response” The initial nginx config: server { server_name example.com; ... root /var/www/wordpress; index index.php index.html; location / { try_files $uri $uri/ $uri.html =404; } ... } Finally I found that the root cause is that nginx cannot redirect subpath to wordpress. Since the Plain permalink has no subpath but with query string only: https://52.175.32.36/?p=123, the above nginx config works fine. When we change the permalink structure, the above rule cannot handle the subpath routing. ...

Posted on 2023-12-05 ·  In WordPress ·  1 min read