Tag:
machinelearning
(55)39 Lessons on Building ML Systems, Scaling, Execution, and More
ML systems, production & scaling, execution & collaboration, building for users, conference etiquette.
03 Nov 2024 · 10 min · machinelearning engineering production leadership
How to Interview and Hire ML/AI Engineers
What to interview for, how to structure the phone screen, interview loop, and debrief, and a few tips.
07 Jul 2024 · 21 min · machinelearning career leadership 🔥
Don't Mock Machine Learning Models In Unit Tests
How unit testing machine learning code differs from typical software practices
25 Feb 2024 · 6 min · machinelearning engineering python
Push Notifications: What to Push, What Not to Push, and How Often
Sending helpful & engaging pushes, filtering annoying pushes, and finding the frequency sweet spot.
24 Dec 2023 · 18 min · teardown recsys machinelearning production
Out-of-Domain Finetuning to Bootstrap Hallucination Detection
How to use open-source, permissive-use data and collect less labeled samples for our tasks.
05 Nov 2023 · 12 min · llm eval machinelearning python
More Design Patterns For Machine Learning Systems
9 patterns including HITL, hard mining, reframing, cascade, data flywheel, business rules layer, and more.
23 Apr 2023 · 20 min · machinelearning engineering production recsys
How to Write Data Labeling/Annotation Guidelines
Writing good instructions to achieve high precision and throughput.
12 Mar 2023 · 6 min · machinelearning mechanism survey
Content Moderation & Fraud Detection - Patterns in Industry
Collecting ground truth, data augmentation, cascading heuristics and models, and more.
26 Feb 2023 · 16 min · teardown machinelearning production
Mechanisms for Effective Machine Learning Projects
Pilot & copilot, literature review, methodology review, and timeboxing.
22 Jan 2023 · 7 min · mechanism machinelearning productivity
Writing Robust Tests for Data & Machine Learning Pipelines
Or why I should write fewer integration tests.
04 Sep 2022 · 19 min · engineering machinelearning production 🩷
Simplicity is An Advantage but Sadly Complexity Sells Better
Pushing back on the cult of complexity.
14 Aug 2022 · 10 min · machinelearning engineering production 🔥
Design Patterns in Machine Learning Code and Systems
Understanding and spotting patterns to use code and components as intended.
12 Jun 2022 · 13 min · machinelearning engineering python 🔥
Bandits for Recommender Systems
Industry examples, exploration strategies, warm-starting, off-policy evaluation, and more.
08 May 2022 · 14 min · teardown recsys machinelearning
Counterfactual Evaluation for Recommendation Systems
Thinking about recsys as interventional vs. observational, and inverse propensity scoring.
10 Apr 2022 · 8 min · recsys eval machinelearning
Red Flags to Look Out for When Joining a Data Team
What to consider for in terms of data, roadmap, role, manager, tooling, etc.
13 Feb 2022 · 8 min · datascience machinelearning career
How to Keep Learning about Machine Learning
Beyond getting that starting role, how does one continue growing in the field?
19 Jan 2022 · 6 min · learning career machinelearning
The Data Scientist Show - Building end-to-end ML systems
Daliana and I had a 2hr chat on all things data science and machine learning.
02 Dec 2021 · 1 min · datascience machinelearning career
Informal Mentors Grew into ApplyingML.com!
More than two dozen interviews with ML Practitioners sharing their stories and advice
25 Nov 2021 · 1 min · machinelearning career 🛠
The First Rule of Machine Learning: Start without Machine Learning
Why this is the first rule, some baseline heuristics, and when to move on to machine learning.
19 Sep 2021 · 8 min · machinelearning 🔥
MLOps Community - System Design for RecSys & Search
An overview of system design, candidate retrieval, and ranking, with industry examples.
15 Sep 2021 · 1 min · recsys machinelearning production
Bootstrapping Labels via ___ Supervision & Human-In-The-Loop
How to generate labels from scratch with semi, active, and weakly supervised learning.
01 Aug 2021 · 12 min · teardown machinelearning
Mailbag: How to Bootstrap Labels for Relevant Docs in Search
Building semantic search; how to calculate recall when relevant documents are unknown.
20 Jul 2021 · 1 min · machinelearning 📬
SF Big Analytics - System Design for RecSys & Search
Why real-time RecSys? What does the system design look like in industry? How to build an MVP?
13 Jul 2021 · 1 min · recsys machinelearning production
Patterns for Personalization in Recommendations and Search
A whirlwind tour of bandits, embedding+MLP, sequences, graph, and user embeddings.
13 Jun 2021 · 25 min · teardown recsys machinelearning deeplearning
The Metagame of Applying Machine Learning
How to go from knowing machine learning to applying it at work to drive impact.
02 May 2021 · 12 min · machinelearning career 🩷
Search: Query Matching via Lexical, Graph, and Embedding Methods
An overview and comparison of the various approaches, with examples from industry search systems.
25 Apr 2021 · 21 min · teardown machinelearning production 🔥
TalkPython - What ML can Teach Us About Life
Mike and I take a philosophical detour on Talk Python and discuss life lessons from machine learning.
26 Mar 2021 · 1 min · machinelearning life
Choosing Problems in Data Science and Machine Learning
Short vs. long-term gain, incremental vs. disruptive innovation, and resume-driven development.
21 Mar 2021 · 12 min · datascience machinelearning leadership
How to Write Design Docs for Machine Learning Systems
Pointers to think through your methodology and implementation, and the review process.
07 Mar 2021 · 15 min · writing machinelearning engineering
Feature Stores: A Hierarchy of Needs
Access, serving, integrity, convenience, autopilot; use what you need.
21 Feb 2021 · 19 min · teardown machinelearning engineering 🔥
DataTalksClub - Building an ML System; Behind the Scenes
Design and architecture, tech stack, methodology, results, and lessons learned.
07 Feb 2021 · 5 min · machinelearning production
Real-time Machine Learning For Recommendations
Why real-time? How have China & US companies built them? How to design & build an MVP?
10 Jan 2021 · 21 min · teardown machinelearning recsys production 🔥
What Machine Learning Can Teach Us About Life - 7 Lessons
Data cleaning, transfer learning, overfitting, ensembling, and more.
22 Nov 2020 · 11 min · machinelearning life
Applied / Research Scientist, ML Engineer: What’s the Difference?
A personal take on their deliverables and skills, and what it means for the industry and your team.
08 Nov 2020 · 11 min · datascience machinelearning engineering career
Chip Huyen on Her Career, Writing, and Machine Learning
Setbacks she faced, overcoming them, and how writing changed her life.
01 Nov 2020 · 11 min · career machinelearning writing
How to Install Google Scalable Nearest Neighbors (ScaNN) on Mac
Step-by-step walkthrough on the environment, compilers, and installation for ScaNN.
14 Oct 2020 · 3 min · python machinelearning til
How to Test Machine Learning Code and Systems
Checking for correct implementation, expected learned behaviour, and satisfactory performance.
06 Sep 2020 · 14 min · machinelearning engineering python
Mailbag: Parsing Fields from PDFs—When to Use Machine Learning?
Should I switch from a regex-based to ML-based solution on my application?
04 Sep 2020 · 4 min · machinelearning 📬
Unpopular Opinion: Data Scientists Should be More End-to-End
Why (and why not) be more end-to-end, how to, and Stitch Fix and Netflix's experience
09 Aug 2020 · 17 min · datascience machinelearning leadership 🔥
My Notes From Spark+AI Summit 2020 (Application-Specific Talks)
Part II of the previous write-up, this time on applications and frameworks of Spark in production
05 Jul 2020 · 15 min · machinelearning deeplearning production survey
My Notes From Spark+AI Summit 2020 (Application-Agnostic Talks)
Sharing my notes & practical knowledge from the conference for people who don't have the time.
28 Jun 2020 · 11 min · machinelearning deeplearning survey
A Practical Guide to Maintaining Machine Learning in Production
Can maintaining machine learning in production be easier? I go through some practical tips.
25 May 2020 · 16 min · machinelearning engineering production
6 Little-Known Challenges After Deploying Machine Learning
I thought deploying machine learning was hard. Then I had to maintain multiple systems in prod.
18 May 2020 · 14 min · machinelearning engineering production
DataScience SG Meetup - RecSys, Beyond the Baseline
Comparing baselines (matrix factorization) against novel approaches using graphs & NLP.
14 Jan 2020 · 2 min · recsys machinelearning
DataScience SG x ODSC Meetup - Applying ML to Healthcare
In-depth sharing on how to put machine learning systems into production.
09 Oct 2019 · 4 min · machinelearning production
OLX Prod Tech 2019 Keynote - Asia's Tech Giants & SuperApps
Keynote on how Asia's tech giants scale and their SuperApp strategy.
03 Oct 2019 · 3 min · machinelearning engineering leadership
OMSCS CS7646 (Machine Learning for Trading) Review and Tips
OMSCS CS7646 (Machine Learning for Trading) - Don't sell your house to trade algorithmically.
11 May 2019 · 9 min · omscs learning machinelearning python
DATAx - A Production ML system for SEA's Biggest Hospital Group
How we built an ML system to predict hospitalization costs at admission; sharing at DATAx Conference.
06 Mar 2019 · 4 min · production machinelearning
OMSCS CS6601 (Artificial Intelligence) Review and Tips
OMSCS CS6601 (Artificial Intelligence) - First, start with the simplest solution, and then add intelligence.
20 Dec 2018 · 8 min · omscs learning machinelearning python
OMSCS CS7641 (Machine Learning) Review and Tips
OMSCS CS7641 (Machine Learning) - Revisiting the fundamentals and learning new techniques.
27 Dec 2017 · 4 min · omscs learning machinelearning python
Product Categorization API Part 3: Creating an API
Or how to put machine learning models into production.
13 Feb 2017 · 8 min · machinelearning production python 🛠
Product Classification API Part 2: Data Preparation
Cleaning up text and messing with ascii (urgh!)
11 Dec 2016 · 8 min · machinelearning python 🛠
Strata x Hadoop 2016 - How Lazada Ranks Products
How Lazada ranks products to improve customer experience and conversion at Strata 2016.
09 Dec 2016 · 1 min · machinelearning production
Product Classification API Part 1: Data Acquisition
Parsing json and formatting product titles and categories.
11 Oct 2016 · 9 min · machinelearning python 🛠
DataScience SG Meetup - How we got top 3% in Kaggle
Sharing about my first data science competition at DataScience SG.
20 Jun 2015 · 1 min · machinelearning
Join 11,800+ readers getting updates on machine learning, RecSys, LLMs, and engineering.