Soft entity resolution using ElasticSearch and data analysis: DOT chameleon-carrier detection as a PoC
A few years ago I tried to build a probabilistic/soft entity resolution system a few years ago using Elasticsearch with its ability to match "like" terms. The idea was to create a candidate list of companies that closed and re-opened a short time later, a pattern often used to avoid some type of consequences. The project was more work than I felt like doing at the time. Recently, I decided to try to push the project forward using Claude Code as my development team. The LLM filled in the blank spaces, created tests, and helped me analyze the data to understand what I needed to do. All within just a couple of days. Entitopia as a working project Entitopia is a proof of concept for using semantic matching and multi-property similarity as part of probabilistic entity resolution. It looks for carriers that shut down under one DOT registration and re-registered as a “new” carrier shortly after — a chameleon carrier. No single data point proves that happened: a sh...