Comet (@Cometml) / X

Comet

3,494 posts

Comet

@Cometml

Comet provides an end-to-end model evaluation platform for AI developers, with best in class LLM evaluations, experiment tracking, and production monitoring

New York, NY

Joined October 2017

Comet
@Cometml
Jun 29
🚀 Opik just hit 20,000 GitHub stars. We knew this community was growing fast. We didn't know it was this fast. What started as an open source experiment in LLM evaluation has turned into something we couldn't have built alone: hundreds of thousands of developers choosing Opik
00:00
337
Comet reposted
Abby
@anmorgan2414
Jun 25
🧵 The @aiDotEngineer World's Fair schedule just dropped. 600+ sessions, 29 tracks. I'll be there next week (June 29 - July 2 in SF). Here are the 8 talks and tracks I'm planning my days around:
1.2K
Comet reposted
Akshay 🚀
@akshay_pachaar
Jun 24
Andrej Karpathy: "Remove yourself as the bottleneck. Maximize your leverage. Put in very few tokens, and a huge amount of stuff happens on your behalf." loop engineering is the exact thing that gets you there. in a hand-run session you do two things. you decide what the agent
GIF
Akshay 🚀
@akshay_pachaar
Jun 22
Article
Loop Engineering Clearly Explained
Half your feed is suddenly saying the same thing. Stop prompting your agents, start engineering loops. Boris Cherny, the person who built Claude Code, said it plainly: "I don't prompt Claude anymore....
437K
Comet reposted
Akshay 🚀
@akshay_pachaar
Jun 22
Article
Loop Engineering Clearly Explained
Half your feed is suddenly saying the same thing. Stop prompting your agents, start engineering loops. Boris Cherny, the person who built Claude Code, said it plainly: "I don't prompt Claude anymore....
1.1M
Comet
@Cometml
Jun 24
Did you know Opik integrates with #Openclaw? With the Opik/opik-openclaw plugin, every LLM call, tool invocation, and agent run is automatically traced and visible in your Opik dashboard. Three commands to get started: install, configure, restart. Setup guide →
369
Comet
@Cometml
Jun 22
We just published a public examples repo for Opik: integrations, use cases, and utility scripts you can clone and run. Community contributions welcome. github.com/comet-ml/opik-…
525
Comet reposted
Paul Iusztin
@pauliusztin_
Jun 22
I used to think evals were something you added after building the AI system. But the more AI agents I ship, the more backward that seems... The scariest AI failures are the silent ones. You change something and everything still runs. But did the system get better? Did you
515
Comet
@Cometml
Jun 9
You're spending ~30% of your coding agent tokens on misconfiguration. Bloated context, unused skills, idle MCPs. We just launched Cost Intelligence in Opik — cuts that waste 20-30% with one click. Native to Claude Code + Codex 🔗globenewswire.com/news-release/2…
241
Comet reposted
Rajesh M
@Rajesh7113
May 21
AI agent debugging is a COMPLETE mess right now. You fix one issue… and another workflow randomly breaks. You change a prompt. Tool calls start behaving differently. You improve latency. Accuracy drops somewhere else. Most teams are basically duct taping evals, traces,
898
Comet
@Cometml
May 12
Our Head of Research Doug Blank headed to Boston for his 3rd annual talk at @MITDeepLearning. He took Asimov's laws of robotics & applied them to agentic AI -- proposing his own three laws of AI and sharing how we're thinking about AI safety at Comet.
502
Comet
@Cometml
May 8
We're hiring across the team 🎉 If you know any rockstars (or are one yourself), we'd love to chat with you! 🔗 comet.com/site/about-us/…
270
Comet reposted
Paul Iusztin
@pauliusztin_
May 6
I just interviewed the former CTO at IBM and Chairperson of NodeJS. Here's what I learned: Michael @maximilien spent 12 months shipping production RAG to multiple customers. In our discussion, he told me that nothing on a leaderboard can predict what works until you evaluate
701
Comet
@Cometml
May 2
"Until you evaluate on your data, nothing else matters."
Paul Iusztin
@pauliusztin_
May 1
I’ve spent the last week interviewing @maximilien, former CTO at IBM and Chairperson of NodeJS Foundation, who has shipped production RAG to multiple customers over the past year. The lesson he kept circling back to is that until you evaluate on your customer’s data, nothing else
692