AI Engineer, EVA-LLM AI-platform owner, OpenAI Promptfoo Contributor (G-Eval), PhD in Engineering.
07.2024 - 03.2026 - Senior Developer of AI-based systems
Responsibility:
- Design and building of AI and agentic systems.
- Development of corporate tool for testing AI prompts.
Researching and experimenting:
- Transformers architecture internals
- LLM-serving tools: llama.cpp, vllm, sglang
- AI-agents frameworks: langchain, llamaindex, autogen, BeeAI, MCP
Opensource contribution:
- Implementation of G-Eval evaluation in promptfoo
- Fix of critical issue with server crash in promptfoo
- Minor but important fix in beeai-framework
- MCP-server for Pipedrive public API v1+v2
- MCP-compatible LLM G-Eval guardrails checker
Publications:
- A Thought Experiment: Building an AI Platform Stage to Stage
- Reflections on Guardrail Architecture: Designing Safe and Scalable LLM Systems
- Reflections on Hierarchical Memory and Local Contexts in LLMs with Self-Organizing AGENTS.md
- 11 Practical Notes about Prompt Engineering
- Rethinking AI Agents (practical guide)
- 7 Practical Guidelines for Designing AI-Friendly APIs
- Retaining AI Agent Tools Experience with LLM Embeddings
- Thoughts on External Memory for LLMs
Earlier
05.2020 - 06.2024 - Senior Backend Developer
One of cofounders (technical part) of AI-powered Sales Assistant (AISA)
- idea and implementation method of company-specific AI assistant;
- research and development of project prototype;
- ML algorithm update with automatic features selection and next action recommendation;
- full pipeline to delivery predictions and recommendations to customers;
Publications:
Opensource:
- multithreading and multiprocessing tasks executor
- nodejs interactive debugger
- couchdb adapter for migration tool
- bug fixing in react player component
08.2018 - 05.2020 - Machine Learning Engineer
Responsibilities:
- Develop solutions for production AI;
- Machine learning tools troubleshooting;
- Data scientists support;
Publications:
- ML Code vs AWS Lambda Limits
- Distribution density score
- Python monkey-patching like a boss
- Machine learning in tests generating
OpenSource:
- Easy converter pandas -> tfrecords & tfrecords -> pandas
- Concurrent Queue Consumer
- Minor fix in xgboost
- Minor fixes in mlflow:
04.2017 - 08.2018 - Senior Automation Engineer
Responsibilities:
- Technical leader of automation team
- Automation processes curation
- Automation tools selection
- Corporate automation tools development
Achievements:
- Set up automation flow and team from scratch
- Involved code review to automation flow
- Detailed documentation of all developed projects
- Developed automation courses for QA engineers
OpenSource:
- Founder of functional testing platform GlaceJS
- Jython library for native applications testing
- Contribution to vuejs
- Contribution to pixijs:
Presentaions:
- Speaker on TallinnJS Meetup;
- Speaker on Derivco DevNight "Automation";
- Speaker on Tallinn DevClub;
11.2016 - 04.2017 - Senior Automation Engineer
Responsibilities:
- Architectural solutions of stepler project
- Coordinating of stepler developers team
- Code review of stepler project.
Achievements:
- Cofounder, architect and core developer of stepler project:
OpenSource:
Publications:
- Python memory management to avoid leaks
- Web UI testing with POM
- STEPS-architecture for OpenStack testing
03.2016 - 10.2016 - Automation Engineer
Responsibilities:
- Horizon QA
- Openstack testing
- Automation testing with selenium
- Code review
- Test coverage
- Test design
02.2014 - 02.2016 - Automation Engineer
Responsibilities:
- UI automated testing at ZOO of operation systems.
- Setup testbed at different operation systems.
- Cloud automated testing.
- Curation of junior automation engineers.
- Architect and main contributor to test framework.
OpenSource:
- Participant of allure team
- Developer of nose-allure-plugin
- Contribution to mitmproxy, uisoup, selenium, jenkins-allure-plugin, jenkins-naginator-plugin, pytest-allure-adaptor, pytest-ordering
05.2013 - 02.2014 - Web Developer
Responsibilities:
- Participation in the development of the "BARS.E-School" with Python, JavaScript, HTML, using frameworks Django, M3, ExtJS.
04.2012 - 05.2013 - Web Developer
Responsibilities:
- Web Application Development with Ruby-on-Rails, CoffeeScript.
- Backend development for iOS-clients.
- Code review of junior developers.
04.2011 - 02.2013 - QA Team Lead
Responsibilities:
- Quality Assurance of https://open.kzn.ru
12.2010 - 04.2011 - QA Engineer
Responsibilities:
- Software testing
- Bug reporting