Charalambos
Rotsides

Forward Deployed AI Engineer

I build production AI systems: agents, RAG, document intelligence and private LLM deployments. I take them from a loosely defined problem to a system running in production.

Based in Cyprus. Working remotely.

Charalambos Rotsides

Selected work

At the Cyprus Marine and Maritime Institute

Self-hosted LLM inference platform

Internal

Designed and optimised a self-hosted ~27B-parameter LLM inference platform supporting multi-user workloads.

Model serving, quantization and precision trade-offs, GPU memory, request queues and concurrency, with monitoring and load testing under simulated agent workloads.

Stack: Python, Docker, GPU inference servers, Linux

Real-time AIS vessel monitoring

Maritime Digitalisation Centre

Full-stack platform for real-time vessel tracking from multiple AIS sources, built across the stack from geospatial storage to the live map.

Historical vessel analysis, geofencing and areas of interest, and vessel activity visualisation on continuously generated real-world data.

Stack: React, Node.js, PostgreSQL/PostGIS, Redis, WebSockets

Internal application platform

Internal

Designed and deployed an internal containerised application platform supporting multiple production research applications.

Isolated workloads, private networks and restricted secrets. A configuration watcher validates routing changes before applying them, so a bad deploy cannot break production.

Stack: Docker, Linux, Nginx, Cloudflare, CI/CD

Document processing pipelines

Research and technical documents

OCR, information extraction and LLM-assisted analysis for technical and research documents.

Structured data pipelines and APIs that feed the results into larger research and software systems.

Stack: Python, OCR, LLM APIs, PostgreSQL

Own products and projects

MealVerve

Live product. Founder and engineer

An AI-assisted meal-planning product that I designed, built and operate, from frontend and backend to databases, AI integration and production infrastructure.

It plans meals for the week, organises recipes, tracks calories and macros automatically, and turns the plan into a grocery list.

Stack: Next.js, Prisma, Auth0, Stripe, Sentry, PWA

mealverve.com

Kai, a bilingual AI voice agent

Voice AI and tool calling

An English and Greek voice agent for outbound and inbound calls. It checks real calendar availability, books the meeting and texts a confirmation with an add-to-calendar link.

Ran five concurrent outbound calls. Detects voicemail and IVR systems and ends the call instead of talking to a machine.

Stack: Vapi, GPT-4o, ElevenLabs, Deepgram, Twilio, Telnyx, Flask

JARVIS, a voice-driven coding-agent orchestrator

Multi-agent and realtime voice

Speak a task into a phone app. A router model sends it to Claude Code, Codex or a Qwen coding agent, which works in an isolated git worktree. JARVIS reports back by voice and merges on command.

Agent sessions resume per project. When an executor hits a rate limit it goes on cooldown and the router picks another.

Stack: Node.js, WebSockets, Flutter, Qwen realtime voice, Claude Code, Codex

agent-loop

Autonomous plan, code and review loop

Planner and reviewer agents direct coding agents through a task checklist. Independent subtasks run in parallel in separate git worktrees and merge back.

The reviewer checks UI changes in the running app through Playwright MCP and database state through a read-only database MCP. I used it to build a full-stack compliance web app.

Stack: Python, Claude, Codex, MCP, Playwright, git worktrees

Historic handwriting recognition

Document AI, Zindi competition

Handwritten-text recognition for historic archival documents, with a 5-fold evaluation harness and a data audit before any training.

  • Weighted character error rate from 35.4 to 9.4 after fine-tuning, on a held-out fold of 816 lines
  • Weighted word error rate from 11.4 to 4.9

Stack: Python, PyTorch, Kraken, McCATMuS

Artificial pancreas and glucose prediction

B.Eng. thesis, University of Cyprus, 2023

Lead programmer in a five-person team. LSTM networks forecast blood glucose and a reinforcement-learning model calculates insulin doses, both running on Android through TensorFlow Lite.

  • Glucose forecast error (RMSE) of about 10 mg/dL ±3, trained on 23 simulated patients
  • Virtual patients kept in the target range for more than 70% of simulated time

Stack: Python, TensorFlow, Keras, TensorFlow Lite, Android

Code on GitHub

What I work on

I'm most useful when the problem is complex or not yet well defined.

  • AI agents

    Agents that do real tasks, connected to your databases, CRMs and internal APIs.

  • RAG and knowledge systems

    Search and question answering over your company's documents and data.

  • Document extraction

    OCR and structured extraction, fed into the systems you already use.

  • Prototype to production

    Making an AI prototype reliable: evaluation, monitoring and cost control.

  • Fixing existing AI systems

    Debugging and improving RAG, agent and LLM pipelines that aren't performing.

  • Private LLM deployment

    Running models on your own hardware, and routing between models to balance cost and quality.

Experience and education

  1. 2023 – present

    Assistant Scientist, Software & AI Engineer

    Cyprus Marine and Maritime Institute, Maritime Digitalisation Centre

    • Design, build and deploy complete software and AI systems, from architecture to production
    • Lead architecture decisions and supervise a junior developer
    • Database design, CI/CD, deployment and taking research software to production
    • Software for EU-funded research and innovation projects
  2. 2019–2023

    B.Eng. Computer Engineering

    University of Cyprus

    • Software engineering, machine learning, neural networks, computer systems, embedded and mobile development
    • Thesis: artificial pancreas and blood-glucose prediction

Awards and certificates

  • 1st Place Team Award, University of Cyprus Student Innovators Competition, 2023
  • European Innovation Academy summer school, A grade, 2023
  • Coursera: Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization
  • Coursera: Structuring Machine Learning Projects

Skills

AI and LLMs
OpenAI and Anthropic APIs, open-source models, vLLM, RAG, embeddings and vector search, tool calling, MCP, agents and multi-agent systems, structured outputs, model routing, LLM evaluation
Machine learning
PyTorch, TensorFlow, Keras, LSTMs, reinforcement learning, GNNs, computer vision and OCR, model deployment and inference
Languages
Python, TypeScript, JavaScript, SQL
Backend
Node.js, Express, FastAPI, REST APIs, WebSockets, background workers and queues
Frontend
React, TypeScript
Data
PostgreSQL, PostGIS, MongoDB, Redis
Infrastructure
Docker, Linux, Nginx, PM2, Cloudflare, CI/CD, GPU inference servers, monitoring, load testing
Other projects
  • Phone-based 3D room reconstruction

    R&D: an Android phone captures colour, depth and camera pose, and a Python pipeline turns it into a metric point cloud and mesh. Kotlin, Rust, PyTorch, depth models.

  • Live audio transcription

    Transcribes whatever a PC is playing, word by word, on the CPU, with Moonshine and Whisper.

Where it started

The first things I built with software and AI.

  • AI Spotify playlist creator

    Builds playlists from a plain-language description, with OpenAI and Stripe.

  • Personal trainer booking site

    Booking site for a personal trainer. Bookings go to Google Sheets with email notifications.

  • AI translator

    Translation tool built on the OpenAI API.

  • Habit tracker

    Android app for habit tracking and tasks, with a Firebase backend.

  • MIPS32 pipeline simulator

    Simulator of a pipelined RISC processor, in C++.

  • Genetic algorithm demo

    Smart rockets that learn to reach a target, in p5.js.

  • Point of sale system

    Retail point of sale software, in C++ with Qt.

Contact

Email is the quickest way to reach me.

charalambosrotsides@gmail.com