ML engineer · NLP researcher · New York

I build language systems that read the news, interview candidates, and answer questions from documents. Then I measure where they go wrong.

Havishey Jotaniya on Bow Bridge in Central Park at sunset, with the Manhattan skyline behind him
Bow Bridge, Central ParkNew York

M.S. Computer Science, Stevens Institute of Technology, 2026. I work where NLP research meets backend engineering: dataset pipelines, model evaluation, and the APIs that put models in front of people.

Scroll to watch 2,002 news articles become a dataset

01Collect

2,002

news articles from Common Crawl mention YouTube or Snapchat near words like anxiety, depression, or therapy. Each dot is one article.

02Filter

1,492

are actually about youth mental health. A GPT-4o ensemble scores relevance, and three human annotators decide the borderline cases. Passing mentions are dropped.

03Label

4 classes

Negative, Mixed, Positive, Neutral. Two LLMs label each article; when they disagree, four models vote. Ties go to the more critical label.

04Result

66.8%

of articles take a negative stance. News mostly covers risk, so the dataset keeps that skew rather than hiding it. That makes it a hard benchmark.

Selected work

SCREENResearch · LEAF-AI-LAB · Jan–May 2026

A stance dataset for how news covers teens, video apps, and mental health

Sentiment models call an article negative when it reports bad news. Stance asks a harder question: what position does the writer take? SCREEN is a benchmark built to test that.

I built the NLP pipeline from Common Crawl to labeled corpus, designed the GPT-4o / GPT-4o-mini relevance screen with human-in-the-loop validation, and trained and evaluated the supervised baselines on AWS EC2.

932 labeled by 2-model agreement 560 sent to a 4-model vote Fleiss’ κ 0.38 on that hard subset
Macro-F1 · held-out test set (448 articles) trainedzero-shot LLM
Logistic RegressionTF-IDF
0.85
Longformer
0.84
RoBERTa
0.84
SVMTF-IDF
0.84
Claude Sonnet 4.6
0.79
GPT-4o-mini
0.75
DeBERTa-v3
0.20
0.25.50.751

A plain TF-IDF model matched the transformers. DeBERTa-v3 collapsed onto the majority class. Zero-shot LLMs struggled most with Neutral reporting, often reading factual coverage of harm as a negative stance.

Python · Hugging Face Transformers · scikit-learn · GPT-4o · Doccano · AWS EC2

Dataset on GitHub ↗ with J. Singh, T. Xie, S. W. Bae, P. Wang · manuscript in preparation
AKVStevens Marketplace · May 2026–present

An AI interviewer that checks whether the candidate actually knows it

Stevens Marketplace connects organizations, faculty, and students on funded, real-world projects. Faculty review applicants through resume matching and an LLM-run interview. I build the backend services and APIs, and I helped build the interview assistant.

If a candidate pastes answers from another AI, the interview means nothing. I designed Adaptive Knowledge Verification (AKV), a multi-stage process that follows up on each answer to test understanding beyond the first response.

How AKV probes · illustrative exchange
Interviewer

How would you handle class imbalance in a four-class text classifier?

Candidate

Class weights or oversampling, then I’d report accuracy.

Interviewer

Say one class is 7% of the data. What could accuracy hide there?G5 reasoning

Candidate

A model could ignore that class and still score high. Macro-F1 would show it.

Interviewer

Earlier you chose accuracy. Which metric goes in your report now, and why?G2 consistency

  1. G1
    Dynamic question perturbation

    Questions change shape between candidates and sessions, so prepared answers stop fitting.

  2. G2
    Cross-response consistency

    Claims made early in the interview are checked against later answers.

  3. G3
    Practical competency validation

    Asks how the candidate would apply the idea, not only define it.

  4. G4
    Rubric-based evaluation

    Scores answers against an explicit rubric that faculty can read.

  5. G5
    Adaptive reasoning verification

    Pushes on the reasoning behind an answer until it holds or breaks.

Python · FastAPI · PostgreSQL · LLM APIs

RAGProject

AI Knowledge Assistant

A personal knowledge base you can talk to. It ingests your documents, notes, and course material, then answers questions with GPT-4o and cites the page each answer came from.

Embedding and vector-retrieval pipelines on FAISS for low-latency semantic search, FastAPI services that connect retrieval to generation, a CLI for ingesting folders, and a Streamlit app for asking questions. The FAISS index stays on your machine.

Try retrieval on this pageTF-IDF · runs in your browser

    The real project uses dense embeddings in FAISS. This demo ranks passages from this site with TF-IDF and cosine similarity.

    Python · OpenAI GPT-4o · FAISS · FastAPI · Streamlit

    More from GitHub

    Smaller tools I’ve built

    GitHub Action · CLI

    AI Code Review Assistant

    An LLM reviewer for pull requests. Static analysis flags security, complexity, and style problems, then the model explains design and refactoring issues in context.

    ruff + bandit + radon → GPT review → PR comments

    PythonRepo ↗

    Streamlit · OpenAI or Ollama

    LLM Resume Evaluator

    Scores a resume against a job description on a fixed five-part rubric and returns strict JSON with evidence and suggested fixes. Runs on OpenAI or a local model.

    {"name": "Skills Match", "score": 5}

    PythonRepo ↗

    REST API · Flask

    Strava Lite

    A lightweight fitness API. Users register, log workouts, follow friends, and see the workouts of people they follow.

    users · workouts · follows

    PythonRepo ↗

    Experience

    1. Stevens Marketplace · Stevens Institute of Technology

      Backend services and APIs; LLM-powered interview assistant with adaptive questioning.

    2. SCREEN News Media Stance Research · LEAF-AI-LAB, Stevens

      NLP data pipeline, LLM-assisted annotation, and model benchmarking on 1,492 news articles.

    3. Teaching Assistant · Python, ML & Software Development

      Supported graduate courses of 100+ students each; graded projects on Pandas, sentiment analysis, Git workflows, databases, and testing.

    4. M.S. Computer Science · Stevens Institute of Technology

      Provost Master’s Scholarship. Machine Learning, Deep Learning, NLP, Distributed Systems, Advanced Algorithms.

    5. Software Engineer Intern · PlusGold, Bangalore

      FastAPI REST APIs on MySQL and Redis; CI/CD with GitHub Actions and Jenkins; services on AWS EC2, Lambda, and CloudWatch.

    6. Software Engineer Intern · Elsner Technologies, Ahmedabad

      FastAPI microservices, Docker containers, and Terraform deployment workflows.

    Toolkit

    Languages

    PythonSQLJavaScriptJavaR

    ML & NLP

    PyTorchHugging Facescikit-learnTensorFlowRoBERTaLongformerBERTRAGFAISSPandasNumPy

    Backend

    FastAPIFlaskReact

    Cloud & DevOps

    AWSDockerTerraformGitHub ActionsJenkins

    Data

    PostgreSQLMySQLMongoDBRedisBigQuery

    Contact

    Open to AI/ML engineering roles. Let’s talk.

    havisheyjotaniya@gmail.com