AI/Machine Learning Software Engineering Intern

Description

Support the design, development, and deployment of agentic AI systems operating in secure, air-gapped, and edge environments. Work alongside senior engineers to build and test LLM-based pipelines, contribute to agentic workflow development, and assist with model optimization for constrained and offline deployment targets. Gain hands-on experience with real production-oriented AI systems at the intersection of machine learning, systems engineering, and infrastructure-aware deployment.

Responsibilities

• Contribute to the design and implementation of agentic AI workflows, including multi-agent orchestration, tool use, and reasoning loops
• Assist with the deployment of LLM-based systems in air-gapped, on-premises, and edge environments under the guidance of senior engineers
• Support the build-out of secure inference pipelines designed to operate without external network access
• Write clean, modular code that integrates ML components into broader software systems and pipelines
• Run and test models on edge hardware platforms and constrained compute targets; assist with performance and memory optimization
• Support model fine-tuning and distillation experiments, including data preparation, training runs, and evaluation
• Contribute to reproducible engineering workflows, including version control, containerization, and structured testing
• Author and maintain documentation pertaining to deployment processes, system configurations, and experiment results
• Troubleshoot issues across the stack, from model behavior through API layer through infrastructure, and report findings clearly
• Assist with hardware configuration tasks for GPU workstations and servers as needed, with guidance provided
• Engage with senior engineers to understand system changes, contribute to evaluations, and provide feedback for continuous improvement

Requirements

• Must currently be pursuing a Bachelor’s degree in Computer Science, Computer Engineering, Software Engineering, or a related technical discipline
• Strong Python programming skills
• Understanding of basic software engineering principles – code modularity, debugging, and testing
• Understanding of machine learning fundamentals and neural network basics
• Familiarity with Git and modern software development workflows
• Familiarity with REST APIs and basic software integration concepts
• Ability to work independently, prioritize tasks, and document work clearly
• Effective written and verbal communication skills

Preferred Qualifications

• Experience with LLM inference or serving frameworks such as vLLM, Ollama, llama.cpp, or Hugging Face Transformers
• Any hands-on experience with model fine-tuning or distillation, including course projects or personal experiments
• Familiarity with agentic frameworks such as LangChain, LangGraph, AutoGen, or similar
• Experience deploying or running software in constrained, offline, or non-cloud environments
• Exposure to containerization tools such as Docker
• Any familiarity with GPU setup or configuration for ML workloads; curiosity about hardware is welcome, deep expertise is not expected
• Interest in or exposure to edge hardware platforms such as NVIDIA Jetson, Raspberry Pi, or similar devices