Project 1
Adaptive LLM Inference Engine
A final-year capstone in progress focused on selecting a suitable language model, quantization level, and device based on resource and performance constraints.
- —Python and Hugging Face Transformers for the core engine.
- —FastAPI for the service layer and model serving.
- —Model quantization as part of the resource-selection workflow.