Home Projects Portfolio Dashboard Export PDF Log in

Scaling ML Workflows: Deploying Credit Scoring APIs with FastAPI

Building Scalable ML Services

The mlops-credito project represents a shift toward robust, production-ready machine learning. Traditionally, data scientists iterate in notebooks, but moving those models into a high-performance serving environment requires a bridge between model logic and infrastructure. We recently focused on creating a streamlined API architecture that makes credit scoring models accessible, reliable, and easy to deploy.

The Architecture

By leveraging FastAPI, we gain a performant, asynchronous framework that handles concurrent requests with minimal overhead. Combined with Pydantic for data validation, we ensure that the inputs received by our credit model are always in the expected format, preventing common runtime errors that plague ML services.

Defining Request Validation

Using Pydantic, we define the schema for our credit assessment features, ensuring that incoming data is clean before it ever reaches the scikit-learn model:

from pydantic import BaseModel

class CreditApplication(BaseModel):
    applicant_age: int
    monthly_income: float
    credit_history_score: float

Streamlining Deployment with CI/CD

No API is truly production-ready without automated testing and deployment. We integrated GitHub Actions to create a continuous delivery pipeline. Every time code is pushed, the workflow builds a containerized version of the API, runs verification tests, and ensures the model environment remains consistent across development and production settings.

Model Inference Flow

Our service follows a straightforward flow where incoming requests are validated, processed through a pre-trained scikit-learn pipeline, and returned as a serialized prediction:

from fastapi import FastAPI
import numpy as np

app = FastAPI()

@app.post("/predict")
def get_credit_score(data: CreditApplication):
    # Transform input to feature vector
    features = np.array([[data.applicant_age, data.monthly_income, data.credit_history_score]])
    # Run inference
    prediction = model.predict(features)
    return {"score": float(prediction[0])}

Results

This container-first approach drastically reduces the "it works on my machine" syndrome. By automating the build process with GitHub Actions, we have reduced the lead time for deploying model updates from hours to minutes, significantly increasing our ability to react to changing credit market variables.

Next Steps

Moving forward, we plan to implement model monitoring to detect drift in prediction performance over time and explore caching strategies for frequently requested profiles to further decrease latency.


Generated with Gitvlg.com

Scaling ML Workflows: Deploying Credit Scoring APIs with FastAPI
Sneider Rincón Castrillón

Sneider Rincón Castrillón

Author

Share: