Share Your Requirements
Cloudrangers
LANCERProject Description
Cloudrangers, a fintech firm building an air-gapped LLM-powered compliance analysis platform, approached Oodles to strengthen trade surveillance and account monitoring. The organization required secure deployment of vLLM with Llama-3 on AWS GPU infrastructure, along with contextual risk analysis modules aligned with FINRA and regulatory standards.
Scope Of Work
The client sought Oodles to address the secure deployment of LLMs and regulatory-grade risk analysis within a private, no-internet VPC environment. Areas of Work included AWS GPU provisioning using Terraform, vLLM + Llama-3 deployment, prompt engineering for trade-level explanations, API development for structured JSON outputs, and behavioral pattern detection aligned with FINRA 2111, 2010, Reg BI, and 2165 compliance needs.
Our Solution
A secure and scalable LLM-powered compliance framework was implemented within an air-gapped AWS environment to support advanced trade surveillance and regulatory monitoring.
Implementation Approach:
- Air-Gapped AWS Deployment: Configured private VPC infrastructure with no internet access to ensure data confidentiality and regulatory compliance.
- GPU Provisioning with Terraform: Automated AWS g5 GPU instance setup for scalable and reproducible infrastructure management.
- vLLM + Llama-3 Integration: Deployed Llama-3-8B models using vLLM for optimized inference performance and low-latency analysis.
- Prompt Engineering Framework: Designed structured prompts to generate contextual explanations for flagged trades and account-level analysis.
- Behavioral Pattern Detection: Implemented activity-based risk detection modules to surface anomalies aligned with FINRA 2111, FINRA 2010, Reg BI, and FINRA 2165.