Senior AI Architect and Integrations Engineer
Alyn Inc.
- Location
- Atlanta, US (hybrid)
- Workplace
- Hybrid
- Job type
- Full-time
- Salary
- $175k
- Posted
- Today
- Source
- DevITJobs
Requirements:
- Bachelors or masters degree in computer science, data science, artificial intelligence, information technology, cybersecurity, or a related technical field; a bachelors degree is preferred.
- At least 8 years of experience in AI/ML engineering, data architecture, or advanced cybersecurity analytics, including at least 3 years in technical leadership or staff management.
- Proven experience designing, evaluating, and operating production AI/ML systems and modern AI architectures in enterprise environments.
- Hands-on experience implementing LLM applications and orchestration frameworks such as LangChain, and deploying local or self-hosted models such as Ollama.
- Experience establishing AI governance, model evaluation frameworks, and provenance and validation controls for automated or AI-assisted decision systems.
- Hands-on experience developing secure APIs, data integration contracts, and pipeline automation in enterprise Linux and cloud environments.
- Deep expertise in LLM application frameworks and orchestration tools such as LangChain or LlamaIndex, including agentic workflows, prompt management, and tool-calling architectures.
- Experience configuring, benchmarking, and optimizing local model inference engines such as Ollama, vLLM, or llama.cpp.
- Experience designing and deploying production retrieval-augmented generation (RAG) systems integrated with vector stores and analytical databases.
- Proficiency in Python, SQL, R, and machine learning frameworks such as PyTorch, TensorFlow, or Hugging Face.
- Strong background in cyber threat intelligence, security operations, detection engineering, and threat hunting.
- Experience with canonical data modeling, high-volume analytical databases, schema design such as JSON Schema or OpenAPI, and data pipeline automation.
- Familiarity with Docker, Kubernetes, and Terraform across cloud and hybrid environments.
- Knowledge of AI risk management and compliance standards, such as NIST AI RMF, CMMC, and federal cloud security authorization requirements.
- U.S. citizenship is required.
- At least 8 years of AI/ML experience is required.
- Ability to commute to Atlanta, Georgia 30329, is required.
Responsibilities:
- Lead, mentor, and manage AI engineering staff, setting technical priorities, development standards, and performance expectations across modeling and engineering workflows.
- Architect, evaluate, and operationalize private local models and cloud-hosted LLMs in secure network enclaves while maintaining data isolation, preventing data leakage, and supporting low latency.
- Build tool-integrated, agentic LLM workflows and orchestration pipelines to automate analyst investigations and structured data queries.
- Establish and enforce AI governance, including model validation, data provenance, bias mitigation, human review criteria, and separation of authoritative security evidence from model inference.
- Oversee end-to-end AI/ML and LLM pipelines, from data ingestion, normalization, and feature extraction through model training, containerized deployment, and continuous monitoring.
- Design secure service interfaces and integration contracts, including REST APIs and schema validation, to connect models with cybersecurity platforms, SIEM and telemetry stores, and external tools without uncontrolled backend access.
- Guide development of advanced detection capabilities, anomaly models, RAG systems, and cross-organizational threat correlation using high-volume security data.
- Partner with platform, cloud, and infrastructure teams to design secure hosting topologies, compute environments, and private networks across cloud, hybrid, and government-authorized enclaves.
- Define benchmarks, test datasets, and operational metrics to evaluate model accuracy, reliability, latency, cost, and failure modes before production deployment.
- Advise executive leadership and external stakeholders by translating operational needs into architecture roadmaps, technical documentation, and prototypes.
Technologies:
- AI
- Architect
- Backend
- Cloud
- Docker
- JSON
- Kubernetes
- LLM
- Linux
- Machine Learning
- Model Training
- Network
- OpenAPI
- PyTorch
- Python
- RAG
- REST
- SQL
- Security
- TensorFlow
- Terraform
- vLLM
More
At Alyn, Inc., we partner with Fortune 50 companies and leading government agencies to advance cybersecurity operations through innovative initiatives. We are hiring an experienced Principal AI Architect/Engineer to shape the architecture, governance, implementation, and deployment of AI and advanced analytics for enterprise cybersecurity operations. This role connects cyber threat operations, data engineering, and secure infrastructure, with an emphasis on reliable, explainable AI and human oversight. The position is hybrid remote in Atlanta, Georgia 30329, with pay starting at $175,000 per year. Our benefits include 401(k) matching, dental, health, vision, and life insurance, flexible spending and health savings accounts, paid time off, professional development assistance, and tuition reimbursement.
last updated 43 week of 2026