Lavora.

Back to search

Government Subject Matter Expert (SME) - AI Model Evaluation

Volga Partners

Location
Remote (US)
Workplace
Remote
Job type
Contract
Posted
Today
Source
Himalayas
Apply on company site
Remote | United States | Project-Based Independent Contractor Compensation: $35–$40 USD/hour, based on relevant experience and project requirements Help Shape the Future of AI in Government What if your years of experience navigating government regulations, evaluating complex cases, or interpreting public-sector policies could help make artificial intelligence more accurate, reliable, and effective? At Volga Partners, we're bringing experienced government professionals into the next generation of AI development. We're seeking Government Subject Matter Experts (SMEs) who can apply their professional knowledge, analytical judgment, and industry experience to evaluate and improve advanced AI models. This isn't a traditional government position, and you won't be processing applications or managing government caseloads. Instead, you'll use your expertise to assess how well AI systems interpret information, apply regulations, reason through complex scenarios, and produce accurate, defensible conclusions. Your expertise is what matters. AI experience is a plus, not a requirement. The Opportunity As a Government SME, you'll serve as a subject matter evaluator, helping assess the quality, accuracy, and reasoning of AI-generated responses across specialized government functions. You'll examine realistic scenarios, identify errors or gaps in AI-generated conclusions, and provide expert feedback grounded in established regulations, policies, and professional standards. Your contributions will help improve how AI systems understand and respond to complex public-sector challenges. Areas of Expertise We're Seeking We're particularly interested in professionals with substantial knowledge and practical experience in one or more of these areas: 1. Government Policy, Public Records & Regulatory Compliance - Interpreting federal, state, or local government regulations and policies - Freedom of Information Act (FOIA), public records, and disclosure requirements - Privacy compliance, sensitive information protection, and regulatory auditing - Evaluating complex compliance scenarios and identifying regulatory risks 2. Government Programs, Eligibility & Administrative Decision-Making - Interpreting government program requirements and eligibility regulations - Evaluating complex cases, supporting documentation, and administrative determinations - Identifying inconsistencies, compliance issues, or unsupported decisions - Applying professional judgment to regulatory and program-specific scenarios 3. Government Procurement, Contracts & Vendor Evaluation - Federal, state, or local government procurement processes - Request for Proposal (RFP) analysis and evaluation - Contracting standards, vendor selection, and procurement compliance - Developing or applying evaluation criteria, scoring methodologies, and defensible recommendations You do not need expertise in every area. We're seeking depth of knowledge within your particular specialization. What You'll Do - Evaluate AI-generated responses: Review complex government-related scenarios for accuracy, completeness, reasoning, and regulatory alignment. - Apply expert judgment: Determine whether AI-generated conclusions are appropriate, defensible, and supported by relevant policies or regulations. - Identify errors and gaps: Recognize inaccurate interpretations, flawed assumptions, missing information, and potential compliance concerns. - Validate against authoritative sources: Use applicable statutes, regulations, agency guidance, and professional standards to verify findings. - Develop evaluation benchmarks: Help establish high-quality reference responses, assessment criteria, and examples of sound professional reasoning. - Provide actionable feedback: Clearly explain your evaluations and recommend improvements to AI-generated content. - Collaborate on quality: Apply project-specific evaluation guidelines and participate in quality reviews to support consistency and accuracy. Why Join Volga Partners? Put your professional expertise to work in a new way. Rather than performing traditional government administrative functions, you'll apply the knowledge you've developed throughout your career to emerging AI technology. Contribute to meaningful AI development. Your evaluations will help identify weaknesses in AI reasoning and improve the accuracy and reliability of AI-generated information. Work remotely with project-based flexibility. Participate in specialized assignments from anywhere in the United States, with opportunities for future engagements based on project availability and performance. No AI background required. We value professionals who understand their field and can recognize when an AI-generated answer is right, wrong, incomplete, or misleading. Project Details - Engagement: Independent contractor, project-based - Location: Remote, United States only - Compensation: $35–$40 USD/hour - Schedule: Variable, based on project assignments and deadlines; weekday or weekend availability may be needed - Duration: Initial short-term pilot, with potential future project opportunities - Selection Process: Qualified candidates must successfully complete a skills-based assessment evaluating domain expertise, analytical reasoning, and ability to follow project guidelines Hours and future assignments are not guaranteed. Compensation is subject to completion of assigned work in accordance with project instructions and quality standards. Ready to Apply Your Expertise to the Future of AI? If you've built your career understanding government systems, interpreting regulations, evaluating complex information, or making informed professional assessments, we'd love to hear from you. Bring your expertise. Help us build better AI. Apply today to be considered for upcoming Government SME opportunities with Volga Partners. Requirements Who We're Looking For We're seeking experienced professionals who bring more than familiarity with government processes. You should be comfortable analyzing complex information, exercising independent judgment, and explaining the reasoning behind your conclusions. Required Qualifications - At least 2 years of relevant professional experience in government operations, public administration, regulatory compliance, government procurement, or a closely related field - Demonstrated subject matter expertise in at least one of the government specializations outlined above - Experience interpreting, evaluating, auditing, or applying government policies, regulations, or professional standards - Strong analytical reasoning and the ability to identify inaccuracies, inconsistencies, and unsupported conclusions - Excellent written communication skills, including the ability to explain complex findings clearly and concisely - Ability to conduct independent research and validate information using authoritative sources - Comfort using digital platforms, online research tools, and structured evaluation guidelines - Current U.S. residency and ability to work independently in a remote, project-based environment Especially Valuable Experience We encourage applications from professionals with backgrounds such as: - Government Policy or Program Analyst - Senior Regulatory or Compliance Analyst - Government Auditor or Quality Assurance Specialist - Public Records or Privacy Compliance Officer - Government Procurement or Contracting Specialist - RFP Evaluation or Source Selection Specialist - Government Program Manager or Senior Eligibility Analyst - Public Sector Consultant or Regulatory Advisor Experience with AI model evaluation, large language models (LLMs), research, or structured quality assessments is beneficial but not required. Originally posted on Himalayas

Similar jobs