• Develop, maintain, and enhance automated test suites for back-end REST APIs and web-based user interfaces.
• Build and maintain a scalable, reliable test automation harness (framework) including execution, reporting, data setup/teardown, and CI/CD integration.
• Implement and expand Python-based test automation using Pytest, including fixtures, test data strategies, and robust assertions/validation.
• Create and maintain Docker/Podman container images used to run automation consistently across developer environments and CI pipelines.
• Integrate automated test execution into Jenkins and GitLab CI/CD pipelines, ensuring repeatable runs, clear reporting, and actionable results.
• Use Linux command-line tools and Bash shell scripting to locate, parse, transform, and report on large volumes of logs, test output, and system data.
• Support and extend UI automation using Robot Framework and the Python Selenium library, including test stability improvements and best practices.
• Collaborate with stakeholders to plan, estimate, and break down work for migrating the current in-house test harness from legacy Robot Framework to a modern alternative (e.g., Robot Framework AIO or Microsoft Playwright).
• Write and maintain SQL queries (using SQL Developer or similar tooling) and integrate database validation steps into automated tests were appropriate.
• Troubleshoot CI failures and test irregularity/volatility, improve test reliability, and contribute to continuous improvement of the overall QA automation approach.
• Assist with any or all of the Level I tasks as constrained by technical training and previous testing experience
• Conduct research into and apply knowledge of Government test and evaluation concepts all related engineering acquisition and operations activities as needed to support the T&E activities
• Plan and Execute Performance Analysis
• Review planned acquisition approaches to support T&B schedule alignment with decision maker needs for T&E support
• Analyze performance risk areas to focus T&B planning
• Specify, validate, and adapt Modeling and Simulation for T&E use
• Apply Statistical Analysis of variations in performance behavior to characterize confidence in
• performance estimates
• Select, develop, & use analysis tools
• Execute the evaluation plan of data collected by the Testing Task
• Plan and Execute Performance Data Collection
• Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
• Establish and employ Data & Configuration Management capabilities
• Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
• Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
• Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
• Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
• Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions· levels of T&E include inspection, demonstration paper analysis, survey simulation, and physical test
• Design surveys for evaluation of Subject Matter Expert (SE input and user as estimates of performance)
• Participate in the T&E Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
• Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/T&E cross-walk), Analysis Plans Data Requirements Risk Assessments, Evaluation Reports Status reports; provide input to Government T&E products (e.g., Technology Readiness Assessments, Test & Evaluation Strategy, Test & Evaluation Master Plan, T&E Plans & Procedures and Test
• Readiness Reports)
• Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
• Select, coordinate. and calibrate Instrumentation, collection and data management tools, targets, and facilities
• Ensure test readiness including training of test event participants re conduct of the event; equipment readiness, and security legal, and privacy compliance arrangements
• Participate in T&E WIPT and/or Integrated Test Team for coordination of data collection plan -
• Execute Testing and Data Collection per plan
• Produce associated Test Plans, Procedures, and Reports /Briefings, Data Management Plan
• Define and provide technical direction and guidance for the Level 1 tasks to the Level 0 and Level 1 TEs assigned to the task
• Recommend draft plans and reports from the Level 1 tasks for approval by the task leader
• Work directly with the Government sponsor to coordinate task implementation
• Maintain knowledge of current and evolving agency, national, and international standards applicable to the system development of interest
• Provide overall leadership of the T&E task and serve as primary liaison to the government for supporting contract coordination and task execution
• Communicate issues and solutions to the broader government and contract management structure as requested by Leadership
• Ensure the appropriate level of independence of the team from the solution provider to support government management of objectivity risk
• Manage T&E resources and tasks; ensure quality assurance of test processes and product
• Coordinate and integrate Evaluation and Testing tasks and products
• Participate in T&E WIPT and /or integrated Test Team as needed to ensure proper coordination of T&E activities
• Drive innovation and responsiveness to program changes and evolving T&E status to help manage program risk; develop alternative courses of action, work-arounds, and fall-back positions with a recommended course of action for each risk and monitor and re-evaluate risks at appropriate milestones