AI Controls Testing Analyst

We’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive end-to-end offerings, we advise, engineer, and manage, ensuring our clients proactively drive toward success in this ever-evolving digital landscape.Our team is growing, and we’re searching for an AI Controls Testing Analyst who is a creative problem-solver with their fingertips on the latest industry practices to help our clients achieve digital realization. You’ll join a group of industry veterans, blending the power of tried-and-true methods with cutting-edge technologies. We prioritize authentic partnerships in a collaborative environment, and we’re excited to welcome an AI Controls Testing Analyst who is eager to bring their expertise to our team.ResponsibilitiesConduct testing of operational controls and compliance with controls standards and requirements for Gen AI tools in production. Analyze, interpret and report on the results of the testing.Conduct root cause analysis, identify controls gaps and deficienciesEvaluate inherent and residual risk for Gen AI technology reviewed.Makes recommendations for remediation.QualificationsKnowledge of AI / ML concepts, especially Gen AI (LLMs)Understanding of Gen AI risks, familiarity with AI governance standards and AI ethics principles (bias, fairness, transparency, responsible AI usage)Control frameworks expertise (NIST) Audit and compliance testing – ability to test whether AI tools are compliance with organizational controls policies (access controls, data handling, model explainability)Data analysis – collect and analyze relevant data to ensure AI tools perform as expected and identifying potential risks and control gaps. Problem solving and critical thinking: issue identification, root cause analysis.Company BenefitsHealth, Dental, Vision, 401(k), 20 days of Paid Time Off (PTO)AdditionallyEntech is an equal-opportunity employer.This is an On-site Hybrid work schedule based out of our Malvern, PA OfficeNo Third-party candidates will be accepted, this is strictly a direct employment opportunity with Entech.

Created: 2025-01-19