Job Summary
Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG delivers solutions through leading‑edge management consulting along with technology and design, corporate and digital ventures, and business purpose. Working in a uniquely collaborative model across the firm and throughout all levels of the client organization, BCG generates results that allow our clients to thrive.
What You'll Do
As a Responsible AI Applied Scientist, you will develop and apply innovative tools for testing and evaluating new Gen‑AI products. Your daily work will involve designing and implementing testing and evaluation frameworks to help improve product quality and ensure AI systems are safe, secure, and equitable. You’ll support a wide variety of projects, spanning use cases, technologies, industries, and clients, and influence the development of Gen‑AI applications with a focus on transparency, accountability, and trustworthiness.
- Ensure responsible development of Gen‑AI and AI products by providing Responsible AI expert support to Gen‑AI and AI product teams, including conducting independent assessment of product‑level risks and owning product evaluations.
- Engage independently and directly with BCG product teams to support Responsible AI‑related needs across the entire software development lifecycle of Gen‑AI or AI products.
- Work with and support technical teams executing risk assessment, testing, and evaluation of Gen‑AI and AI products.
- Train and mentor technical teams on testing and evaluation approaches for Gen‑AI products.
- Remain up‑to‑date on emerging frameworks, standards, and technical approaches, and related issues by participating in workshops, reading professional publications, maintaining personal networks, and participating in professional organizations.
What You'll Bring
- 3‑5+ years of experience in Responsible AI, including directly engaging with AI product teams.
- 3+ years of industry experience in building or evaluating Generative AI models.
- Experience in program/project management and team leadership.
- Strong programming skills in Python and deep learning frameworks (PyTorch, TensorFlow).
- Demonstrable knowledge of Responsible AI issues, trends, frameworks, and best practices.
- Working knowledge of emerging AI regulatory and legal frameworks across the globe.
- Excellent written and verbal communication skills across technical and non‑technical audiences.
- Ability to explain sophisticated data science concepts to non‑technical audiences and translate analytical results into business implications.
- Ability to think critically about ethical, social, and business risks posed by Gen‑AI and AI systems.
- Passion for building things and comfort working with modern data science development tools.
- Experience designing and analyzing experiments using advanced statistical methods.
- Experience and enthusiasm for working with Gen‑AI technologies.
Technical Skills
Must‑have experience
- Advanced degree (MS or PhD) in Computer Science, Software Engineering, or equivalent research/work experience.
- Strong research background in empirical evaluation, experimental design, or benchmarking.
- Deep familiarity with software engineering workflows and developer tools.
- Experience working with or evaluating AI/ML models, preferably LLMs.
- Strong analytical and communication skills, including the ability to write clear testing result reports.
Nice‑to‑have experience
- Experience with quantitative social science research.
- Familiarity with software engineering practices (e.g., unit testing, CI/CD).
- Exposure to cloud platforms (AWS, Azure, GCP) or SQL databases.
- Knowledge of AI risk management frameworks (e.g., NIST AI RMF).
- Experience with developer tools, including IDEs (e.g., VSCode, PyCharm) and environment management (e.g., Pyenv, Conda, Poetry, Docker).
- Demonstrable contribution to open‑source evaluations of Gen‑AI.
Who You'll Work With
You’ll collaborate with a diverse set of stakeholders, including senior executives, AI and Gen‑AI product teams, legal, compliance, and security teams, BCG’s Chief AI Ethics Officer, the Director of the Responsible AI team, and other members of the Responsible AI team.
Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, veteran status, or any other characteristic protected under applicable local, provincial, or state law. Candidates with criminal histories will be considered in a manner consistent with applicable state and local laws.
#J-18808-Ljbffr