Massachusetts Education Jobs

Job Description

We are seeking a visionary leader to spearhead foundation model research and development efforts. As the lead of the evaluation science team, you will be responsible for driving the development and implementation of cutting-edge evaluation methods and technologies for evaluation of large language models, visual large language models, and agentive workflows that utilize them. You will lead a team of world-class scientists in inventing, implementing, and deploying state-of-the-art generative AI evaluation methods and/or specific domain industry algorithms and systems. You will lead prototyping and exploration of conceptually new solutions. You will work collaboratively with engineering, product, and other science teams to identify customer needs in order to create and implement solutions, promote innovation, and drive service adoption, developing new intelligence around core products and services through applied research on behalf of our customers.

As a Senior Principal, you will drive and plan implementation of company policy for achieving business goals, defining the bar for science practices while helping teams achieve those goals. You will develop deep product intuition to influence future product roadmaps and drive decision making, clearly articulating technical work to audiences of all levels and across multiple functional areas in both internal and external settings. You will engage in forward looking research, both internal and with academic institutions globally. You will perform an active role in team hiring, planning, review, and retrospective events. You will ensures experiments are ready for hand-off to Software Developers ship into production.

Career Level - IC5

Responsibilities

Responsibilities:

• Research and Development: Conduct in-depth research on foundation model evaluation, including traditional NLP/CV metrics, LLMaaJ techniques, human evaluation, confidence estimation, agentive application evaluation, and RAG application evaluation. Produce production-ready code for handoff of POC applications to counterparts in Engineering.

• Team Leadership: Help build and mentor a high-performing team of scientists and engineers.

• Collaboration: Work closely with cross-functional teams to integrate evaluation capabilities into various applications and products.

• Innovation: Identify new opportunities for evaluation and explore emerging technologies.

• Stay Updated: Maintain a deep understanding of industry trends and advancements in evaluation.

Qualifications and Experience:

• PhD Computer Science, Mathematics, Statistics, Physics, Linguistics or a related field (with a dissertation, thesis or final project centered in Machine Learning/Deep Learning/Generative AI). PhD plus 5+ years relevant experience is preferred but not a must; OR Masters or Bachelor’s in related field with 8+ years relevant experience

• Strong publication record, including as a lead author or reviewer, in top-tier journals or conferences.

• Extensive experience in generative AI and model/application evaluation.

• Proven track record of leading research and development projects

• Strong understanding of machine learning algorithms and architectures

• Excellent problem-solving and analytical skills

• Strong leadership and communication abilities

Disclaimer:

Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range in USD from: $139,400 to $291,800 per annum. May be eligible for bonus, equity, and compensation deferral.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.

Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:

1. Medical, dental, and vision insurance, including expert medical opinion

2. Short term disability and long term disability

3. Life insurance and AD&D

4. Supplemental life insurance (Employee/Spouse/Child)

5. Health care and dependent care Flexible Spending Accounts

6. Pre-tax commuter and parking benefits

7. 401(k) Savings and Investment Plan with company match

8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.

9. 11 paid holidays

10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.

11. Paid parental leave

12. Adoption assistance

13. Employee Stock Purchase Plan

14. Financial planning and group legal

15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

About Us

As a world leader in cloud solutions, Oracle uses tomorrow’s technology to tackle today’s problems. True innovation starts with diverse perspectives and various abilities and backgrounds.

When everyone’s voice is heard, we’re inspired to go beyond what’s been done before. It’s why we’re committed to expanding our inclusive workforce that promotes diverse insights and perspectives.

We’ve partnered with industry-leaders in almost every sector—and continue to thrive after 40+ years of change by operating with integrity.

Oracle careers open the door to global opportunities where work-life balance flourishes. We offer a highly competitive suite of employee benefits designed on the principles of parity and consistency. We put our people first with flexible medical, life insurance and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by calling +1 888 404 2494, option one.

Disclaimer:

Oracle is an Equal Employment Opportunity Employer*. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

* Which includes being a United States Affirmative Action Employer