Codashop, ML Jobs in Usa

Join us in revolutionizing an entire industry's customer engagement! We prioritize human connection through technology. If you're driven by purpose and want to make a meaningful impact on people's lives, this is the place for you. Our team challenges norms with the support of a trusted American brand.

Purpose: A leading professional services firm found that AAA Life associates demonstrate some of the highest levels of commitment, empathy, and dedication when compared to top U.S. companies in a benchmark analysis.

Growth: We have the privilege to offer our products to tens of millions of Americans that make up the AAA member base

Focus is on \"working families\", \"everyday Americans\", \"ordinary citizens\", \"mainstream population\" \"average income households\", providing life insurance products that truly impact people's lives (more information will be provided in the interview).

Team (Culture): USA Today named us a 2024 and 2025 top US workplace

Who are we looking for?

The Director, Enterprise Fraud Strategy & Investigations leads the enterprise-wide fraud prevention and detection strategy across all life insurance products and services. This senior leader will design, implement, and oversee a best-in-class fraud program that ensures regulatory compliance, protects company assets, and preserves stakeholder trust. The Director will partner cross-functionally to influence organizational strategy, drive innovation in fraud analytics, and lead high-impact investigations involving complex financial fraud, insurance fraud, and identity theft.

How will you contribute?

• Develop and oversee the enterprise fraud program including policies, procedures, and governance structures.
• Define the vision, roadmap, and performance metrics for fraud prevention and detection capabilities.
• Ensure alignment with regulatory expectations, industry best practices, and enterprise risk appetite.

• Lead and mentor a team of investigators, analysts, and program managers.
• Build a culture of integrity, accountability, and continuous improvement.
• Establish clear goals and performance indicators to drive individual and team success.

• Oversee complex and sensitive investigations related to claims misrepresentation, application fraud, identity theft, and internal fraud.
• Direct case prioritization, resource allocation, and escalation strategies.
• Collaborate with Legal, Compliance, HR, and Law Enforcement to ensure appropriate resolution and reporting.

• Lead efforts to evaluate, implement, and optimize advanced fraud detection tools (e.g., AI/ML, behavioral analytics, case management systems).
• Oversee the development of dashboards and reporting for executive leadership and board-level committees.
• Champion data-driven decision-making and continuous innovation.

• Serve as the company's subject matter expert and external liaison to NICB, IASIU, regulators, and industry task forces.
• Coordinate with Underwriting, Claims, Operations, and Technology to drive alignment on fraud controls.
• Represent the organization in regulatory reviews, audits, and legal proceedings as required.

• Oversee the design and delivery of fraud prevention training programs across the enterprise.
• Promote organizational awareness through internal communications, campaigns, and leadership engagement.

What do you offer?

• Bachelor's degree in Criminal Justice, Finance, Insurance, or related field; advanced degree or MBA preferred.
• Minimum of 10 years of progressive fraud investigation experience, including 5+ years in a leadership role within the life insurance industry.
• In-depth knowledge of life insurance products, the policy lifecycle, and regulatory frameworks.
• Certifications strongly preferred (e.g., CFE, FCLS, AHFI).
• Experience managing sensitive investigations, preparing executive-level reports, and testifying in legal/regulatory proceedings.
• Expertise in fraud detection platforms and data analytics tools (e.g., SAS, i2 Analyst Notebook, FRISS).

Preferred Attributes

• Law enforcement or regulatory liaison experience is a plus.
• Active involvement in industry fraud prevention organizations and a strong network of investigative contacts.

What can we offer?

• Enjoy a hybrid work environment that promotes work-life balance.
• Comprehensive medical, dental, and vision coverage starting from your first day.
• Employer 401k match and employer contribution to a pension plan.
• Generous PTO and paid parental leave to support your family needs.

At January AI, we believe every day is January 1st a fresh start for better health. Founded in 2017 and headquartered in Menlo Park, California, January AI is the first AI-powered precision health company focused on improving metabolic health and advancing personalized nutrition. Co-founded by tech executive Noosheen Hashemi and Stanford geneticist Dr. Michael Snyder, we bring together machine learning, multi-omic science, and real-world health data to empower individuals to take control of their health. Our flagship January app uses data from continuous glucose monitors, wearables, and food logs to predict users' blood sugar responses to more than 54 million foods, delivering real-time, personalized recommendations for nutrition, activity, and lifestyle. In 2025, we introduced Mirror, which integrates genomics, wearable data, and at-home diagnostics to offer clinical-grade guidancesupporting both individuals and enterprise health partners with tailored insights and actions. We're now expanding our impact beyond the home, partnering with global leaders in hospitality and healthcare to bring precision nutrition, health, and longevity to the forefront of the guest experience. Recognized as one of Fast Company's Most Innovative Companies (2025, Wellness), a CES Innovation Honoree (2025), and one of Inc.'s Best in Business (2024), January AI is backed by visionary investors including Marc Benioff, Jerry Yang, and Steve Chen. Our work has been featured in The Wall Street Journal, The New York Times, STAT, Financial Times, and TechCrunch.

$200,000 - $250,000 a year

About this Role: Vice President of Product

January AI is seeking a strategic, visionary, and execution-driven Vice President of Product to lead our product organization during a period of rapid growth and innovation. Reporting to the CEO, the VP of Product will own and evolve our product roadmap across mobile, web, AI-driven insights, and clinical-grade health features. You'll partner cross-functionally with Engineering, Design, Marketing, and Commercial leaders to deliver experiences that are trusted by users, embraced by clinicians, and scalable across consumer and enterprise segments. You should be deeply user-centric, data-informed, and comfortable operating across 0-to-1 product innovation and enterprise-scale product delivery. This role is ideal for a leader who wants to shape the future of metabolic health through breakthrough AI and multiomic experiences.

Key Responsibilities

• Own the product vision, strategy, and roadmap aligned with January AI's mission and commercial goals.
• Lead and grow a team of product managers and designers to execute across consumer, clinical, enterprise, and data products.
• Collaborate closely with Engineering, Data Science, Clinical, and Commercial teams to deliver seamless, high-impact experiences.
• Ensure all products are grounded in user research, evidence-based health science, and measurable outcomes.
• Translate complex AI and multiomic data into actionable insights for consumers and clinicians.
• Establish strong product processes: planning, execution, QA, user testing, sprint rituals, and stakeholder communication.
• Own product analytics, KPIs, and usage metrics to inform decisions and drive continuous improvement.
• Represent the voice of the user internally and with external partners, payers, and healthcare systems.
• Guide regulatory and compliance-related product decisions (HIPAA, FDA, etc.) in partnership with Clinical and Legal teams.
• Champion a culture of rapid iteration, data-informed decision-making, and exceptional user experience.

Qualifications

Required

• 8+ years of experience in product management, with 4+ years in a leadership role managing product teams.
• Proven success shipping and scaling products in digital health, AI/ML-powered software, or consumer SaaS.
• Track record of building B2C or B2B2C health products with high engagement and retention.
• Strong user empathy and ability to synthesize qualitative and quantitative feedback into actionable insights.
• Familiarity with product development lifecycle, Agile/Scrum methodologies, and working in regulated environments.
• Experience with mobile and web app development, API integrations, and cross-platform consistency.
• Exceptional communication and cross-functional leadership skills.
• Comfort working in a fast-paced, startup environment with shifting priorities and rapid execution.

Preferred

• Technical background or experience working with machine learning, sensor data, or connected devices.
• Understanding of healthcare data standards (HL7, FHIR, etc.).
• Experience with glucose monitoring, metabolic health, or wearable health products.
• Background in behavioral science, habit formation, or health coaching product models.

Why Join January AI

• Mission-driven: Help redefine what health means for millions through science and empathy.
• Science-led: Work alongside world-class scientists, clinicians, and technologists.
• Purpose-built: Where deep research meets beautiful, scalable product experiences.
• Category-creating: Help shape the future of precision health in hospitality, consumer health, and beyond.

Collectiv is seeking a dynamic, results-driven Business Development Executive with a growth mindset and a hunter mentality to drive new business in a complex consulting environment. This role requires a proven track record in selling Microsoft Data & AI solutions, including Microsoft Fabric, Power BI, Azure, Databricks, Copilot, and AI-driven technologies.

Are you passionate about leveraging Data & AI to drive business transformation? At Collectiv, we empower organizations to unlock the full potential of Microsoft's Data & AI ecosystem. As part of our team, you'll build strong client relationships, drive strategic growth, and sell impactful solutions that shape the future of data-driven decision-making.

• Experience selling Microsoft Data & AI consulting services is required.
• Proven success in selling consulting engagements related to Microsoft Fabric, Power BI, Azure, Databricks, Copilot, and AI/ML solutions is required.
• Proven track record as a proactive business developer, excelling in identifying and closing net-new opportunities in a competitive market is required.
• Ability to act as a trusted advisor, addressing complex business challenges with data strategy, analytics, and AI-driven solutions.
• Experience selling at the C-suite level, driving strategic business transformation.
• Growth mindset, with a focus on overcoming obstacles, executing high impact initiatives, and delivering tangible business outcomes.

• You are a proactive dealmaker who excels at identifying and closing high-value opportunities in the Data & AI space.
• You are a self-motivated, strategic thinker who thrives in complex sales cycles and consultative engagements.
• You bring energy, collaboration, and perseverance, navigating challenges to drive successful outcomes.
• You have exceptional interpersonal skills, building trusted relationships with clients, partners, and internal teams.
• You anticipate challenges and address objections with a solutions-oriented, consultative approach.
• You are a persuasive communicator and influencer, effectively aligning technology solutions with business needs.

• Specialize in Microsoft Data & AI solutions, including Microsoft Fabric, Power BI, Azure, and AI-driven technologies.
• Identify, develop, and close high-impact data transformation opportunities, managing the entire sales lifecycle.
• Drive revenue growth by cultivating strong relationships with enterprise and mid-market clients.
• Partner closely with Microsoft teams and ecosystem collaborators, leveraging co-sell opportunities and joint go-to-market strategies.
• Build and maintain a strong sales pipeline, ensuring consistent and sustainable business expansion.
• Stay ahead of market trends, competitive landscapes, and emerging Microsoft Data & AI advancements to offer informed solutions.
• Work in collaboration with Collectiv's consulting and delivery teams, ensuring smooth transitions from sales to execution for client success.

Join Collectiv for a rewarding career in a fully remote work environment with quarterly in person team experiences and a competitive compensation. We provide a clear growth trajectory with professional development opportunities and a top-shelf benefits package. Enjoy unlimited time off and 100% covered health insurance, encompassing medical, dental, and vision plans for you and your family. Our comprehensive offerings, from a competitive 401(k) with a 4% match to educational assistance, tech stipend, and discounts on various goods and services, demonstrate our commitment to your well-being and success. At Collectiv, your career thrives with a perfect blend of remote flexibility, growth potential, and unparalleled benefits prioritizing your financial, physical, and emotional well-being.

Collectiv is the leading boutique consulting and strategy firm specializing in Analytics, Planning and AI with Power BI and the Microsoft Data Stack.

Our mission at Collectiv is simple: We help enterprises make better decisions.

Our Core Values:

Growth Mindset Bring solutions, not problems.

Excel with Humility Be humbly brilliant.

Communicate Actively and Empathically Listen, ask, understand, help.

Work Hard, Play Hard Results are proportional to effort.

Keep Calm and Carry On Stay cool, calm and Collectiv.

Join the ranks of Redfin's top-producing real estate agents by joining an agent team or individually, and get the best of both worlds: highly competitive commissions coupled with customers, benefits, and support!

Maximize your earnings by plugging into the Redfin platform and the nation's #1 brokerage site, which gets 52 million monthly visitors and 600 million luxury listing views each year. We offer our agents progressive commissions: the more you sell, the more you keep from your Redfin-generated and loyalty customers. And since Redfin covers your business expenses, what you earn is what you keep.

Redfin agents have everything they need to reach more qualified buyers and win listings.

• Customers: You'll get 100 new customers each year from Redfin, in addition to helping clients already in your sphere or book of business.

• Technology: Our proprietary CRM helps you manage your deals and stay in touch with your whole pipeline, alerting you when someone might be ready to make another move.

• Support: You'll get support from a dedicated transaction coordinator, listing coordinator, and a team of showing agents. Our inside sales team qualifies opportunities and books them directly on your calendar. They handle many details for events, like organizing showing appointments and letting you know when and where to show up.

Redfin agents earn competitive commissions on their closed deals, with unlimited upside! Commissions vary by deal source with higher splits awarded for repeat Redfin clients:

• Competitive Splits: Redfin Agents earn competitive commissions on the revenue of their closed deals, and there are no limits on the amount you can earn. Splits vary by deal source (Agent-generated or Redfin-generated) and higher commission splits are awarded for your repeat Redfin clients.

• In-Year Accelerators: Opportunity to unlock higher commissions through an in-year commission accelerator that lasts the remainder of the year, if you hit a specified sales volume threshold.

• Top Producer Perks: Earn a President's Club trip to an international destination, qualify for stock grants and get exclusive access to represent clients buying and selling high-priced homes through our luxury brand.

Everything you need, none of the hassle.

• Zero Agent Fees: We pay all of the necessary costs of doing business, including state license and MLS dues, association fees, mileage, cell phone plan, and more.

• Healthcare, 401K, and More: Our generous benefits package includes medical, dental, vision, and insurance benefits, flexible spending account, health savings account, life and disability insurance, fertility benefits, commuter benefits, Employee Assistance Programs; and 401(k) employer match.

• Marketing Investment: We're spending $65M in 2025 to connect our agents with buyers and sellers, equating to roughly $31k per existing agent*, on top of all the other ways we drive client demand to our agents.

• Flexible Vacation: Redfin agents enjoy flexible vacation that supports the importance of time away from work for rest and relaxation.

*Planned 2025 ad spending divided by lead agents working at Redfin as of January 2025

We're looking for the best agents who put clients first and are driven to win in their career.

• Active and unrestricted real estate license

• Minimum of 1 year residential real estate sales experience, ideally with closed transactions; or related real estate experience including but not limited to prior experience with Redfin in a real estate capacity

• You are a trusted advisor with in-depth experience leading clients through the home buying and selling process

• You have a proven track record of winning web leads and clients over, closing deals and earning referral business

• You have excellent interpersonal communication and customer service skills

• You embrace technology to build your business and collaborate efficiently

This is a commission-based role with unlimited upside. Commissions in this role are expected to range from $30,000-410,000. On average, agents make $160,000, but there is uncapped potential. Commission rates: 25%-40% for Redfin generated sales; 50%-70% for agent generated sales.

We offer a generous benefits package including flexible vacation that supports the importance of time away from work for rest and relaxation, paid parental leave, sick leave (accrued at 1 hour for every 30 hours worked), medical, dental, and vision insurance benefits, flexible spending account, health savings account, life and disability insurance, fertility benefits, Employee Assistance Programs, and 401(k) employer match.

Redfin is an equal opportunity employer committed to hiring a diverse workforce. A diverse, inclusive culture is vital to Redfin's mission of making real estate better for people from all walks of life. We're proud that Redfin is a place where different points of view and backgrounds are encouraged and respected. We constantly strive to build a company that reflects the world around us, based on our conviction that pursuing and developing talent of all types is the right way for a business to thrive over the long haul.

Redfin provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, and any other characteristic protected by applicable federal, state or local law.

Redfin encourages individuals with criminal record histories to apply for employment and considers such individuals for employment consistent with the requirements of any applicable fair chance acts, including but not limited to the California, San Francisco and Los Angeles County Fair Chance Acts.

Redfin accepts applications on an ongoing basis.

JOB DESCRIPTIONPermanent position; Full-timeJoin an Urgent Care facility practicing an extended spectrum of family practice, including acute and chronic carePhysicians have the ability to build their practice in their communities and offer continuity to the families they care for.The recruited physicians will join the group as Associate Medical Director.

We also have Area Medical Director and Regional Medical Director positions in DFW.

The clinics are open 8am-8pm M-F, and 8am-8pm
- Sat, and 8am-5pm
- Sun.

(12 hour shifts Mon-Sat and 9 hr shift on Sunday)The physicians at each clinic will have autonomy to structure their own schedules, as long as a minimum of 163 hours per month are worked per doctor.Each provider will work 21 Weekend Hours (Sat &Sun) each month.

(this is included in the 163 hrs.

per month)Must be willing to work some nights and at least one weekend per month.Must be willing to practice in a procedure oriented urgent care setting.

Some of the more common procedures are lacerations, I&D, x-ray, drug screening, work and sports physicals, Ortho splints and General Family Medicine routine care.

Each clinic has a 2-bed triage, and approximately 7-15 exam rooms, lab, Digital X-ray, EKG.Work with 1 physician, 1 or 2 mid-level practitioners (NP or PA), 2 lab techs, 2+ front-office personnel, and a center manager, who is then managed by an area manager.

See on average of 4 patients/ hour.

No clinic calls on days off, or hospital rounding.Enjoy excellent payer mix in the DFW area.

(no Medicare nor Medicaid)Enjoy a physician driven organization, meaning the employed physicians have a say in how the organization is run, and can assist in on-going protocols.COMPENSATION AND BENEFITSEmployed positionPaid an hourly wage of $115-120/hour (this equals $240-250k for full-time physician working 2080 hours/year)A quarterly bonus of $7,500 per quarter based on quality measures.

(The Bonus would equal $30,000 per year.)Physicians receive full benefits, including mal-practice ($2million), health and dental for the entire family, non-matching 401(K) and 1 week CME($2500 allowance).

Reimbursed for TX License, DEA and DPSVacation- PTO accrues as follows: Years 1-3 = 3 weeks; 4th year = 4 weeks; 5thyear > = 5 weeks.

The benefit package also includes a 250K life insurance policy and an excellent disability policy.Relocation assistanceCOMMUNITY The Dallas Fort Worth With low cost of living affordable housing a temperate climate top companies employment opportunities a renowned restaurant scene and two airports that together offer more than 2,000 flights daily it's easy to see why the Dallas/Fort Worth area is a great place to put down roots.

Both Dallas and Fort Worth offer plenty of recreational opportunities that speak to the area s overall quality of life including more than 200 golf courses hundreds of area parks fun entertainment venues like the Fort Worth Stockyards and Six Flags and renowned cultural amenities like the Morton Meyerson Symphony Center the Kimbell Art Museum the Dallas Museum of Art the Fort Worth Museum of Science and History and much more.

The Metroplex is home to five professional sports teams including the Dallas Cowboys (NFL); Dallas Stars (NHL); Dallas Mavericks (NBA); FC Dallas (MLS) and the Texas Rangers (MLB) plus NASCAR and Indy racing giving residents many occasions to cheer their favorite teams and enjoy the excitement of live sports.

REQUIREMENTSBoard Certified or Board Eligible (in process of getting certified) in Family Practice Also open to Emergency Med or Internal Medicine/PediatricsActive TX medical license or ability to obtain

Autonomous CRNA Practice in Denver, Colorado! Join a renowned academic medical center in Denver, CO.

Our team in an autonomous, CRNA-led practice model providing anesthesia care across a range of procedures including bronchoscopy, interventional pulmonology, and gastrointestinal (GI) cases.

This role involves working closely with anesthesiologists, gastroenterologists, pulmonologists, and other healthcare professionals to deliver exceptional patient care.

Opportunity Highlights: Autonomous Practice Model: CRNA-led with collaborative support from attending anesthesiologists.

Diverse Caseload: Includes GI procedures, bronchoscopy, interventional pulmonology, thoracentesis, and more.

High-Acuity Environment: Primarily outpatient with complex cases; most patients are ASA III.

Flexible Work Schedule: Monday-Friday, no weekends, holidays, or call; choice of four 10-hour shifts or five 8-hour shifts.

Competitive Compensation: $192,635
- $267,786 annually, plus a $10,000 sign-on bonus Comprehensive Benefits: Health, dental, vision insurance, retirement plans with matching, generous PTO, CME allowances, and more.

Denver, Colorado Vibrant Cultural Scene: Rich arts and culture with museums, theaters, and music venues like the Denver Art Museum and Red Rocks Amphitheatre.

Outdoor Recreation: Gateway to the Rocky Mountains, offering hiking, skiing, biking, and extensive park systems.

Professional Sports: NFL, NBA, MLB, NHL, MLS, MLL Thriving Food and Beverage Scene: Diverse culinary landscape with award-winning restaurants, craft breweries, and food festivals.

Dynamic Economy and Job Market: Strong economy with key industries in technology, healthcare, energy, and aerospace.

Quality of L

Job Description

At Boeing, we innovate and collaborate to make the world a better place. We're committed to fostering an environment for every teammate that's welcoming, respectful and inclusive, with great opportunity for professional growth. Find your future with us.

The Boeing Company is looking for a Senior Digital Engineer – Full Stack & Systems Architecture to join our team in Charleston, SC; El Segundo, CA; Huntsville, AL; Mesa, AZ; Oklahoma City, OK, Philadelphia, PA; or Berkeley, MO.

Boeing Test & Evaluation (BT&E) generates enormous volumes of data, but data alone does not create insight. We are building a Digital Engineering capability focused on transforming test intent into reusable knowledge through intuitive applications, scalable systems, and thoughtful architecture.

As a Digital Engineer – Full Stack & Systems Architecture, you will sit at the intersection of engineering workflows, software systems, and cloud platforms. Your mission is to empower BT&E engineers to work differently by designing and delivering digital products that shorten feedback loops, reduce friction, and accelerate learning from every test event.

This is not a traditional backend or data‐engineering role. You will design end‐to‐end solutions, working from initial understanding of engineer needs, to shaping application architecture, to implementing full‐stack solutions that integrate data, automation, and cloud services. You will partner closely with BT&E, BCA, BDS, and Wisk/Autonomy engineers to modernize how test data is accessed, explored, and operationalized across Boeing.

If you enjoy systems thinking, building products engineers actually want to use, and architecting platforms that scale across programs and clouds, this role is for you.

Position Responsibilities:

Digital Product & Application Development

• Design and develop full stack applications that improve test and evaluation workflows, decision making, and engineering productivity
• Translate ambiguous engineering problems into clear digital solutions, balancing usability, performance, and scalability
• Develop front end and backend services using modern frameworks (e.g., React, Node.js, Python, .NET)
• Design and implement APIs and service interfaces that enable integration across test systems, analytics platforms, and enterprise tools

Systems Architecture & Cloud Engineering

• Architect end to end systems spanning applications, data services, and cloud infrastructure
• Evaluate and select cloud services across AWS and Azure based on cost, usability, scalability, and long term maintainability
• Implement infrastructure as code using Terraform, CloudFormation, ARM, or Bicep to support repeatable, secure deployments
• Design solutions that support multi cloud and hybrid environments as required by program needs

Data Enabled Engineering (as a Platform Capability)

• Design data models and storage solutions that support both transactional systems and analytical workloads
• Build and integrate data services that allow engineers to discover, explore, and reuse test data efficiently
• Collaborate with data scientists and analysts to enable analytics, visualization, and ML workflows without burdening users with infrastructure complexity

DevOps, Reliability & Security

• Build CI/CD pipelines to support rapid iteration, testing, and safe deployment of applications
• Apply SRE principles to ensure reliability, observability, and operational excellence
• Build and maintain observability capabilities—including logs, metrics, and traces—to enable rapid diagnosis, performance optimization, and reliable operation of digital engineering systems
• Partner with security and compliance teams to ensure solutions meet Boeing security, data governance, and regulatory requirements
• Contribute to operational documentation, runbooks, and continuous improvement efforts

Collaboration & Technical Leadership

• Work closely with engineers, product owners, and stakeholders to shape digital roadmaps and technical direction
• Influence architecture and design decisions across programs through systems thinking and engineering judgment
• Collaborate with peers and contribute to a growing Digital Engineering community within BT&E

Basic Qualifications (Required Skills/Experience):

• Bachelor of Science degree in Engineering, Engineering Technology (including Manufacturing Technology), Computer Science, Data Science, Mathematics, Physics, Chemistry or non-US equivalent qualifications directly related to the work statement
• 5+ years of experience developing full stack applications with modern frameworks
• Strong systems thinking skills with experience designing end to end software solutions
• Proficiency in one or more programming languages (JavaScript/TypeScript, Python, C#, or Go)
• Experience deploying and operating applications in cloud environments (Azure and/or AWS)
• Hands on experience with infrastructure as code (Terraform, CloudFormation, ARM/Bicep)
• Working knowledge of CI/CD pipelines, Git, Docker, and Linux
• Experience designing and working with relational databases (e.g., PostgreSQL), including schema design and performance considerations
• Familiarity with security best practices (IAM, secrets management, network controls)

Preferred Qualifications (Desired Skills/Experience):

• Experience designing developer platforms or internal engineering tools
• Background in Digital Engineering, Model Based Systems Engineering (MBSE), or engineering workflow automation
• Cloud certifications (AWS and/or Azure)
• Experience with Kubernetes, serverless architectures, or event driven systems
• Exposure to data pipelines, analytics platforms, or data enabled applications
• Experience working in regulated or safety critical environments
• Understanding of aerospace, test & evaluation, or large scale engineering programs
• Familiarity with ITAR, EAR, DFARS, or similar compliance frameworks

Drug Free Workplace:

Boeing is a Drug Free Workplace where post offer applicants and employees are subject to testing for marijuana, cocaine, opioids, amphetamines, PCP, and alcohol when criteria is met as outlined in our policies.

Conflict of Interest:

Successful candidates for this job must satisfy the Company's Conflict of Interest (COI) assessment process.

Pay & Benefits:

At Boeing, we strive to deliver a Total Rewards package that will attract, engage and retain the top talent. Elements of the Total Rewards package include competitive base pay and variable compensation opportunities.

The Boeing Company also provides eligible employees with an opportunity to enroll in a variety of benefit programs, generally including health insurance, flexible spending accounts, health savings accounts, retirement savings plans, life and disability insurance programs, and a number of programs that provide for both paid and unpaid time away from work.

The specific programs and options available to any given employee may vary depending on eligibility factors such as geographic location, date of hire, and the applicability of collective bargaining agreements.

Pay is based upon candidate experience and qualifications, as well as market and business considerations.

Summary Pay Range: $127,500 – $197,800

Applications for this position will be accepted until Mar. 21, 2026

Export Control Requirements:

This position must meet U.S. export control compliance requirements. To meet U.S. export control compliance requirements, a "U.S. Person" as defined by 22 C.F.R. §120.62 is required. "U.S. Person" includes U.S. Citizen, U.S. National, lawful permanent resident, refugee, or asylee.

Export Control Details:

US based job, US Person required

Education

Bachelor's Degree or Equivalent Required

Relocation

Relocation assistance is not a negotiable benefit for this position.

Visa Sponsorship

Employer will not sponsor applicants for employment visa status.

Shift

This position is for 1st shift

Equal Opportunity Employer:

Boeing is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, physical or mental disability, genetic factors, military/veteran status or other characteristics protected by law.

Role Summary

BrickRed Systems is seeking an experienced QA Engineer specializing in testing LLM agents and AI-driven workflows. This role focuses on evaluating agentic behavior, safety, reliability, grounding, automation quality, and deterministic vs. non-deterministic outcomes across advanced AI pipelines. You will collaborate closely with engineering, product, and AI research.

Key Responsibilities

• Design and execute comprehensive test strategies for LLM agents, agentic workflows, multi-step planners, and tool-using AI systems
• Implement Eval-Loops for continuous, automated evaluation of model performance, drift, consistency, and safety
• Build and maintain Golden Datasets to benchmark model accuracy, grounding, and regression behavior
• Use hill‐climbing evaluation techniques to iteratively improve prompts, policies, and model outputs
• Evaluate and test safety shield models (e.g., ShieldGemma) for content filtering, policy enforcement, and guardrail robustness
• Perform adversarial testing against hallucinations, ungrounded responses, safety violations, and reasoning failures
• Develop automation harnesses using Python, REST APIs, LangChain, PromptFlow, and LLM evaluation frameworks
• Assess agent behaviors across variations in prompts, contexts, tools, and reasoning paths
• Analyze responses for factuality, coherence, instruction-following, policy adherence, and chain-of-thought integrity (when applicable)
• Document findings, build structured bug taxonomies, and partner with engineering teams to resolve issues
• Drive improvements in reliability, latency, determinism, and consistent execution of multi-step agent behaviors

Required Technical Skills

• Strong QA experience (manual + automation) with AI/ML, LLMs, or agentic systems
• Hands-on experience with Python, automation frameworks, evaluation scripts, REST/JSON APIs
• Familiarity with LLM platforms (Azure OpenAI, OpenAI, Anthropic, Google Gemini, etc.)
• Experience with evaluation frameworks such as:
• PromptFlow evaluations
• DeepEval / Ragas / Trulens
• LangChain LCEL evaluations
• Custom scoring functions for grounding, correctness, toxicity, etc.
• Experience using or testing safety-shield models (e.g., ShieldGemma or similar)
• Understanding of techniques such as:
• Hill climbing optimization
• Agent loop testing
• Determinism scoring
• Self-reflection / self-correction evaluation
• Guardrail stress testing
• Scenario-based reasoning tests
• Strong analytical and problem‐solving skills for non-deterministic system behavior
• Excellent documentation, communication, and cross-team collaboration skills

About Brickred Systems:

Brickred Systems is a global leader in next-generation technology, consulting, and business process service companies. We enable clients to navigate their digital transformation. Brickred Systems delivers a range of consulting services to our clients across multiple industries around the world. Our practices employ highly skilled and experienced individuals with a client-centric passion for innovation and delivery excellence.

With ISO 27001 and ISO 9001 certification and over a decade of experience in managing the systems and workings of global enterprises, we harness the power of cognitive computing hyper-automation, robotics, cloud, analytics, and emerging technologies to help our clients adapt to the digital world and make them successful. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.