Data Migration Best Practices Jobs in Usa

Job Description Summary

We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this role, you will be instrumental in designing, building, and maintaining robust and scalable data pipelines and solutions within the Microsoft Azure ecosystem. You will be responsible for developing and optimizing ETL/ELT processes, ensuring data quality, and enabling efficient data access for analytics and business intelligence. We are looking for a hands-on engineer who thrives in a fast-paced environment and is passionate about leveraging cutting-edge technologies

Key Responsibilities:

Design, develop, and maintain cloud-based data pipelines and ETL/ELT workflows.

Build and optimize data architectures to support structured and unstructured data processing.

Collaborate with data analysts, data scientists, and business stakeholders to understand data needs.

Implement data quality, security, and governance best practices.

Monitor and troubleshoot data workflows to ensure high availability and performance.

Optimize database and data storage solutions for performance and cost efficiency.

Contribute to cloud adoption, migration, and modernization initiatives.

Mandatory Skills:

Strong expertise with Azure cloud platform.

Strong experience in Databricks

Azure Data Factory proficiency required; building datasets, data flows, and pipelines in ADF (not just maintaining something already built)

Hands-on experience with ETL/ELT tools and frameworks.

Proficiency in SQL, Python, and data modeling.

Knowledge of CI/CD pipelines and infrastructure-as-code tools.

Understanding of data governance, security, and compliance.

Preferred Skills:

Exposure to API integration and microservices architecture.

Strong analytical and problem-solving skills.

Azure cloud certifications and/or past experience

AKS (Azure Kubernetes Service) experience, and ETL related to applications containerized & deployed on AKS (or EKS)

About US Solar

US Solar is a developer, owner, operator, and financier of solar and solar + storage projects, with a focus on emerging state markets, community solar programs, distributed generation and small-scale utility projects nationwide.

US Solar is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We believe diverse teams and diverse perspectives lead to better outcomes and breakthrough thinking, which are differentiators in any business and fundamental to our long-term success.

About Sunscription

is US Solar’s platform for managing community solar subscriptions, billing, and customer operations across multiple markets. The platform supports both residential and commercial subscribers, enabling them to participate in community solar projects and receive savings on their electric bills.

The Subscription Data Operations Lead will join the Sunscription team and play a critical role in supporting contract execution, allocation accuracy, and financial closings by serving as the central owner of subscription data and documentation.

Position Description

The Subscription Data Operations Lead serves as the primary data input and coordination point for community solar subscriptions. This role owns the accuracy and flow of information across allocation spreadsheets, executed contracts, utility documentation, and internal systems.

The position requires strong execution within US Solar’s current Excel based allocation and mail merge workflows, while also supporting improvements to automation, documentation, and reporting processes over time. The successful candidate will be detail oriented, systems minded, and comfortable operating in a fast paced environment where processes continue to evolve.

Responsibilities

• Serve as the primary owner of subscription data across allocation spreadsheets, contracts, utility documentation, and internal platforms.
• Execute and maintain Excel based allocation models and mail merge workflows used to generate contracts and supporting documentation.
• Ensure consistency and accuracy between modeled allocations, executed agreements, and utility records through regular validation and reconciliation.
• Administer the execution and recording of commercial subscription agreements and associated costs to support long term contract management, cost, and revenue tracking.
• Track and analyze residential subscriber acquisition activity to monitor program progress, validate enrollment data, and support allocation planning
• Organize and maintain allocation lists, contracts, utility bills, and utility documentation required for enrollment, billing, and ongoing management.
• Create and maintain subscription summaries and documentation required for program and project financial closings.
• Track additional documentation requirements as projects move toward COD and financial close.
• Migrate deal information and documentation accurately and completely into internal subscriber billing and management platform
• Standardize documentation and reporting formats to improve consistency and accessibility for internal stakeholders.
• Identify opportunities to streamline manual processes and improve efficiency within existing Excel and document generation workflows.
• Collaborate with accounting, finance, asset management, and the Sunscription team to support data needs across the customer lifecycle.
• Create and deliver customer onboarding communication to support billing setup and closing requirements.
• Perform process improvement and administrative tasks to support the overall success of community solar subscriptions.

Requirements

• Bachelor’s degree and five or more years of professional experience in operations, data management, finance, or a related field.
• Exceptional attention to detail with strong organizational skills.
• Advanced proficiency in Microsoft Excel and experience managing complex spreadsheets.
• Experience executing document generation or mail merge workflows tied to structured data.
• Comfort working with contracts, utility documentation, and operational data.
• Ability to learn new tools and contribute to the gradual improvement of existing systems and processes.
• Strong communication skills and ability to collaborate across teams.
• Self directed and comfortable working independently in a fast paced environment.
• Interest in renewable energy and community solar programs.
• US Solar seeks individuals who are flexible, motivated, responsible, and eager to contribute to a collaborative team environment.

Open date: March 4, 2026

Next review date: Thursday, Mar 19, 2026 at 11:59pm (Pacific Time)

Apply by this date to ensure full consideration by the committee.

Final date: Thursday, Mar 4, 2027 at 11:59pm (Pacific Time)

Applications will continue to be accepted until this date, but those received after the review date will only be considered if the position has not yet been filled.

The School of Information at the University of California, Berkeley, invites applications for a pool of part-time, non-tenure track lecturers to teach online courses in the Master of Information and Data Science (MIDS) program. We seek exceptional instructors with professional and/or academic expertise who can lead small, highly interactive sections of around 17 graduate students in this innovative, online program.

Courses in the MIDS program are pre-designed and structured, allowing instructors to focus on delivering dynamic and engaging learning experiences while providing valuable expertise to enhance student outcomes. Screening of applicants is ongoing and will continue as the program's needs evolve. The number of available positions may vary by semester based on the School's requirements.

Please Note:

Applicants must be authorized to work in the United States at the time of hire. Visa sponsorship is not available for this position.

The Berkeley School of Information (I School) is a global bellwether in a world awash in information and data, boldly leading the way with education and fundamental research that translates into new knowledge, practices, policies, and solutions. I School scholars and practitioners thrive in the intersections where people, organizations, and societies interact with information, technology, and data. The faculty comprises a mix of disciplines, including information, computer science, economics, political science, law, sociology, design, media studies, and more.

The I School offers three professional master's degrees and an academic doctoral degree. The MIMS program trains students for careers as information professionals and emphasizes small classes and project-based learning. The online MIDS program trains data scientists to manage and analyze the coming onslaught of big data in a unique high-touch online degree. The online MICS program prepares cybersecurity leaders with the technical skills and contextual knowledge necessary to develop solutions for complex cybersecurity challenges. The Ph.D. program equips scholars to develop solutions and shape policies that influence how people seek, use, and share information. Our cohorts and classes are small enough to support intense student engagement, and we encourage collaboration among the students, faculty, and staff in the I School community. Our alumni have careers in diverse fields, such as data science, user experience design and research, product management, engineering, information policy, cybersecurity, and more.

We are committed to attracting outstanding instructors from academia and industry who bring diverse perspectives and experiences to the virtual classroom. Whether your expertise lies in groundbreaking research, innovative industry applications, or both, we value professionals who can bridge theory and practice. Successful lecturers inspire graduate students by integrating real-world applications with deeper theoretical exploration, fostering critical discussions of historical and emerging trends, and preparing students to make an impact in the rapidly evolving field of data science.

If you are an enthusiastic educator or practitioner passionate about shaping the next generation of data science leaders, we encourage you to join our exceptional instructional team.

The instructor role is an exciting opportunity to contribute to the success of graduate students in cutting-edge online MIDS master's programs at UC Berkeley's School of Information.

Delivering Engaging Online Classes: Plan and lead synchronous sessions that emphasize active learning. Facilitate meaningful discussions, collaborative group activities, and practical exercises that enhance students' understanding and application of core concepts.

Facilitating Student-Centered Learning: Provide personalized support to students by holding virtual office hours, moderating online discussions, and leveraging student analytics to identify and support individual learning needs.

Designing and Refining Course Materials: Develop and update instructional materials, assignments, and assessments. Ensure all content aligns with program objectives, maintains academic rigor, and incorporates an inclusive and equitable learning environment.

Providing Constructive Feedback: Deliver timely, actionable feedback on student assignments and projects to promote growth and mastery of key competencies.

Maintaining Course Operations: Use the learning management system (LMS) and other educational technology tools to manage course websites, post assignments, and communicate with students effectively.

Collaborating with Faculty Teams: Actively participate in course meetings to align instructional practices, address challenges, and share innovative teaching strategies. Attend monthly or bi-monthly faculty meetings to stay connected with program goals, initiatives, and effective online teaching pedagogy.

Advancing Online Pedagogy: Engage in faculty development programs to stay current on the latest research, tools, and practices for effective online teaching. Share insights to enhance the overall learning experience.

Promoting Inclusion: Foster an inclusive, equitable learning environment that respects diverse perspectives and supports all students in achieving their academic and professional goals.

Please note:

The use of a lecturer pool does not guarantee that an open position exists. See the review date in AP Recruit to learn whether the school is reviewing applications for a specific position. If no future review date is specified, your application may not be considered at this time.

UC Berkeley has several policies and programs to support all employees as they balance work and family.

Program:

Policies and Programs to Support All Employees: support-faculty/family-responsive-policies-benefits-programs-and-resources

Course Descriptions: courses/datasci

A bachelor's degree (or equivalent international degree).

Minimum 4 years of professional experience in the relevant field.

Minimum 2 years of experience in teaching in higher education or professional development in relevant fields. Professional development instructional activities would include leading workshops, delivering executive education, providing corporate training, or offering industry-recognized certification programs.

An advanced degree in Data Science, Information, Information Science, Statistics, Computer Science, Engineering, Political Science, Sociology, Law, Economics, or related field.

10 + years of professional experience in fields such as Data Science, Information, Information Science, Statistics, Computer Science, Engineering, Political Science, Sociology, Law, Economics, or related fields.

Multiple years of demonstrated excellence in teaching college-level courses, including experience with online instruction.

Familiarity with and use of collaborative learning techniques and student-centered methods of instruction.

Proven organizational skills and ability to complete assignments timely and accurately with minimal supervision.

Possess excellent communication skills, both oral and written, and the ability to communicate effectively with students with a wide range of skills.

Possess excellent interpersonal, customer service, and problem-solving skills. Ability to work well with students, faculty, and staff. Demonstrated strength or potential in teaching at the college level.

Demonstrated ability to support the academic, professional, and personal development of a diverse community through inclusive curriculum, classroom environment, and pedagogy in a multidisciplinary environment.

Teaching or in-depth knowledge and experience in at least one of the following core areas (please see course descriptions):

• 
  
• Applied Cloud Computing for Data Science
  
• Applied Machine Learning
  
• Applied Statistics(R)
  
• Capstone Projects - real-world projects and industry collaboration
  
• Computer Vision
  
• Data Visualization and Communication
  
• Deep Learning and Neural Networks
  
• Edge and IoT Data Science
  
• Experiments and Causal Inference
  
• Fundamentals of Data Engineering
  
• Generative AI
  
• Introduction to Data Science Programming (Python)
  
• Leadership in Data-Driven Transformation
  
• Machine Learning at Scale
  
• Machine Learning Systems Engineering
  
• Natural Language Processing with Deep Learning
  
• Privacy, Security, and Ethics in Data Science
  
• Regression and Time Series Analysis
  
• Research Design and Data Analysis
  
• Scalable Data Mining and Analysis
  
• Statistical Methods for Discrete Response, Time Series, & Panel Data
  
• Special Topics such as: AI for Sustainability, Autonomous Systems and Robotics, Data, Human-Centered Data Science, Spatial Data Science, Time-Series Analysis and Forecasting
  

• Curriculum Vitae - Your most recently updated C.V.

  
  

• Cover Letter

  
  

• Statement of Teaching Interests/Experience/Approach - Applicants must submit a brief statement outlining their teaching philosophy, experience, and methods. This can include, for example, fostering student success, connecting theory to practice, advancing an inclusive learning environment for all students, facilitating student-centered learning, or providing practical exercises that enhance students' understanding and application of core concepts. The statement should clearly describe the format, audience, and scope of teaching or professional development experience.

  
  
  

  The statement should highlight areas of expertise and any experience with online or technology-enhanced teaching.

  
  
  

  Please indicate which class(es) you believe you are qualified to teach.

  
  

• Teaching Evaluations, if available (Optional)

  
  

• 3 required (contact information only)

Help contact:

UC Berkeley is committed to diversity, equity, inclusion, and belonging in our public mission of research, teaching, and service, consistent with UC Regents Policy 4400 and University of California Academic Personnel policy (APM 210 1-d). These values are embedded in our Principles of Community, which reflect our passion for critical inquiry, debate, discovery and innovation, and our deep commitment to contributing to a better world. Every member of the UC Berkeley community has a role in sustaining a safe, caring and humane environment in which these values can thrive.

The University of California, Berkeley is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or protected veteran status.

For more information, please refer to the University of California's Affirmative Action and Nondiscrimination in Employment Policy and the University of California's Anti-Discrimination Policy.

In searches when letters of reference are required all letters will be treated as confidential per University of California policy and California state law. Please refer potential referees, including when letters are provided via a third party (i.e., dossier service or career center), to the UC Berkeley statement of confidentiality prior to submitting their letter.

As a University employee, you will be required to comply with all applicable University policies and/or collective bargaining agreements, as may be amended from time to time. Federal, state, or local government directives may impose additional requirements.

Unless stated otherwise, unambiguously, in the position description, this position does not include sponsorship of a new consular H-1B visa petition that would require payment of the $100,000 supplemental fee.

As a condition of employment, the finalist will be required to disclose if they are subject to any final administrative or judicial decisions within the last seven years determining that they committed any misconduct.

• 
  
• "Misconduct" means any violation of the policies or laws governing conduct at the applicant's previous place of employment, including, but not limited to, violations of policies or laws prohibiting sexual harassment, sexual assault, or other forms of harassment or discrimination, as defined by the employer.
  
• UC Sexual Violence and Sexual Harassment Policy
  
• UC Anti-Discrimination Policy
  
• APM - 035: Affirmative Action and Nondiscrimination in Employment
  

Description

The Scientific Computing & Data group at the Icahn School of Medicine at Mount Sinai (ISMMS) accelerates scientific discovery by supporting a high-performance computing and research data ecosystem. This includes a data commons and two clinical research data warehouses: one for ISMMS and one for the Kidney Precision Medicine Project (KPMP), a multi-institutional research consortium ( ) funded by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK). Both warehouses use Microsoft SQL Server and the OMOP Common Data Model.

The Lead Data Warehouse Engineer is a senior technical specialist responsible for leading development, maintenance, and operations of these research data warehouses. The role collaborates with warehouse team members and research stakeholders to expand functionality and integrate new data sources. Data transformations are built in Transact-SQL stored procedures, with SSIS used for orchestration.

Responsibilities

• Design databases and pipelines that balance functionality, performance, cost, and development time; evaluate technical options with the product manager.
• Design, build, test, and maintain ETL/ELT processes using T-SQL stored procedures, SSIS, and SQL Agent; apply metadata-driven design for extensibility.
• Serve as a team leader; contribute to project planning, work breakdown, dependency sequencing, and release management.
• Develop and promote standards, conventions, design patterns, DevOps/SDLC best practices, and operational procedures for pipelines and warehouse maintenance.
• Mentor junior engineers in data warehousing, data engineering skills, and operational support.
• Design, build, and maintain data management processes, including loading flat files (csv, tsv, pipe-delimited, JSON).
• Lead design sessions, code walkthroughs, peer reviews, and produce technical documentation.
• Tune database objects, stored procedures, and pipelines to optimize performance and minimize compute and storage costs.
• Monitor database and pipeline operations; lead troubleshooting and remediation of failures; provide occasional after-hours on-call support.
• Collaborate with DBAs and system administrators on backups, performance tuning, statistics/index maintenance, and patching.
• Provide high-quality customer service to researchers, clinicians, and internal partners; maintain a science‑driven, customer-focused approach.
• Ensure patient privacy and data security in compliance with IRB & cybersecurity policies, HIPAA, 42 CFR Part 2, NYS Article 27-F, and other regulations.
• Stay current with emerging technologies to improve capabilities, efficiency, quality, or cost.
• Identify improvements in procedures, technology, compliance, and data privacy/security.
• Periodically assist DBAs with user provisioning, backups, restorations, capacity planning, and performance monitoring.
• Perform related duties as assigned.

Qualifications

• Bachelor’s degree in a technical field; Master’s preferred.
• 12–15 years of related experience, including 7+ years designing, developing, and maintaining relational databases, data pipelines, and dimensional/OLAP warehouses.

Preferred

• Expert knowledge of data warehousing: 3NF & dimensional modeling (fact table types, SCDs), change data capture, incremental loads, data lineage, source-to-target mappings, pattern-based & parameter-driven development.
• Expert-level experience with Microsoft SQL Server technologies: T-SQL, indexing, stored procedures, UDFs, sequences, dynamic SQL, Linked Servers, SSIS, Visual Studio, SSDT, and SQL Agent.
• Experience with DevOps/SDLC best practices; Agile (Scrum, Kanban) with JIRA and Confluence; version control with git.
• Strong communication and customer service skills for working with researchers, clinicians, administrators, and IT staff.
• Excellent critical thinking, problem-solving, multitasking, and collaboration skills; ability to work independently in a fast-paced environment.
• Preferred experience with healthcare data (EHR, billing/claims, cost accounting), Epic Clarity/Caboodle, data models (OMOP, i2b2, PCORnet).
• Preferred experience with Azure Synapse, Azure Data Factory, Oracle PL/SQL, PostgreSQL PL/pgSQL.
• Experience with SQL Server administration: configuration, performance tuning, partitioning, materialized views, permissions, backups & restorations.
• Preferred experience with scripting in Windows & Linux (PowerShell, Python, or similar); HL7; web services/REST APIs; reporting tools like SSRS, Power BI, Tableau.

Strength through Unity and Inclusion

The Mount Sinai Health System is committed to fostering an environment where everyone can contribute to excellence. We share a common dedication to delivering outstanding patient care. When you join us, you become part of Mount Sinai’s unparalleled legacy of achievement, education, and innovation as we work together to transform healthcare. We encourage all team members to actively participate in creating a culture that ensures fair access to opportunities, promotes inclusive practices, and supports the success of every individual.

At Mount Sinai, our leaders are committed to fostering a workplace where all employees feel valued, respected, and empowered to grow. We strive to create an environment where collaboration, fairness, and continuous learning drive positive change, improving the well-being of our staff, patients, and organization. Our leaders are expected to challenge outdated practices, promote a culture of respect, and work toward meaningful improvements that enhance patient care and workplace experiences. We are dedicated to building a supportive and welcoming environment where everyone has the opportunity to thrive and advance professionally. Explore this opportunity and be part of the next chapter in our history.

About the Mount Sinai Health System:

Mount Sinai Health System is one of the largest academic medical systems in the New York metro area, with more than 48,000 employees working across eight hospitals, more than 400 outpatient practices, more than 300 labs, a school of nursing, and a leading school of medicine and graduate education. Mount Sinai advances health for all people, everywhere, by taking on the most complex health care challenges of our time — discovering and applying new scientific learning and knowledge; developing safer, more effective treatments; educating the next generation of medical leaders and innovators; and supporting local communities by delivering high-quality care to all who need it. Through the integration of its hospitals, labs, and schools, Mount Sinai offers comprehensive health care solutions from birth through geriatrics, leveraging innovative approaches such as artificial intelligence and informatics while keeping patients’ medical and emotional needs at the center of all treatment. The Health System includes more than 9,000 primary and specialty care physicians; 13 joint-venture outpatient surgery centers throughout the five boroughs of New York City, Westchester, Long Island, and Florida; and more than 30 affiliated community health centers. We are consistently ranked by U.S. News & World Report's Best Hospitals, receiving high "Honor Roll" status, and are highly ranked: No. 1 in Geriatrics, top 5 in Cardiology/Heart Surgery, and top 20 in Diabetes/Endocrinology, Gastroenterology/GI Surgery, Neurology/Neurosurgery, Orthopedics, Pulmonology/Lung Surgery, Rehabilitation, and Urology. New York Eye and Ear Infirmary of Mount Sinai is ranked No. 12 in Ophthalmology. U.S. News & World Report’s “Best Children’s Hospitals” ranks Mount Sinai Kravis Children's Hospital among the country’s best in several pediatric specialties. The Icahn School of Medicine at Mount Sinai is ranked No. 11 nationwide in National Institutes of Health funding and in the 99th percentile in research dollars per investigator according to the Association of American Medical Colleges. Newsweek’s “The World’s Best Smart Hospitals” ranks The Mount Sinai Hospital as No. 1 in New York and in the top five globally, and Mount Sinai Morningside in the top 20 globally.

Equal Opportunity Employer

The Mount Sinai Health System is an equal opportunity employer, complying with all applicable federal civil rights laws. We do not discriminate, exclude, or treat individuals differently based on race, color, national origin, age, religion, disability, sex, sexual orientation, gender, veteran status, or any other characteristic protected by law. We are deeply committed to fostering an environment where all faculty, staff, students, trainees, patients, visitors, and the communities we serve feel respected and supported. Our goal is to create a healthcare and learning institution that actively works to remove barriers, address challenges, and promote fairness in all aspects of our organization.

Compensation

The Mount Sinai Health System (MSHS) provides salary ranges that comply with the New York City Law on Salary Transparency in Job Advertisements. The salary range for the role is $145200 - $217875 annually. Actual salaries depend on a variety of factors, including experience, education, and operational need. The salary range or contractual rate listed does not include bonuses/incentive, differential pay or other forms of compensation or benefits.

About Wakefern

Wakefern Food Corp. is the largest retailer-owned cooperative in the United States and supports its co-operative members' retail operations, trading under the ShopRite®, Price Rite®, The Fresh Grocer®, Dearborn Markets®, and Gourmet Garage® banners.

Employing an innovative approach to wholesale business services, Wakefern focuses on helping the independent retailer compete in a big business world. Providing the tools entrepreneurs need to stay a step ahead of the competition, Wakefern’s co-operative members benefit from the company’s extensive portfolio of services, including innovative technology, private label development, and best-in-class procurement practices.

The ideal candidate will have a strong background in designing, developing, and implementing complex projects, with focus on automating data processes and driving efficiency within the organization. This role requires a close collaboration with application developers, data engineers, data analysts, data scientists to ensure seamless data integration and automation across various platforms. The Data Integration & AI Engineer is responsible for identifying opportunities to automate repetitive data processes, reduce manual intervention, and improve overall data accessibility.

Essential Functions

• Participate in the development life cycle (requirements definition, project approval, design, development, and implementation) and maintenance of the systems.
• Implement and enforce data quality and governance standards to ensure the accuracy and consistency.
• Provide input for project plans and timelines to align with business objectives.
• Monitor project progress, identify risks, and implement mitigation strategies.
• Work with cross-functional teams and ensure effective communication and collaboration.
• Provide regular updates to the management team.
• Follow the standards and procedures according to Architecture Review Board best practices, revising standards and procedures as requirements change and technological advancements are incorporated into the >tech_ structure.
• Communicates and promotes the code of ethics and business conduct.
• Ensures completion of required company compliance training programs.
• Is trained – either through formal education or through experience – in software / hardware technologies and development methodologies.
• Stays current through personal development and professional and industry organizations.

Responsibilities

• Design, build, and maintain automated data pipelines and ETL processes to ensure scalability, efficiency, and reliability across data operations.
• Develop and implement robust data integration solutions to streamline data flow between diverse systems and databases.
• Continuously optimize data workflows and automation processes to enhance performance, scalability, and maintainability.
• Design and develop end-to-end data solutions utilizing modern technologies, including scripting languages, databases, APIs, and cloud platforms.
• Ensure data solutions and data sources meet quality, security, and compliance standards.
• Monitor and troubleshoot automation workflows, proactively identifying and resolving issues to minimize downtime.
• Provide technical training, documentation, and ongoing support to end users of data automation systems.
• Prepare and maintain comprehensive technical documentation, including solution designs, specifications, and operational procedures.

Qualifications

• A bachelor's degree or higher in computer science, information systems, or a related field.
• Hands-on experience with cloud data platforms (e.g., GCP, Azure, etc.)
• Strong knowledge and skills in data automation technologies, such as Python, SQL, ETL/ELT tools, Kafka, APIs, cloud data pipelines, etc.
• Experience in GCP BigQuery, Dataflow, Pub/Sub, and Cloud storage.
• Experience with workflow orchestration tools such as Cloud Composer or Airflow
• Proficiency in iPaaS (Integration Platform as a Service) platforms, such as Boomi, SAP BTP, etc.
• Develop and manage data integrations for AI agents, connecting them to internal and external APIs, databases, and knowledge sources to expand their capabilities.
• Build and maintain scalable Retrieval-Augmented Generation (RAG) pipelines, including the curation and indexing of knowledge bases in vector databases (e.g., Pinecone, Vertex AI Vector Search).
• Leverage cloud-based AI/ML platforms (e.g., Vertex AI, Azure ML) to build, train, and deploy machine learning models on a scale.
• Establish and enforce data quality and governance standards for AI/ML datasets, ensuring the accuracy, completeness, and integrity of data used for model training and validation.
• Collaborate closely with data scientists and machine learning engineers to understand data requirements and deliver optimized data solutions that support the entire machine learning lifecycle.
• Hands-on experience with IBM DataStage and Alteryx is a plus.
• Strong understanding of database design principles, including normalization, indexing, partitioning, and query optimization.
• Ability to design and maintain efficient, scalable, and well-structured database schemas to support both analytical and transactional workloads,
• Familiarity with BI visualization tools such as MicroStrategy, Power BI, Looker, or similar.
• Familiarity with data modeling tools.
• Familiarity with DevOps practices for data (CI/CD pipelines)
• Proficiency in project management software (e.g., JIRA, Clarizen, etc.)
• Familiarity with DevOps practices for data (CI/CD pipelines)
• Strong knowledge and skills in data management, data quality, and data governance.
• Strong communication, collaboration, and problem-solving skills.
• Ability to work on multiple projects and prioritize tasks effectively.
• Ability to work independently and in a team environment.
• Ability to learn new technologies and tools quickly.
• The ability to handle stressful situations.
• Highly developed business acuity and acumen.
• Strong critical thinking and decision-making skills.

Working Conditions & Physical Demands

This position requires in-person office presence at least 4x a week.

Compensation and Benefits

The salary range for this position is $75,868 - $150,644. Placement in the range depends on several factors, including experience, skills, education, geography, and budget considerations.

Wakefern is proud to offer a comprehensive benefits package designed to support the health, well-being, and professional development of our Associates. Benefits include medical, dental, and vision coverage, life and disability insurance, a 401(k) retirement plan with company match & annual company contribution, paid time off, holidays, and parental leave.

Associates also enjoy access to wellness and family support programs, fitness reimbursement, educational and training opportunities through our corporate university, and a collaborative, team-oriented work environment. Many of these benefits are fully or partially funded by the company, with some subject to eligibility requirements

Sr. Data Engineer (Hybrid)

Chicago, IL

The American Medical Association (AMA) is the nation's largest professional Association of physicians and a non-profit organization. We are a unifying voice and powerful ally for America's physicians, the patients they care for, and the promise of a healthier nation. To be part of the AMA is to be part of our Mission to promote the art and science of medicine and the betterment of public health.

At AMA, our mission to improve the health of the nation starts with our people. We foster an inclusive, people-first culture where every employee is empowered to perform at their best. Together, we advance meaningful change in health care and the communities we serve.

We encourage and support professional development for our employees, and we are dedicated to social responsibility. We invite you to learn more about us and we look forward to getting to know you.

We have an opportunity at our corporate offices in Chicago for a Sr. Data Engineer (Hybrid) on our Information Technology team. This is a hybrid position reporting into our Chicago, IL office, requiring 3 days a week in the office.

As a Sr. Data Engineer, you will play a key role in implementing
and maintaining AMA's enterprise data platform to support analytics,
interoperability, and responsible AI adoption. This role partners closely with
platform engineering, data governance, data science, IT security, and business
stakeholders to deliver highquality, reliable, and secure data products. This
role contributes to AMA's modern lakehouse architecture, optimizing data
operations, and embedding governance and quality standards into engineering
workflows. This role serves as a
senior technical contributor within the team-providing mentorship to junior
engineers and implementing engineering best practices within the data platform function,
in alignment with architectural direction set by leadership.

RESPONSIBILITIES:

Data Engineering & AI Enablement

• Build and maintain scalable data pipelines and
  ETL/ELT workflows supporting analytics, operational reporting, and AI/ML use
  cases.
• Implement best practice patterns for ingestion,
  transformation, modeling, and orchestration within a modern lakehouse
  environment (e.g., Databricks, Delta Lake, Azure Data Lake).
• Develop highperformance
  data models and curated datasets with strong attention to quality, usability,
  and interoperability; create reusable engineering components and automation.
• Collaborate with the Architecture Team, the Data
  Platform Lead, and federated IT teams to optimize storage, compute, and
  architectural patterns for performance and costefficiency.
• Build model-ready data sets and feature
  pipelines to support AI/ ML use cases; serve as a technical coordination point
  supporting business units' AI-related infrastructure needs.
• Collaborate with data scientists and AI Working
  Group to operationalize models responsibly and maintain ongoing monitoring
  signals.

Governance, Quality & Compliance

• Embed data governance, metadata standards,
  lineage tracking, and quality controls directly into engineering workflows;
  ensure technical implementation and alignment within engineering workflows.
• Work with the Data Governance Lead and business
  stakeholders to operationalize stewardship, classification, validation,
  retention, and access standards.
• Implement privacybydesign and securitybydesign
  principles, ensuring compliance with internal policies and regulatory
  obligations.
• Maintain documentation for pipelines, datasets,
  and transformations to support transparency and audit requirements.

Platform Reliability, Observability & Optimization

• Monitor and troubleshoot pipeline failures,
  performance bottlenecks, data anomalies, and platformlevel issues.
• Implement observability tooling, alerts,
  logging, and dashboards to ensure endtoend reliability.
• Support cost governance by optimizing compute
  resources, refining job schedules, and advising on efficient architecture.
• Collaborate with the Data Platform Lead on
  scaling, configuration management, CI/CD pipelines, and environment management.
• Collaborate with business units to understand
  data needs, translate them into engineering requirements, and deliver
  fit-for-purpose data solutions; share and apply best practices and emerging
  technologies within assigned initiatives.
• Work with IT Security and Legal/ Compliance to
  ensure platform and datasets meet risk and regulatory standards.
  

Staff Management

• Lead, mentor, and provide management oversight
  for staff.
• Responsible for setting objectives, evaluating
  employee performance, and fostering a collaborative team environment.
• Responsible for developing staff knowledge and
  skills to support career development.

May include other responsibilities as assigned

REQUIREMENTS:

1. Bachelor's degree in Computer Science, Engineering, Information Systems, or related field preferred or equivalent work experience and HS diploma/equivalent education required.
2. 5+ years of experience in data engineering within cloud environments
3. Experience in people management preferred.
4. Demonstrated hands-on experience with modern data platforms (Databricks preferred).
5. Proficiency in Python, SQL, and data
   transformation frameworks.
6. Experience designing and operationalizing
   ETL/ELT pipelines, orchestration workflows (Airflow, Databricks Workflows), and
   CI/CD processes.
7. Solid understanding of data modeling,
   structured/unstructured data patterns, and schema design.
8. Experience implementing governance and quality
   controls: metadata, lineage, validation, stewardship workflows.
9. Working knowledge of cloud architecture, IAM,
   networking, and security best practices.
10. Demonstrated ability to collaborate across
    technical and business teams.
11. Exposure to AI/ML engineering concepts, feature
    stores, model monitoring, or MLOps patterns.
12. Experience with infrastructureascode
    (Terraform, CloudFormation) or DevOps tooling.

The American Medical Association is located at 330 N. Wabash Avenue, Chicago, IL 60611 and is convenient to all public transportation in Chicago.

This role is an exempt position, and the salary range for this position is $115,523.42-$150,972.44. This is the lowest to highest salary we believe we would pay for this role at the time of this posting. An employee's pay within the salary range will be determined by a variety of factors including but not limited to business consideration and geographical location, as well as candidate qualifications, such as skills, education, and experience. Employees are also eligible to participate in an incentive plan. To learn more about the American Medical Association's benefits offerings, please click here.

We are an equal opportunity employer, committed to diversity in our workforce. All qualified applicants will receive consideration for employment. As an EOE/AA employer, the American Medical Association will not discriminate in its employment practices due to an applicant's race, color, religion, sex, age, national origin, sexual orientation, gender identity and veteran or disability status.

THE AMA IS COMMITTED TO IMPROVING THE HEALTH OF THE NATION

The Manager of Data is responsible for overseeing the collection, management, and analysis of institutional data to support decision-making and strategic planning. This role involves leading a team of data analysts and ensuring data integrity, security, and compliance with relevant regulations. Additionally, the manager collaborates with various departments to develop data governance policies and implement effective data management practices that enhance the institution's ability to leverage data for improved outcomes.

Job Duty 1 -
Oversee the development and implementation of data management strategies to ensure the accurate collection, storage, and retrieval of institutional data.

Job Duty 9 -
Collaborate with academic and administrative departments to identify data needs and develop solutions that enhance data accessibility and usability.

Job Duty 10 -
Perform other duties as assigned.

Job Duty 2 -
Lead a team of data analysts in conducting data analysis and reporting to support institutional decision-making and strategic initiatives.

Job Duty 3 -
Establish and enforce data governance policies to ensure data quality, integrity, and compliance with relevant regulations and standards.

Job Duty 4 -
Monitor data management systems and tools, ensuring they are maintained, updated, and aligned with best practices in data security and privacy.

Job Duty 5 -
Provide training and support to staff on data management practices, tools, and analytical techniques to foster a data-driven culture within the institution.

Job Duty 6 -
Conduct regular audits of data processes and systems to identify areas for improvement and implement corrective actions as needed.

Job Duty 7 -
Prepare and present comprehensive reports on data trends, analysis findings, and management initiatives to senior leadership and relevant stakeholders.

Job Duty 8 -
Stay informed about emerging data management technologies and methodologies to continually enhance the institution's data management capabilities.

Educational Requirements
Bachelor's degree in related discipline or equivalent, related experience.

Required Experience
5+ years of relevant experience; 3+ years of supervisory knowledge.

Preferred Educational Qualifications
Master's degree in related discipline or equivalent, related experience.

• Master's degree in Computer Science, Information Technology, Information System, Data Science, Business Administration, related discipline or equivalent, related experience.
• Certified Data Management Professional certification.
• Experience designing, implementing and operating Security Information Management solutions such as SIMS or ThreatSwitch.
• Advanced knowledge of SQL, database design and data modeling expertise.
• Experience in managing and securing enterprise security database systems containing sensitive and regulated data.
• Experience in cross-departmental collaboration during security investigations, assessments, and compliance reviews.

The University System of Georgia is comprised of our 25 institutions of higher education and learning as well as the System Office. Our USG Statement of Core Values are Integrity, Excellence, Accountability, and Respect. These values serve as the foundation for all that we do as an organization, and each USG community member is responsible for demonstrating and upholding these standards. More details on the USG Statement of Core Values and Code of Conduct are available in USG Board Policy 8.2.18.1.2 and can be found on-line at policymanual/section8/C224/#p8.2.18_personnel_conduct.

Additionally, USG supports Freedom of Expression as stated in Board Policy 6.5 Freedom of Expression and Academic Freedom found on-line at policymanual/section6/C2653.

The Georgia Institute of Technology (Georgia Tech) is an Equal Employment Opportunity Employer. The Institute is committed to maintaining a fair and respectful environment for all. To that end, and in accordance with federal and state law, Board of Regents policy, and Institute policy, Georgia Tech provides equal opportunity to all faculty, staff, students, and all other members of the Georgia Tech community, including applicants for admission and/or employment, contractors, volunteers, and participants in institutional programs, activities, or services. Georgia Tech complies with all applicable laws and regulations governing equal opportunity in the workplace and in educational activities.

Equal opportunity and decisions based on merit are fundamental values of the University System of Georgia ("USG") and Georgia Tech. Georgia Tech prohibits discrimination, including discriminatory harassment, on the basis of an individual's race, ethnicity, ancestry, color, religion, sex (including pregnancy), national origin, age, disability, genetics, or veteran status in its programs, activities, employment, and admissions. Further, Georgia Tech prohibits citizenship status, immigration status, and national origin discrimination in hiring, firing, and recruitment, except where such restrictions are required in order to comply with law, regulation, executive order, or Attorney General directive, or where they are required by Federal, State, or local government contract.

The Georgia Tech Research Institute (GTRI) is the nonprofit, applied research division of the Georgia Institute of Technology (Georgia Tech). This position is in the Research Security Department (RS) of GTRI.

*At Securian Financial the internal position title is Data Science Sr Con.*

Position Overview

As a Lead Data Scientist at Securian Financial, you are a recognized expert and technical leader within the organization. You will apply deep analytical and machine learning expertise to solve complex enterprise problems while shaping the technical direction of data science and AI initiatives. You seek to understand first, build scalable solutions that drive strategic growth and value, and thrive in a collaborative, teamwork-oriented environment.

You will play a key role in advancing our enterprise AI and advanced analytics capabilities, influencing tooling standards, MLOps practices, and responsible AI adoption across the organization. Our company values innovation, collaboration, and excellence, and we offer a supportive and inclusive environment where diverse perspectives are encouraged and professional growth is prioritized.

Key Responsibilities

• Design, develop, and productionize advanced machine learning and AI models in partnership with data engineering and software engineering teams.

• Establish and promote MLOps best practices, including experiment tracking, model versioning, reproducibility, CI/CD, and model monitoring using tools such as MLflow and DSpy.

• Lead the design and evaluation of AI and generative AI solutions, including LLM-based systems, and agent-based workflows.

• Collaborate with cross-functional team to identify, prioritize, and deliver high-impact, data-driven solutions.

• Communicate complex analytical and model-driven insights to technical and non-technical audiences through clear narratives, reports, and presentations.

• Ensure model quality, robustness, and regulatory alignment through rigorous testing, validation, and explainability techniques.

• Drive adoption of enterprise standards for data science, machine learning, and responsible AI.

• Identify opportunities for process improvements and automation using advanced analytics and AI techniques.

• Lead and mentor more junior data scientists, providing guidance and support in their professional development while working on projects.

Preferred Qualifications

• A Master's or PhD degree in Data Science, Computer Science, Statistics, Mathematics, or a related field.

• At least 5 years of experience in data science or a related field, with a minimum of 2 years in a project leadership role.

• Experience building and deploying production solutions

• Experience with MLOps tools and practices, including MLflow (or similar) for experiment tracking and model management.

• 2+ years of experience in Insurance, actuarial, or a related field

• Proficiency in programming languages such as Python

• Strong expertise in machine learning frameworks and libraries (e.g., TensorFlow, PyTorch, Scikit-learn).

• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud).

• Solid understanding of statistical analysis, data visualization, data wrangling techniques, NLP approaches, ML model selection.

• Solid understanding of model approaches to satisfy regulatory requirements regarding explainability/interpretability of advanced AI/ML models

• Excellent problem-solving skills and the ability to think critically and analytically.

• Strong communication and presentation skills, with the ability to convey complex concepts to non-technical audiences.

• Demonstrated ability to manage multiple projects and prioritize tasks effectively.

• A passion for continuous learning and staying current with industry trends and developments.

Preferred Skills

• Experience with natural language processing (NLP), LLMs, prompt engineering, and advanced ML models.

• Familiarity with modern ML debugging, evaluation, and optimization tools such as DSpy or equivalent.

• Knowledge of responsible AI practices, including bias detection, fairness assessment, and model risk management.

• Knowledge of data governance and data privacy regulations.

• Background in finance, healthcare, or other specialized industries.

#LI-hybrid **This position will be in a hybrid working arrangement.**

Securian Financial believes in hybrid work as an integral part of our culture. Associates get the benefit of working both virtually and in our offices. If you're in a commutable distance (90 minutes), you'll join us 3 days each week in our offices to collaborate and build relationships. Our policy allows flexibility for the reality of business and personal schedules.

The estimated base pay range for this job is:

Pay may vary depending on job-related factors and individual experience, skills, knowledge, etc. More information on base pay and incentive pay (if applicable) can be discussed with a member of the Securian Financial Talent Acquisition team.

Be you. With us. At Securian Financial, we understand that attracting top talent means offering more than just a job - it means providing a rewarding and fulfilling career. As a valued member of our high-performing team, we want you to connect with your work, your relationships and your community. Enjoy our comprehensive range of benefits designed to enhance your professional growth, well-being and work-life balance, including the advantages listed here:

Paid time off:

• We want you to take time off for what matters most to you. Our PTO program provides flexibility for associates to take meaningful time away from work to relax, recharge and spend time doing what's important to them. And Securian Financial rewards associates for their service by providing additional PTO the longer you stay at Securian.

• Leave programs: Securian's flexible leave programs allow time off from work for parental leave, caregiver leave for family members, bereavement and military leave.

• Holidays: Securian provides nine company paid holidays.

Company-funded pension plan and a 401(k) retirement plan: Share in the success of our company. Securian's 401(k) company contribution is tied to our performance up to 10 percent of eligible earnings, with a target of 5 percent. The amount is based on company results compared to goals related to earnings, sales and service.

Health insurance: From the first day of employment, associates and their eligible family members - including spouses, domestic partners and children - are eligible for medical, dental and vision coverage.

Volunteer time: We know the importance of community. Through company-sponsored events, volunteer paid time off, a dollar-for-dollar matching gift program and more, we encourage you to support organizations important to you.

Associate Resource Groups: Build connections, be yourself and develop meaningful relationships at work through associate-led ARGs. Dedicated groups focus on a variety of interests and affinities, including:

• Mental Wellness and Disability

• Pride at Securian Financial

• Securian Young Professionals Network

• Securian Multicultural Network

• Securian Women and Allies Network

• Servicemember Associate Resource Group

For more information regarding Securian's benefits, please review our Benefits page.

This information is not intended to explain all the provisions of coverage available under these plans. In all cases, the plan document dictates coverage and provisions.

Securian Financial Group, Inc. does not discriminate based on race, color, religion, national origin, sex, gender, gender identity, sexual orientation, age, marital or familial status, pregnancy, disability, genetic information, political affiliation, veteran status, status in regard to public assistance or any other protected status. If you are a job seeker with a disability and require an accommodation to apply for one of our jobs, please contact us by email at , by telephone (voice), or 711 (Relay/TTY).

To view our privacy statement click here

To view our legal statement click here