Cloudera Data Platform Tutorial Jobs in Usa

OZ – Databricks Architect/ Senior Data Engineer

Note: Only applications from U.S. citizens or lawful permanent residents (Green Card Holders) will be considered.

We believe work should be innately rewarding and a team-building venture. Working with our teammates and clients should be an enjoyable journey where we can learn, grow as professionals, and achieve amazing results. Our core values revolve around this philosophy. We are relentlessly committed to helping our clients achieve their business goals, leapfrog the competition, and become leaders in their industry. What drives us forward is the culture of creativity combined with a disciplined approach, passion for learning & innovation, and a ‘can-do’ attitude!

What We're Looking For:

We are seeking a highly experienced Databricks professional with deep expertise in data engineering, distributed computing, and cloud-based data platforms. The ideal candidate is both an architect and a hands-on engineer who can design scalable data solutions while actively contributing to development, optimization, and deployment.

This role requires strong technical leadership, a deep understanding of modern data architectures, and the ability to implement best practices in DataOps, performance optimization, and data governance.

Experience with modern AI/GenAI-enabled data platforms and real-time data processing environments is highly desirable.

Position Overview:

The Databricks Senior Data Engineer will play a critical role in designing, implementing, and optimizing enterprise-scale data platforms using the Databricks Lakehouse architecture. This role combines architecture leadership with hands-on engineering, focusing on building scalable, secure, and high-performance data pipelines and platforms. The ideal candidate will establish coding standards, define data architecture frameworks such as the Medallion Architecture, and guide the end-to-end development lifecycle of modern data solutions.

This individual will collaborate with cross-functional stakeholders, including data engineers, BI developers, analysts, and business leaders, to deliver robust data platforms that enable advanced analytics, reporting, and AI-driven decision-making.

Key Responsibilities:

• Architecture & Design: Architect and design scalable, reliable data platforms and complex ETL/ELT and streaming workflows for the Databricks Lakehouse Platform (Delta Lake, Spark).
• Hands-On Development: Write, test, and optimize code in Python, PySpark, and SQL for data ingestion, transformation, and processing.
• DataOps & Automation: Implement CI/CD, monitoring, and automation (e.g., with Azure DevOps, DBX) for data pipelines.
• Stakeholder Collaboration: Work with BI developers, analysts, and business users to define requirements and deliver data-driven solutions.
• Performance Optimization: Tune delta tables, Spark jobs, and SQL queries for maximum efficiency and scalability.
• GenAI Applications Development: It is a big plus to have experience in GenAI application development

Requirements:

• 8+ years of experience in data engineering, with strong hands-on expertise in Databricks and Apache Spark.
• Proven experience designing and implementing scalable ETL/ELT pipelines in cloud environments.
• Strong programming skills in Python and SQL; experience with PySpark required.
• Hands-on experience with Databricks Lakehouse, Delta Lake, and distributed data processing.
• Experience working with cloud platforms such as Microsoft Azure, AWS, or GCP (Azure preferred).
• Experience with CI/CD pipelines, Git, and DevOps practices for data engineering.
• Strong understanding of data architecture, data modeling, and performance optimization.
• Experience working with cross-functional teams to deliver enterprise data solutions.
• Tackles complex data challenges, ensuring data quality and reliable delivery.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• Experience designing enterprise-scale data platforms and modern data architectures.
• Experience with data integration tools such as Azure Data Factory or similar platforms.
• Familiarity with cloud data warehouses such as Databricks, Snowflake, or Azure Fabric.
• Experience supporting analytics, reporting, or AI/ML workloads is highly desirable.
• Databricks, Azure, or cloud certifications are preferred.
• Strong problem-solving, communication, and technical leadership skills.

Technical Proficiency in:

• Databricks, Apache Spark, PySpark, Delta Lake
• Python, SQL, Scala (preferred)
• Cloud platforms: Azure (preferred), AWS, or GCP
• Azure Data Factory, Kafka, and modern data integration tools
• Data warehousing: Databricks, Snowflake, or Azure Fabric
• DevOps tools: Git, Azure DevOps, CI/CD pipelines
• Data architecture, ETL/ELT design, and performance optimization

What You’re Looking For:

Join a fast-growing organization that thrives on innovation and collaboration. You’ll work alongside talented, motivated colleagues in a global environment, helping clients solve their most critical business challenges. At OZ, your contributions matter – you’ll have the chance to be a key player in our growth and success. If you’re driven, bold, and eager to push boundaries, we invite you to join a company where you can truly make a difference.

About Us:

OZ is a 28-year-old global technology consulting, services, and solutions leader specializing in creating business-focused solutions for our clients by leveraging disruptive digital technologies and innovation.

OZ is committed to creating a continuum between work and life by allowing people to work remotely. We offer competitive compensation and a comprehensive benefits package. You’ll enjoy our work style within an incredible culture. We’ll give you the tools you need to succeed so you can grow and develop with us and become part of a team that lives by its core values.

Location: Anywhere in Country

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

EY is seeking a motivated professional with solid experience in the utilities sector to serve as a Senior Manager who possesses a robust background in Data Architecture, Data Modernization, End to end Data capabilities, AI, Gen AI, Agentic AI, preferably with a power systems / electrical engineering background and having delivered business use cases in Transmission / Distribution / Generation / Customer. The ideal candidate will have a history of working for consulting companies and be well-versed in the fast-paced culture of consulting work. This role is dedicated to the utilities sector, where the successful candidate will craft, deploy, and maintain large-scale AI data ready architectures.

You will help our clients enable better business outcomes while working in the rapidly growing Power & Utilities sector. You will have the opportunity to lead and develop your skill set to keep up with the ever-growing demands of the modern data platform. During implementation you will solve complex analytical problems to bring data to insights and enable the use of ML and AI at scale for your clients. This is a high growth area and a high visibility role with plenty of opportunities to enhance your skillset and build your career.

As a Senior Manager in Data Architecture, you will have the opportunity to lead transformative technology projects and programs that align with our organizational strategy to achieve impactful outcomes. You will provide assurance to leadership by managing timelines, costs, and quality, and lead both technical and non-technical project teams in the development and implementation of cutting-edge technology solutions and infrastructure. You will have the opportunity to be face to face with external clients and build new and existing relationships in the sector. Your specialized knowledge in project and program delivery methods, including Agile and Waterfall, will be instrumental in coaching others and proposing solutions to technical constraints.

In this pivotal role, you will be responsible for the effective management and delivery of one or more processes, solutions, and projects, with a focus on quality and effective risk management. You will drive continuous process improvement and identify innovative solutions through research, analysis, and best practices. Managing professional employees or supervising team members to deliver complex technical initiatives, you will apply your depth of expertise to guide others and interpret internal/external issues to recommend quality solutions. Your responsibilities will include:

As Data Architect – Senior Manager, you will have an expert understanding of data architecture and data engineering and will be focused on problem-solving to design, architect, and present findings and solutions, leading more junior team members, and working with a wide variety of clients to sell and lead delivery of technology consulting services. You will be the go-to resource for understanding our clients’ problems and responding with appropriate methodologies and solutions anchored around data architectures, platforms, and technologies. You are responsible for helping to win new business for EY. You are a trusted advisor with a broad understanding of digital transformation initiatives, the analytic technology landscape, industry trends and client motivations. You are also a charismatic communicator and thought leader, capable of going toe-to-toe with the C-level in our clients and prospects and willing and able to constructively challenge them.

To thrive in this role, you will need a combination of technical and business skills that will make a significant impact. Your skills will include:

• 
  
• Technical Skills Applications Integration
  
• Cloud Computing and Cloud Computing Architecture
  
• Data Architecture Design and Modelling
  
• Data Integration and Data Quality
  
• AI/Agentic AI driven data operations
  
• Experience delivering business use cases in Transmission / Distribution / Generation / Customer.
  
• Strong relationship management and business development skills.
  
• Become a trusted advisor to your clients’ senior decision makers and internal EY teams by establishing credibility and expertise in both data strategy in general and in the use of analytic technology solutions to solve business problems.
  
• Engage with senior business leaders to understand and shape their goals and objectives and their corresponding information needs and analytic requirements.
  
• Collaborate with cross-functional teams (Data Scientists, Business Analysts, and IT teams) to define data requirements, design solutions, and implement data strategies that align with our clients’ objectives.
  
• Organize and lead workshops and design sessions with stakeholders, including clients, team members, and cross-functional partners, to capture requirements, understand use cases, personas, key business processes, brainstorm solutions, and align on data architecture strategies and projects.
  
• Lead the design and implementation of modern data architectures, supporting transactional, operational, analytical, and AI solutions.
  
• Direct and mentor global data architecture and engineering teams, fostering a culture of innovation, collaboration, and continuous improvement.
  
• Establish data governance policies and practices, including data security, quality, and lifecycle management.
  
• Stay abreast of industry trends and emerging technologies in data architecture and management, recommending innovations and improvements to enhance our capabilities.
  

• 
  
• A Bachelor’s degree required in STEM
  
• 12+ years professional consulting experience in industry or in technology consulting.
  
• 12+ years hands-on experience in architecting, designing, delivering or optimizing data lake solutions.
  
• 5+ years’ experience with native cloud products and services such as Azure or GCP.
  
• 8+ years of experience mentoring and leading teams of data architects and data engineers, fostering a culture of innovation and professional development.
  
• In-depth knowledge of data architecture principles and best practices, including data modelling, data warehousing, data lakes, and data integration.
  
• Demonstrated experience in leading large data engineering teams to design and build platforms with complex architectures and diverse features including various data flow patterns, relational and no-SQL databases, production-grade performance, and delivery to downstream use cases and applications.
  
• Hands-on experience in designing end-to-end architectures and pipelines that collect, process, and deliver data to its destination efficiently and reliably.
  
• Proficiency in data modelling techniques and the ability to choose appropriate architectural design patterns, including Data Fabrics, Data Mesh, Lake Houses, or Delta Lakes.
  
• Manage complex data analysis, migration, and integration of enterprise solutions to modern platforms, including code efficiency and performance optimizations.
  
• Previous hands‑on coding skills in languages commonly used in data engineering, such as Python, Java, or Scala.
  
• Ability to design data solutions that can scale horizontally and vertically while optimizing performance.
  
• Experience with containerization technologies like Docker and container orchestration platforms like Kubernetes for managing data workloads.
  
• Experience in version control systems (e.g. Git) and knowledge of DevOps practices for automating data engineering workflows (DataOps).
  
• Practical understanding of data encryption, access control, and security best practices to protect sensitive data.
  
• Experience leading Infrastructure and Security engineers and architects in overall platform build.
  
• Excellent leadership, communication, and project management skills.
  
• Data Security and Database Management
  
• Enterprise Data Management and Metadata Management
  
• Ontology Design and Systems Design
  

• 
  
• Master’s degree in Electrical / Power Systems Engineering, Computer science, Statistics, Applied Mathematics, Data Science, Machine Learning or commensurate professional experience.
  
• Experience working at big 4 or a major utility.
  
• Experience with cloud data platforms like Databricks.
  
• Experience in leading and influencing teams, with a focus on mentorship and professional development.
  
• A passion for innovation and the strategic application of emerging technologies to solve real-world challenges.
  
• The ability to foster an inclusive environment that values diverse perspectives and empowers team members.
  
• Building and Managing Relationships
  
• Client Trust and Value and Commercial Astuteness
  
• Communicating With Impact and Digital Fluency
  

We are looking for top performers who demonstrate a blend of technical expertise and business acumen, with the ability to build strong client relationships and lead teams through change. Emotional agility and hybrid collaboration skills are key to success in this dynamic role.

FY26NATAID

At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.

• 
  
• We offer a comprehensive compensation and benefits package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $144,000 to $329,100. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $172,800 to $374,000. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.
  
• Join us in our team‑led and leader‑enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year.
  
• Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well‑being.
  

EY accepts applications for this position on an on‑going basis.

For those living in California, please click here for additional information.

EY focuses on high‑ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities.

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.

EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at .

Sr. Data Engineer (Hybrid)

Chicago, IL

The American Medical Association (AMA) is the nation's largest professional Association of physicians and a non-profit organization. We are a unifying voice and powerful ally for America's physicians, the patients they care for, and the promise of a healthier nation. To be part of the AMA is to be part of our Mission to promote the art and science of medicine and the betterment of public health.

At AMA, our mission to improve the health of the nation starts with our people. We foster an inclusive, people-first culture where every employee is empowered to perform at their best. Together, we advance meaningful change in health care and the communities we serve.

We encourage and support professional development for our employees, and we are dedicated to social responsibility. We invite you to learn more about us and we look forward to getting to know you.

We have an opportunity at our corporate offices in Chicago for a Sr. Data Engineer (Hybrid) on our Information Technology team. This is a hybrid position reporting into our Chicago, IL office, requiring 3 days a week in the office.

As a Sr. Data Engineer, you will play a key role in implementing
and maintaining AMA's enterprise data platform to support analytics,
interoperability, and responsible AI adoption. This role partners closely with
platform engineering, data governance, data science, IT security, and business
stakeholders to deliver highquality, reliable, and secure data products. This
role contributes to AMA's modern lakehouse architecture, optimizing data
operations, and embedding governance and quality standards into engineering
workflows. This role serves as a
senior technical contributor within the team-providing mentorship to junior
engineers and implementing engineering best practices within the data platform function,
in alignment with architectural direction set by leadership.

RESPONSIBILITIES:

Data Engineering & AI Enablement

• Build and maintain scalable data pipelines and
  ETL/ELT workflows supporting analytics, operational reporting, and AI/ML use
  cases.
• Implement best practice patterns for ingestion,
  transformation, modeling, and orchestration within a modern lakehouse
  environment (e.g., Databricks, Delta Lake, Azure Data Lake).
• Develop highperformance
  data models and curated datasets with strong attention to quality, usability,
  and interoperability; create reusable engineering components and automation.
• Collaborate with the Architecture Team, the Data
  Platform Lead, and federated IT teams to optimize storage, compute, and
  architectural patterns for performance and costefficiency.
• Build model-ready data sets and feature
  pipelines to support AI/ ML use cases; serve as a technical coordination point
  supporting business units' AI-related infrastructure needs.
• Collaborate with data scientists and AI Working
  Group to operationalize models responsibly and maintain ongoing monitoring
  signals.

Governance, Quality & Compliance

• Embed data governance, metadata standards,
  lineage tracking, and quality controls directly into engineering workflows;
  ensure technical implementation and alignment within engineering workflows.
• Work with the Data Governance Lead and business
  stakeholders to operationalize stewardship, classification, validation,
  retention, and access standards.
• Implement privacybydesign and securitybydesign
  principles, ensuring compliance with internal policies and regulatory
  obligations.
• Maintain documentation for pipelines, datasets,
  and transformations to support transparency and audit requirements.

Platform Reliability, Observability & Optimization

• Monitor and troubleshoot pipeline failures,
  performance bottlenecks, data anomalies, and platformlevel issues.
• Implement observability tooling, alerts,
  logging, and dashboards to ensure endtoend reliability.
• Support cost governance by optimizing compute
  resources, refining job schedules, and advising on efficient architecture.
• Collaborate with the Data Platform Lead on
  scaling, configuration management, CI/CD pipelines, and environment management.
• Collaborate with business units to understand
  data needs, translate them into engineering requirements, and deliver
  fit-for-purpose data solutions; share and apply best practices and emerging
  technologies within assigned initiatives.
• Work with IT Security and Legal/ Compliance to
  ensure platform and datasets meet risk and regulatory standards.
  

Staff Management

• Lead, mentor, and provide management oversight
  for staff.
• Responsible for setting objectives, evaluating
  employee performance, and fostering a collaborative team environment.
• Responsible for developing staff knowledge and
  skills to support career development.

May include other responsibilities as assigned

REQUIREMENTS:

1. Bachelor's degree in Computer Science, Engineering, Information Systems, or related field preferred or equivalent work experience and HS diploma/equivalent education required.
2. 5+ years of experience in data engineering within cloud environments
3. Experience in people management preferred.
4. Demonstrated hands-on experience with modern data platforms (Databricks preferred).
5. Proficiency in Python, SQL, and data
   transformation frameworks.
6. Experience designing and operationalizing
   ETL/ELT pipelines, orchestration workflows (Airflow, Databricks Workflows), and
   CI/CD processes.
7. Solid understanding of data modeling,
   structured/unstructured data patterns, and schema design.
8. Experience implementing governance and quality
   controls: metadata, lineage, validation, stewardship workflows.
9. Working knowledge of cloud architecture, IAM,
   networking, and security best practices.
10. Demonstrated ability to collaborate across
    technical and business teams.
11. Exposure to AI/ML engineering concepts, feature
    stores, model monitoring, or MLOps patterns.
12. Experience with infrastructureascode
    (Terraform, CloudFormation) or DevOps tooling.

The American Medical Association is located at 330 N. Wabash Avenue, Chicago, IL 60611 and is convenient to all public transportation in Chicago.

This role is an exempt position, and the salary range for this position is $115,523.42-$150,972.44. This is the lowest to highest salary we believe we would pay for this role at the time of this posting. An employee's pay within the salary range will be determined by a variety of factors including but not limited to business consideration and geographical location, as well as candidate qualifications, such as skills, education, and experience. Employees are also eligible to participate in an incentive plan. To learn more about the American Medical Association's benefits offerings, please click here.

We are an equal opportunity employer, committed to diversity in our workforce. All qualified applicants will receive consideration for employment. As an EOE/AA employer, the American Medical Association will not discriminate in its employment practices due to an applicant's race, color, religion, sex, age, national origin, sexual orientation, gender identity and veteran or disability status.

THE AMA IS COMMITTED TO IMPROVING THE HEALTH OF THE NATION

The pay range for this role is $150,000 - $200,000/yr USD.

WHO WE ARE:

Headquartered in Southern California, Skechers—the Comfort Technology Company®—has spent over 30 years helping men, women, and kids everywhere look and feel good. Comfort innovation is at the core of everything we do, driving the development of stylish, high-quality products at a great value. From our diverse footwear collections to our expanding range of apparel and accessories, Skechers is a complete lifestyle brand.

ABOUT THE ROLE:

Skechers Digital Team is seeking a Digital Data Architect reporting to the Director, Digital Architecture, Consumer Domain. This role is responsible for designing and governing Skechers’ Consumer Data 360 ecosystem, enabling identity resolution, high-quality data foundations, personalization, loyalty intelligence, and machine learning capabilities across digital and retail channels.

The ideal candidate will be a strong technical leader, have hands-on full-stack technical knowledge in enterprise technologies related to Skecher’s consumer domain, and have the ability to work in a fast-paced agile environment. You should have knowledge of consumer programs from an architecture/industry perspective, and you should have strong hands-on experience designing solutions on the Salesforce Core Platform (including configuration, integration, and data model best practices).

You will work cross-functionally with Digital Engineering, Data Engineering, Data Science, Loyalty, and Marketing teams to architect scalable, secure, and high-performance data platforms that support advanced personalization and recommender systems.

WHAT YOU’LL DO:

• Responsible for the full technical life cycle of consumer platform capabilities which includes:
• Capability roadmap and technical architecture in alignment to consumer experience
• Technical planning, design, and execution
• Operations, analytics/reporting, and adoption
• Define and evolve Skechers’ Consumer Data 360 architecture, including identity resolution (deterministic and probabilistic matching) and unified customer profiles.
• Architect scalable data models and pipelines across CDP, CRM, e-commerce, marketing automation, data lake, and warehouse platforms.
• Establish enterprise data quality frameworks including validation, deduplication, anomaly detection, and observability.
• Optimize SQL workloads and large-scale distributed queries through performance tuning, partitioning, indexing, and workload management strategies.
• Design and oversee ML pipelines supporting personalization, churn modeling, and recommender systems.
• Partner with Data Science teams to productionize models using distributed platforms such as Databricks (Spark, Delta Lake, MLflow preferred).
• Ensure secure data governance, access control (RBAC/ABAC), and compliance with GDPR, CCPA, and related privacy regulations.
• Provide architectural oversight ensuring performance, scalability, resilience, and maintainability.
• Collaborate with stakeholders to translate business objectives (LTV growth, personalization lift, engagement) into scalable data solutions.

REQUIREMENTS:

• Computer Science, Data Engineering, or related degree or equivalent experience.
• 12+ years experience architecting enterprise data platforms in cloud environments.
• 9+ years experience with data engineering with a focus on consumer data.
• 6+ years experience working with Salesforce platforms, including data models and enterprise integrations.
• Strong experience with Data 360 and identity resolution architectures.
• Proven expertise in SQL performance tuning and large-scale data modeling.
• Hands-on experience implementing ML pipelines and recommender systems in production environments.
• Experience with cloud technologies (AWS, GCP, or Azure).
• Experience with integration patterns (API, ETL, event streaming).
• Experience providing technical leadership and guidance across multiple projects and development teams.
• Experience translating business requirements into detailed technical specifications and working with development teams through implementation, including issue resolution and stakeholder communication.
• Strong project management skills including scope assessment, estimation, and clear technical communication with both business users and technical teams.
• Must hold at least one of the following Salesforce Certifications (Platform App Builder, Platform Developer 1, JavaScript Developer 1).
• Experience with Databricks or similar distributed data/ML platforms preferred.

IBM Consulting is seeking an accomplished Data & Analytics Associate Partner to accelerate our growth within the Industrial & Communications sectors. This executive role is responsible for shaping client vision, cultivating senior executive relationships, and developing data-driven solutions that enable clients to successfully navigate complex transformation programs.

You will bring together deep industry expertise and IBM’s portfolio of data, analytics, and AI capabilities to help organizations modernize their data ecosystems—migrating from legacy platforms to modern hybrid cloud architectures—while adopting next-generation analytics, GenAI, and agentic AI to strengthen decision-making and deliver measurable business and financial outcomes.

This role is ideal for a seasoned leader who integrates industry depth, consulting excellence, and technical thought leadership, has a strong understanding of competitive market dynamics, and consistently delivers high-impact transformation at scale.

• 
  

• Expand IBM’s Data & Analytics presence by identifying new market opportunities, developing differentiated solutions, and building a strong pipeline.

  
  

• Engage senior client executives to understand strategic priorities and shape data transformation roadmaps aligned to their business and financial goals.

  
  

• Lead end-to-end sales cycles, including solution definition, proposal leadership, financial structuring, and contract negotiation.

  
  

• 
  

• Advise C-suite leaders on strategies to their data estate modernization, advanced analytics, GenAI, and agentic AI to drive business performance.

  
  

• Architect integrated solutions that include:

  
  

• Migration from legacy data platforms to modern cloud-based architectures

  
  

• Data engineering and Information governance

  
  

• Business intelligence and advanced analytics

  
  

• GenAI-powered and agentic AI-driven automation and decisioning

  
  

• Lead complex transformation programs from discovery through delivery, ensuring measurable outcomes and client satisfaction.

  
  

• 
  

• Oversee multi-disciplinary delivery teams to ensure high-quality, consistent execution across all program phases.

  
  

• Manage engagement financials, including forecasting, margin performance, and overall portfolio profitability.

  
  

• Align right client technologies, industry expertise, and global delivery capabilities to maximize client value.

  
  

• 
  

• Recruit, mentor, and grow top-tier consultants, architects, and data specialists.

  
  

• Build and scale capabilities in data modernization, cloud data engineering, analytics, GenAI, and emerging agentic AI techniques.

  
  

• Contribute to practice strategy, offering development, and capability growth across the global Data & Analytics team.

  
  

• 
  

• Stay ahead of sector and technology trends, including cloud modernization, GenAI, agentic system design, regulatory changes, and evolving competitive dynamics.

  
  

• Represent IBM at industry conferences, client events, webinars, and executive roundtables.

  
  

• Create original thought leadership—articles, perspectives, point-of-views—that positions IBM as a leading advisor in data and AI-driven transformation.

  
  

This position can be preformed anywhere in the US.

"Leaders are expected to spend time with their teams and clients and therefore are generally expected to be in the workplace a minimum of three days a week, subject to business needs."

• 
  

• 12+ years of experience in consulting, data strategy, analytics, or digital transformation, with strong exposure to the Industrial or Communications sectors.

  
  

• Hands-on experience modernizing data ecosystems, including migrating from legacy on-premise platforms to modern cloud-native or hybrid cloud architectures.

  
  

• Deep expertise with major cloud platforms and their data/analytics stacks, including implementation experience with:

  
  

• AWS (e.g., Redshift, S3, Glue, EMR, Athena, Lake Formation, Bedrock, SageMaker)

  
  

• Microsoft Azure (e.g., Azure Data Lake, Synapse, Data Factory, Databricks on Azure, Fabric, Cognitive Services)

  
  

• Google Cloud Platform (e.g., BigQuery, Cloud Storage, Dataflow, Dataproc, Vertex AI)

  
  

• Experience designing and implementing end-to-end data pipelines, governance frameworks, and analytics solutions on one or more of these platforms.

  
  

• Strong understanding of GenAI architectures, LLM integration patterns, vector databases, retrieval-augmented generation (RAG), and emerging agentic AI frameworks.

  
  

• Proven track record of selling, structuring, and delivering large-scale data and AI transformation programs.

  
  

• Robust technical and functional expertise in data engineering, cloud data platforms, analytics, AI/ML, information management, and governance.

  
  

• Executive-level communication and presence, with demonstrated ability to influence senior stakeholders and convey complex topics through compelling narratives.

  
  

• Financial management experience, including engagement economics, forecasting, margin optimization, and portfolio profitability.

  
  

• Demonstrated leadership in building, scaling, and developing high-performing consulting and technical teams.

  
  

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

• 
  
• Administer and operate Microsoft Purview Data Map and Data Catalog environments.
  
• Monitor platform health, scan execution, metadata ingestion, and lineage availability.
  
• Troubleshoot and resolve catalog, scan, and connectivity issues.
  
• Perform routine maintenance, configuration updates, and service optimizations.
  
• Coordinate incident resolution with internal engineering teams and Microsoft support as required.
  

• 
  
• Register, configure, and maintain data sources across Azure, M365, on?prem, and approved third?party platforms.
  
• Configure and schedule metadata scans for supported sources.
  
• Manage authentication for scans using managed identities, service principals, and Key Vault secrets.
  
• Monitor scan performance, failures, and coverage; take corrective action as needed.
  
• Optimize scan frequency and scope to balance cost, performance, and governance coverage.
  

• 
  
• Maintain and enforce enterprise metadata standards within the Purview Catalog.
  
• Manage business metadata, classifications, glossary terms, and custom attributes.
  
• Ensure metadata accuracy, completeness, and consistency across data assets.
  
• Support curation activities including asset certification and publishing.
  
• Resolve duplicate, incomplete, or stale catalog entries.
  

• 
  
• Enable and validate data lineage ingestion from supported data platforms.
  
• Monitor lineage completeness and visibility for critical data assets.
  
• Assist data consumers and stewards with lineage?based impact analysis.
  
• Escalate lineage gaps or tool limitations requiring architectural or engineering remediation.
  

• 
  
• Configure and manage Purview role?based access control (RBAC) within collections.
  
• Provision and maintain access for administrators, data curators, and data stewards.
  
• Enforce domain?based access controls and separation of duties.
  
• Integrate Purview access with Microsoft Entra ID.
  
• Support sensitivity labels and classification alignment with Microsoft Information Protection.
  

• 
  
• Support automated discovery of sensitive data (PII, PCI, PHI).
  
• Assist risk, audit, and compliance teams with catalog evidence and reporting.
  
• Validate scan coverage for regulated data domains.
  
• Support regulatory and audit initiatives (SOX, GLBA, NYDFS, GDPR, etc.).
  

• 
  
• Provide operational support to data producers, consumers, and data stewards.
  
• Respond to access requests, catalog issues, and usage questions.
  
• Maintain operational documentation, runbooks, and standard operating procedures.
  
• Support onboarding of new data domains following established governance patterns.
  
• Assist with training and adoption initiatives led by governance or architecture teams.
  

• 
  
• 5+ years experience supporting enterprise data platforms or governance tools and 4+ years hands?on MS Purview experience at enterprise scale.
  
• Hands?on experience administering Microsoft Purview Data Catalog.
  
• Strong understanding of metadata management, data classification, and lineage concepts.
  
• Working knowledge of Azure data services and enterprise data ecosystems.
  
• Experience managing access controls and identities using Microsoft Entra ID.
  
• Familiarity with regulated data environments and compliance requirements.
  
• Strong troubleshooting, operational support, and documentation skills.
  

• 
  
• Experience supporting Purview integrations with Synapse, Fabric, Databricks, Snowflake, or SQL Server.
  
• Exposure to financial services or other regulated industries.
  
• Experience with PowerShell, REST APIs, or basic automation for operational tasks.
  
• Prior experience supporting enterprise data governance or stewardship programs.
  

• 
  
• Facilitate workshops, demos, onboarding sessions, and cross?domain engagements to drive Marketplace adoption.
  
• Serve as the primary technical presenter of the Marketplace for domain teams and stakeholders.
  
• Engage with domain owners to understand their data products, help refine their articulation, and showcase how they integrate into the Marketplace ecosystem.
  
• Configure and maintain demo environments for Marketplace capabilities, data products, and new features.
  
• Support light development, proof?of?concept configurations, and sample integrations to demonstrate platform capabilities.
  
• Translate technical Marketplace concepts into clear, business?friendly language for non?technical audiences.
  
• Collect structured feedback from domain teams, synthesize insights, and partner with product and engineering to influence the roadmap.
  
• Develop and refine training materials, demos, playbooks, and onboarding assets to support continuous adoption.
  
• Act as an advocate for domains, ensuring their data product needs and challenges are well represented in Marketplace planning.
  
• Support ongoing adoption initiatives, including community sessions, office hours, and cross?domain knowledge sharing.
  

• 
  
• 4-7+ years of experience in data engineering, platform engineering, solution engineering, technical consulting, or similar roles.
  
• Strong understanding of data products, data modeling concepts, data APIs, enterprise integrations and metadata?driven architectures.
  
• Ability to configure and demonstrate platform features, build light proofs?of?concept, and support technical onboarding.
  
• Excellent communication and presentation skills, with experience translating technical concepts for business partners.
  
• Experience facilitating workshops, leading demos, or driving customer/product adoption initiatives.
  
• Ability to engage domain teams, understand their data product needs, and help articulate value within a larger ecosystem.
  
• Strong collaboration and stakeholder management skills across engineering, product, and business teams.
  
• Comfortable working in fast?moving environments and driving clarity through ambiguity.
  

• 
  
• Experience with data product and governance frameworks, data marketplaces, data mesh concepts, or platform adoption roles.
  
• Hands?on experience with cloud data platforms (Azure, AWS, or GCP), data pipelines, or integration tooling.
  
• Familiarity with REST/GraphQL APIs, event-driven patterns, and data ingestion workflows.
  
• Background in solution architecture, customer engineering, or sales engineering.
  
• Experience developing demo environments, sample apps, or repeatable platform enablement assets.
  
• Strong storytelling ability when explaining data product value, domain capabilities, and Marketplace patterns.
  

About Wakefern

Wakefern Food Corp. is the largest retailer-owned cooperative in the United States and supports its co-operative members' retail operations, trading under the ShopRite®, Price Rite®, The Fresh Grocer®, Dearborn Markets®, and Gourmet Garage® banners.

Employing an innovative approach to wholesale business services, Wakefern focuses on helping the independent retailer compete in a big business world. Providing the tools entrepreneurs need to stay a step ahead of the competition, Wakefern’s co-operative members benefit from the company’s extensive portfolio of services, including innovative technology, private label development, and best-in-class procurement practices.

The ideal candidate will have a strong background in designing, developing, and implementing complex projects, with focus on automating data processes and driving efficiency within the organization. This role requires a close collaboration with application developers, data engineers, data analysts, data scientists to ensure seamless data integration and automation across various platforms. The Data Integration & AI Engineer is responsible for identifying opportunities to automate repetitive data processes, reduce manual intervention, and improve overall data accessibility.

Essential Functions

• Participate in the development life cycle (requirements definition, project approval, design, development, and implementation) and maintenance of the systems.
• Implement and enforce data quality and governance standards to ensure the accuracy and consistency.
• Provide input for project plans and timelines to align with business objectives.
• Monitor project progress, identify risks, and implement mitigation strategies.
• Work with cross-functional teams and ensure effective communication and collaboration.
• Provide regular updates to the management team.
• Follow the standards and procedures according to Architecture Review Board best practices, revising standards and procedures as requirements change and technological advancements are incorporated into the >tech_ structure.
• Communicates and promotes the code of ethics and business conduct.
• Ensures completion of required company compliance training programs.
• Is trained – either through formal education or through experience – in software / hardware technologies and development methodologies.
• Stays current through personal development and professional and industry organizations.

Responsibilities

• Design, build, and maintain automated data pipelines and ETL processes to ensure scalability, efficiency, and reliability across data operations.
• Develop and implement robust data integration solutions to streamline data flow between diverse systems and databases.
• Continuously optimize data workflows and automation processes to enhance performance, scalability, and maintainability.
• Design and develop end-to-end data solutions utilizing modern technologies, including scripting languages, databases, APIs, and cloud platforms.
• Ensure data solutions and data sources meet quality, security, and compliance standards.
• Monitor and troubleshoot automation workflows, proactively identifying and resolving issues to minimize downtime.
• Provide technical training, documentation, and ongoing support to end users of data automation systems.
• Prepare and maintain comprehensive technical documentation, including solution designs, specifications, and operational procedures.

Qualifications

• A bachelor's degree or higher in computer science, information systems, or a related field.
• Hands-on experience with cloud data platforms (e.g., GCP, Azure, etc.)
• Strong knowledge and skills in data automation technologies, such as Python, SQL, ETL/ELT tools, Kafka, APIs, cloud data pipelines, etc.
• Experience in GCP BigQuery, Dataflow, Pub/Sub, and Cloud storage.
• Experience with workflow orchestration tools such as Cloud Composer or Airflow
• Proficiency in iPaaS (Integration Platform as a Service) platforms, such as Boomi, SAP BTP, etc.
• Develop and manage data integrations for AI agents, connecting them to internal and external APIs, databases, and knowledge sources to expand their capabilities.
• Build and maintain scalable Retrieval-Augmented Generation (RAG) pipelines, including the curation and indexing of knowledge bases in vector databases (e.g., Pinecone, Vertex AI Vector Search).
• Leverage cloud-based AI/ML platforms (e.g., Vertex AI, Azure ML) to build, train, and deploy machine learning models on a scale.
• Establish and enforce data quality and governance standards for AI/ML datasets, ensuring the accuracy, completeness, and integrity of data used for model training and validation.
• Collaborate closely with data scientists and machine learning engineers to understand data requirements and deliver optimized data solutions that support the entire machine learning lifecycle.
• Hands-on experience with IBM DataStage and Alteryx is a plus.
• Strong understanding of database design principles, including normalization, indexing, partitioning, and query optimization.
• Ability to design and maintain efficient, scalable, and well-structured database schemas to support both analytical and transactional workloads,
• Familiarity with BI visualization tools such as MicroStrategy, Power BI, Looker, or similar.
• Familiarity with data modeling tools.
• Familiarity with DevOps practices for data (CI/CD pipelines)
• Proficiency in project management software (e.g., JIRA, Clarizen, etc.)
• Familiarity with DevOps practices for data (CI/CD pipelines)
• Strong knowledge and skills in data management, data quality, and data governance.
• Strong communication, collaboration, and problem-solving skills.
• Ability to work on multiple projects and prioritize tasks effectively.
• Ability to work independently and in a team environment.
• Ability to learn new technologies and tools quickly.
• The ability to handle stressful situations.
• Highly developed business acuity and acumen.
• Strong critical thinking and decision-making skills.

Working Conditions & Physical Demands

This position requires in-person office presence at least 4x a week.

Compensation and Benefits

The salary range for this position is $75,868 - $150,644. Placement in the range depends on several factors, including experience, skills, education, geography, and budget considerations.

Wakefern is proud to offer a comprehensive benefits package designed to support the health, well-being, and professional development of our Associates. Benefits include medical, dental, and vision coverage, life and disability insurance, a 401(k) retirement plan with company match & annual company contribution, paid time off, holidays, and parental leave.

Associates also enjoy access to wellness and family support programs, fitness reimbursement, educational and training opportunities through our corporate university, and a collaborative, team-oriented work environment. Many of these benefits are fully or partially funded by the company, with some subject to eligibility requirements

Join the team leading the next evolution of virtual care.

At Teladoc Health, you are empowered to bring your true self to work while helping millions of people live their healthiest lives.

Here you will be part of a high-performance culture where colleagues embrace challenges, drive transformative solutions, and create opportunities for growth. Together, we're transforming how better health happens.

Summary of Position

As a Staff Software Engineer, you are a senior individual contributor who leads the design and delivery of significant platform features and raises the bar for engineering quality across the team. You'll work handson in code-designing APIs and data flows, building services in Python/FastAPI and React frontends, and guiding solutions from idea to production. You'll mentor engineers, influence architecture and standards within and adjacent to your team, and partner closely with product and design to achieve clear, measurable outcomes. This role blends deep implementation work with pragmatic technical leadership by example.

Essential Duties and Responsibilities

• Lead technical design for platform features and services, breaking ambiguous requirements into clear, incremental designs and stories for your team and adjacent partners.

• Implement backend services in Python/FastAPI and React frontends end-to-end, owning a continuous stream of stories from idea to production.

• Define and use clear API contracts and data flows between services and UIs, creating patterns and templates others can follow.

• Champion high-quality engineering practices, including code reviews, documentation, and maintainable, testable designs.

• Develop and improve automated testing (unit, integration, endtoend) and integrate these into everyday development and CI.

• Improve CI/CD pipelines and release workflows for your team so the team can ship small, safe changes frequently and confidently.

• Own the operational lifecycle of the features and services you build, including monitoring, observability, on-call participation, and incident follow-up.

• Design and implement secure-by-default solutions, including robust authentication/authorization, input validation, and safe handling of sensitive data.

• Identify and address reliability and performance risks early, proposing concrete technical improvements and sequencing them into the roadmap.

• Mentor and unblock engineers through pairing, design discussions, and clear feedback; influence without formal authority.

• Partners with product/design to shape requirements into incremental deliverables; escalates tradeoff decisions; proposes sequencing that optimizes value/risk.

The time spent on each responsibility reflects an estimate and is subject to change dependent on business needs.

Supervisory Responsibilities

No

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field; equivalent work experience is acceptable.

• 7+ years of experience in software engineering.

• Strong proficiency with Python and modern web backends (FastAPI, Flask, Django, or similar) and solid understanding of HTTP, API design, and data modeling.

• Significant experience with React (or a comparable SPA framework) and building production frontends that talk to backend APIs.

• Demonstrated ability to own features end-to-end in a small team: from shaping requirements through design, implementation, testing, deployment, and support.

• Experience designing and working with distributed systems or multi-service architectures (e.g., service boundaries, async jobs, integration patterns).

• Solid understanding of observability and operations for production systems (metrics, logs, traces, dashboards, alerting, incident response).

• Strong understanding of security fundamentals (authentication, authorization, secure data handling) and how they apply to web services and UIs.

• Deep familiarity with automated testing and CI/CD, and a track record of improving engineering workflows and quality.

• Excellent communication and collaboration skills; comfortable working closely with product, design, and other stakeholders.

• Proven ability to provide technical leadership in a hands-on way: unblocking others, making clear decisions, and raising the bar through code and reviews.

Bonus Qualifications

• Experience in early-stage or small platform teams where engineers wear multiple hats and balance shipping with building foundations.

• Experience with Azure and containerized deployments (or similar cloud-native environments).

• Experience building platforms (developer platforms, data platforms, or similar) that serve multiple product teams.

• Exposure to AI/ML or data-intensive applications (e.g., integrating with model inference APIs, data pipelines, or analytical data stores).

The base salary range for this position is$180,000 - $200,000. In addition to a base salary, this position is eligible for a performance bonus and benefits (subject to eligibility requirements) listed here: Teladoc Health Benefits 2026.Total compensation is based on several factors including, but not limited to, type of position, location, education level, work experience, and certifications.This information is applicable for all full-time positions.

#LI-SS2 #LI-Remote

We follow a Flexible Vacation Policy, intended for rest, relaxation, and personal time. All time off must be approved by your manager prior to use. You will also receive 80 hours of Paid Sick, Safe, and Caregiver Leave annually. This applies to full-time positions only. If you are applying for a part-time role, your recruiter can provide additional details.

As part of our hiring process, we verify identity and credentials, conduct interviews (live or video), and screen for fraud or misrepresentation. Applicants who falsify information will be disqualified.

Teladoc Health will not sponsor or transfer employment work visas for this position. Applicants must be currently authorized to work in the United States without the need for visa sponsorship now or in the future.

Why join Teladoc Health?

• Teladoc Health is transforming how better health happens. Learn how when you join us in pursuit of our impactful mission.

• Chart your career path with meaningful opportunities that empower you to grow, lead, and make a difference.

• Join a multi-faceted community that celebrates each colleague's unique perspective and is focused on continually improving, each and every day.

• Contribute to an innovative culture where fresh ideas are valued as we increase access to care in new ways.

• Enjoy an inclusive benefits program centered around you and your family, with tailored programs that address your unique needs.

• Explore candidate resources with tips and tricks from Teladoc Health recruiters and learn more about our company culture by exploring #TeamTeladocHealth on LinkedIn.

As an Equal Opportunity Employer, we never have and never will discriminate against any job candidate or employee due to age, race, religion, color, ethnicity, national origin, gender, gender identity/expression, sexual orientation, membership in an employee organization, medical condition, family history, genetic information, veteran status, marital status, parental status, or pregnancy). In our innovative and inclusive workplace, we prohibit discrimination and harassment of any kind.

Teladoc Health respects your privacy and is committed to maintaining the confidentiality and security of your personal information. In furtherance of your employment relationship with Teladoc Health, we collect personal information responsibly and in accordance with applicable data privacy laws, including but not limited to, the California Consumer Privacy Act (CCPA). Personal information is defined as: Any information or set of information relating to you, including (a) all information that identifies you or could reasonably be used to identify you, and (b) all information that any applicable law treats as personal information. Teladoc Health's Notice of Privacy Practices for U.S. Employees' Personal information is available at this link.