Computer Data Storage Terms Jobs in Usa

Job Title – Lead Data Engineer

Please note this role is not able to offer visa transfer or sponsorship now or in the future

About the role

As a Lead Data Engineer, you will make an impact by designing, building, and operating scalable, cloud‑native data platforms supporting batch and streaming use cases, with strong focus on governance, performance, and reliability. You will be a valued member of the Data Engineering team and work collaboratively with cross‑functional engineering, cloud, and architecture stakeholders.

In this role, you will:

• Design, build, and operate scalable cloud‑native data platforms supporting batch and streaming workloads with strong governance, performance, and reliability.
• Develop and operate data systems on AWS, Azure, and GCP, designing cloud‑native, scalable, and cost‑efficient data solutions.
• Build modern data architectures including data lakes, data lakehouses, and data hubs, with strong understanding of ingestion patterns, data governance, data modeling, observability, and platform best practices.
• Develop data ingestion and collection pipelines using Kafka and AWS Glue; work with modern storage formats such as Apache Iceberg and Parquet.
• Design and develop real‑time streaming pipelines using Kafka, Flink, or similar streaming frameworks, with understanding of event‑driven architectures and low‑latency data processing.
• Perform data transformation and modeling using SQL‑based frameworks and orchestration tools such as dbt, AWS Glue, and Airflow, including Slowly Changing Dimensions (SCD) and schema evolution.
• Use Apache Spark extensively for large‑scale data transformations across batch and streaming workloads.

Work model

We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a hybrid position requiring 4 days a week in a client or Cognizant office in Atlanta, GA. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

What you need to have to be considered

• Hands‑on experience developing and operating data systems on AWS, Azure, and GCP.
• Proven ability to design cloud‑native, scalable, and cost‑efficient data solutions.
• Experience building data lakes, data lakehouses, and data hubs with strong understanding of ingestion patterns, governance, modeling, observability, and platform best practices.
• Expertise in data ingestion and collection using Kafka and AWS Glue, with experience in Apache Iceberg and Parquet.
• Strong experience designing and developing real‑time streaming pipelines using Kafka, Flink, or similar streaming frameworks.
• Deep expertise in data transformation and modeling using SQL‑based frameworks and orchestration tools including dbt, AWS Glue, and Airflow, with knowledge of SCD and schema evolution.
• Extensive experience using Apache Spark for large‑scale batch and streaming data transformations.

These will help you stand out

• Experience with event‑driven architectures and low‑latency data processing.
• Strong understanding of schema evolution, SCD modeling, and modern data modeling concepts.
• Experience with Apache Iceberg, Parquet, and modern ingestion/storage patterns.
• Strong knowledge of observability, governance, and platform best practices.
• Ability to partner effectively with cloud, architecture, and engineering teams.

Salary and Other Compensation:

Applications will be accepted until March 17, 2025.

The annual salary for this position is between $81,000 - $135,000, depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long‑term/Short‑term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

The Manager of Data is responsible for overseeing the collection, management, and analysis of institutional data to support decision-making and strategic planning. This role involves leading a team of data analysts and ensuring data integrity, security, and compliance with relevant regulations. Additionally, the manager collaborates with various departments to develop data governance policies and implement effective data management practices that enhance the institution's ability to leverage data for improved outcomes.

Job Duty 1 -
Oversee the development and implementation of data management strategies to ensure the accurate collection, storage, and retrieval of institutional data.

Job Duty 9 -
Collaborate with academic and administrative departments to identify data needs and develop solutions that enhance data accessibility and usability.

Job Duty 10 -
Perform other duties as assigned.

Job Duty 2 -
Lead a team of data analysts in conducting data analysis and reporting to support institutional decision-making and strategic initiatives.

Job Duty 3 -
Establish and enforce data governance policies to ensure data quality, integrity, and compliance with relevant regulations and standards.

Job Duty 4 -
Monitor data management systems and tools, ensuring they are maintained, updated, and aligned with best practices in data security and privacy.

Job Duty 5 -
Provide training and support to staff on data management practices, tools, and analytical techniques to foster a data-driven culture within the institution.

Job Duty 6 -
Conduct regular audits of data processes and systems to identify areas for improvement and implement corrective actions as needed.

Job Duty 7 -
Prepare and present comprehensive reports on data trends, analysis findings, and management initiatives to senior leadership and relevant stakeholders.

Job Duty 8 -
Stay informed about emerging data management technologies and methodologies to continually enhance the institution's data management capabilities.

Educational Requirements
Bachelor's degree in related discipline or equivalent, related experience.

Required Experience
5+ years of relevant experience; 3+ years of supervisory knowledge.

Preferred Educational Qualifications
Master's degree in related discipline or equivalent, related experience.

• Master's degree in Computer Science, Information Technology, Information System, Data Science, Business Administration, related discipline or equivalent, related experience.
• Certified Data Management Professional certification.
• Experience designing, implementing and operating Security Information Management solutions such as SIMS or ThreatSwitch.
• Advanced knowledge of SQL, database design and data modeling expertise.
• Experience in managing and securing enterprise security database systems containing sensitive and regulated data.
• Experience in cross-departmental collaboration during security investigations, assessments, and compliance reviews.

The University System of Georgia is comprised of our 25 institutions of higher education and learning as well as the System Office. Our USG Statement of Core Values are Integrity, Excellence, Accountability, and Respect. These values serve as the foundation for all that we do as an organization, and each USG community member is responsible for demonstrating and upholding these standards. More details on the USG Statement of Core Values and Code of Conduct are available in USG Board Policy 8.2.18.1.2 and can be found on-line at policymanual/section8/C224/#p8.2.18_personnel_conduct.

Additionally, USG supports Freedom of Expression as stated in Board Policy 6.5 Freedom of Expression and Academic Freedom found on-line at policymanual/section6/C2653.

The Georgia Institute of Technology (Georgia Tech) is an Equal Employment Opportunity Employer. The Institute is committed to maintaining a fair and respectful environment for all. To that end, and in accordance with federal and state law, Board of Regents policy, and Institute policy, Georgia Tech provides equal opportunity to all faculty, staff, students, and all other members of the Georgia Tech community, including applicants for admission and/or employment, contractors, volunteers, and participants in institutional programs, activities, or services. Georgia Tech complies with all applicable laws and regulations governing equal opportunity in the workplace and in educational activities.

Equal opportunity and decisions based on merit are fundamental values of the University System of Georgia ("USG") and Georgia Tech. Georgia Tech prohibits discrimination, including discriminatory harassment, on the basis of an individual's race, ethnicity, ancestry, color, religion, sex (including pregnancy), national origin, age, disability, genetics, or veteran status in its programs, activities, employment, and admissions. Further, Georgia Tech prohibits citizenship status, immigration status, and national origin discrimination in hiring, firing, and recruitment, except where such restrictions are required in order to comply with law, regulation, executive order, or Attorney General directive, or where they are required by Federal, State, or local government contract.

The Georgia Tech Research Institute (GTRI) is the nonprofit, applied research division of the Georgia Institute of Technology (Georgia Tech). This position is in the Research Security Department (RS) of GTRI.

About Wakefern

Wakefern Food Corp. is the largest retailer-owned cooperative in the United States and supports its co-operative members' retail operations, trading under the ShopRite®, Price Rite®, The Fresh Grocer®, Dearborn Markets®, and Gourmet Garage® banners.

Employing an innovative approach to wholesale business services, Wakefern focuses on helping the independent retailer compete in a big business world. Providing the tools entrepreneurs need to stay a step ahead of the competition, Wakefern’s co-operative members benefit from the company’s extensive portfolio of services, including innovative technology, private label development, and best-in-class procurement practices.

The ideal candidate will have a strong background in designing, developing, and implementing complex projects, with focus on automating data processes and driving efficiency within the organization. This role requires a close collaboration with application developers, data engineers, data analysts, data scientists to ensure seamless data integration and automation across various platforms. The Data Integration & AI Engineer is responsible for identifying opportunities to automate repetitive data processes, reduce manual intervention, and improve overall data accessibility.

Essential Functions

• Participate in the development life cycle (requirements definition, project approval, design, development, and implementation) and maintenance of the systems.
• Implement and enforce data quality and governance standards to ensure the accuracy and consistency.
• Provide input for project plans and timelines to align with business objectives.
• Monitor project progress, identify risks, and implement mitigation strategies.
• Work with cross-functional teams and ensure effective communication and collaboration.
• Provide regular updates to the management team.
• Follow the standards and procedures according to Architecture Review Board best practices, revising standards and procedures as requirements change and technological advancements are incorporated into the >tech_ structure.
• Communicates and promotes the code of ethics and business conduct.
• Ensures completion of required company compliance training programs.
• Is trained – either through formal education or through experience – in software / hardware technologies and development methodologies.
• Stays current through personal development and professional and industry organizations.

Responsibilities

• Design, build, and maintain automated data pipelines and ETL processes to ensure scalability, efficiency, and reliability across data operations.
• Develop and implement robust data integration solutions to streamline data flow between diverse systems and databases.
• Continuously optimize data workflows and automation processes to enhance performance, scalability, and maintainability.
• Design and develop end-to-end data solutions utilizing modern technologies, including scripting languages, databases, APIs, and cloud platforms.
• Ensure data solutions and data sources meet quality, security, and compliance standards.
• Monitor and troubleshoot automation workflows, proactively identifying and resolving issues to minimize downtime.
• Provide technical training, documentation, and ongoing support to end users of data automation systems.
• Prepare and maintain comprehensive technical documentation, including solution designs, specifications, and operational procedures.

Qualifications

• A bachelor's degree or higher in computer science, information systems, or a related field.
• Hands-on experience with cloud data platforms (e.g., GCP, Azure, etc.)
• Strong knowledge and skills in data automation technologies, such as Python, SQL, ETL/ELT tools, Kafka, APIs, cloud data pipelines, etc.
• Experience in GCP BigQuery, Dataflow, Pub/Sub, and Cloud storage.
• Experience with workflow orchestration tools such as Cloud Composer or Airflow
• Proficiency in iPaaS (Integration Platform as a Service) platforms, such as Boomi, SAP BTP, etc.
• Develop and manage data integrations for AI agents, connecting them to internal and external APIs, databases, and knowledge sources to expand their capabilities.
• Build and maintain scalable Retrieval-Augmented Generation (RAG) pipelines, including the curation and indexing of knowledge bases in vector databases (e.g., Pinecone, Vertex AI Vector Search).
• Leverage cloud-based AI/ML platforms (e.g., Vertex AI, Azure ML) to build, train, and deploy machine learning models on a scale.
• Establish and enforce data quality and governance standards for AI/ML datasets, ensuring the accuracy, completeness, and integrity of data used for model training and validation.
• Collaborate closely with data scientists and machine learning engineers to understand data requirements and deliver optimized data solutions that support the entire machine learning lifecycle.
• Hands-on experience with IBM DataStage and Alteryx is a plus.
• Strong understanding of database design principles, including normalization, indexing, partitioning, and query optimization.
• Ability to design and maintain efficient, scalable, and well-structured database schemas to support both analytical and transactional workloads,
• Familiarity with BI visualization tools such as MicroStrategy, Power BI, Looker, or similar.
• Familiarity with data modeling tools.
• Familiarity with DevOps practices for data (CI/CD pipelines)
• Proficiency in project management software (e.g., JIRA, Clarizen, etc.)
• Familiarity with DevOps practices for data (CI/CD pipelines)
• Strong knowledge and skills in data management, data quality, and data governance.
• Strong communication, collaboration, and problem-solving skills.
• Ability to work on multiple projects and prioritize tasks effectively.
• Ability to work independently and in a team environment.
• Ability to learn new technologies and tools quickly.
• The ability to handle stressful situations.
• Highly developed business acuity and acumen.
• Strong critical thinking and decision-making skills.

Working Conditions & Physical Demands

This position requires in-person office presence at least 4x a week.

Compensation and Benefits

The salary range for this position is $75,868 - $150,644. Placement in the range depends on several factors, including experience, skills, education, geography, and budget considerations.

Wakefern is proud to offer a comprehensive benefits package designed to support the health, well-being, and professional development of our Associates. Benefits include medical, dental, and vision coverage, life and disability insurance, a 401(k) retirement plan with company match & annual company contribution, paid time off, holidays, and parental leave.

Associates also enjoy access to wellness and family support programs, fitness reimbursement, educational and training opportunities through our corporate university, and a collaborative, team-oriented work environment. Many of these benefits are fully or partially funded by the company, with some subject to eligibility requirements

About Pinterest:

Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.

Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace theflexibility to do your best work. Creating a career you love? It's Possible.

At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we're looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we'll explore your foundational skills and how you collaborate with AI.

Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here.

About tvScientific

tvScientific is the first and only CTV advertising platform purpose-built for performance marketers. We leverage massive data and cutting-edge science to automate and optimize TV advertising to drive business outcomes. Our solution combines media buying, optimization, measurement, and attribution in one, efficient platform. Our platform is built by industry leaders with a long history in programmatic advertising, digital media, and ad verification who have now purpose-built a CTV performance platform advertisers can trust to grow their business.

We are seeking a Staff Data Engineer to lead the design, implementation, and evolution of our identity services and data governance platform. This role is critical to ensuring trusted, privacy-safe, and well-governed data across the organization. You will work at the intersection of data engineering, identity resolution, privacy, and platform reliability.This is anindividual contributor role, where you will work to define and implement a strategic vision for data engineering within the organization.

What you'll do:

• 
  
• Identity Services:
  
  • 
    
  • Design and maintain a scalable identity resolution platform
    
  • Build pipelines and services to ingest, normalize, link, and version identity data across multiple sources
    
  • Ensure deterministic and probabilistic matching logic that is transparent, auditable, and measurable
    
  • Partner with product and analytics teams to expose identity data through reliable, well-documented APIs and datasets
    
  • Build and operate batch and streaming pipelines using modern data stack tools
    
  • Create clear documentation, standards, and runbooks for identity and governance systems
    
  
  
  
• Data Governance & Trust
  
  • 
    
  • Own data governance foundations including data lineage, quality checks, schema enforcement, and access controls
    
  • Implement privacy-by-design principles (PII handling, consent enforcement, retention policies)
    
  • Collaborate with legal, privacy, and security teams to operationalize regulatory requirements (e.g., GDPR, CCPA)
    
  • Establish monitoring and alerting for data quality, freshness, and integrity
    
  
  
  

What we're looking for:

• 
  
• Data engineering experience with proven track record building data infrastructure using Spark with Scala
  
• Proven experience building data infrastructure using Spark with Scala for at least 5 years
  
• Experience in delivering significant technical initiatives and building reliable, large scale services
  
• Experience in delivering APIs backed by relationship-heavy datasets
  
• Experience implementing data governance practices, including data quality, metadata management, and access controls
  
• Strong understanding of privacy-by-design principles and handling of sensitive or regulated data
  
• Familiarity with data lakes, cloud warehouses, and storage formats
  
• Strong proficiency in AWS services
  
• Successful design and implementation of scalable and efficient data infrastructure
  
• High attention to detail in implementation of automated data quality checks
  
• Effective collaboration with cross-functional teams
  
• Excellent written and verbal communication skills
  
• Bachelor's degree in Computer Science or a related field
  

In-Office Requirement Statement:

• 
  
• We recognize that the ideal environment for work is situational and may differ across departments. What this looks like day-to-day can vary based on the needs of each organization or role.
  

Relocation Statement:

• 
  
• This position is not eligible for relocation assistance. Visit ourPinFlexpage to learn more about our working model.
  

#LI-SM4

#LI-REMOTE

At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise.

Information regarding the culture at Pinterest and benefits available for this position can be found here.

Our Commitment to Inclusion:

About Pinterest:

Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.

Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace theflexibility to do your best work. Creating a career you love? It's Possible.

At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we're looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we'll explore your foundational skills and how you collaborate with AI.

Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here.

About tvScientific

tvScientific is the first and only CTV advertising platform purpose-built for performance marketers. We leverage massive data and cutting-edge science to automate and optimize TV advertising to drive business outcomes. Our solution combines media buying, optimization, measurement, and attribution in one, efficient platform. Our platform is built by industry leaders with a long history in programmatic advertising, digital media, and ad verification who have now purpose-built a CTV performance platform advertisers can trust to grow their business.

As a Senior Data Engineer at tvScientific, you will be a key player in implementing the robust data infrastructure to power our data-heavy company. You will collaborate with our cross-functional teams to evolve our core data pipelines, design for efficiency as we scale, and store data in optimal engines and formats. This is an individual contributor role, where you will work to define and implement a strategic vision for data engineering within the organization.

What you'll do:

• 
  
• Implement robust data infrastructure in AWS, using Spark with Scala
  
• Evolve our core data pipelines to efficiently scale for our massive growth
  
• Store data in optimal engines and formats
  
• Collaborate with our cross-functional teams to design data solutions that meet business needs
  
• Built out fault-tolerant batch and streaming pipelines
  
• Leverage and optimize AWS resources while designing for scale
  
• Collaborate closely with our Data Science and Product teams
  
• How we'll define success:
  
  • 
    
  • Successful implementation of scalable and efficient data infrastructure
    
  • Timely delivery and optimization of data assets and APIs
    
  • High attention to detail in implementation of automated data quality checks
    
  • Effective collaboration with cross-functional teams
    
  
  
  

What we're looking for:

• 
  
• Production data engineering experience
  
• Proficiency in Spark and Scala, with proven experience building data infrastructure in Spark using Scala
  
• Familiarity with data lakes, cloud warehouses, and storage formats
  
• Strong proficiency in AWS services
  
• Expertise in SQL for data manipulation and extraction
  
• Excellent written and verbal communication skills
  
• Bachelor's degree in Computer Science or a related field
  
• Nice-to-Haves
  
  • 
    
  • Experience in adtech
    
  • Experience implementing data governance practices, including data quality, metadata management, and access controls
    
  • Strong understanding of privacy-by-design principles and handling of sensitive or regulated data
    
  • Familiarity with data table formats like Apache Iceberg, Delta
    
  
  
  

In-Office Requirement Statement:

• 
  
• We recognize that the ideal environment for work is situational and may differ across departments. What this looks like day-to-day can vary based on the needs of each organization or role.
  

Relocation Statement:

• 
  
• This position is not eligible for relocation assistance. Visit ourPinFlexpage to learn more about our working model.
  

#LI-SM4

#LI-REMOTE

At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise.

Information regarding the culture at Pinterest and benefits available for this position can be found here.

Our Commitment to Inclusion: