Colab Python Jobs in Usa
1,215 positions found — Page 7
Job Description
Role -: QA Automation Engineer
Location: Mount Laurel, NJ (Onsite)
We are looking for a highly skilled SDET / QA Automation Engineer with strong experience in Python, JavaScript, and modern automation frameworks to support automation solutions and end-to-end network validation.
Key Skills Required:
Python Automation
JavaScript
SDET / QA Automation
Automation Frameworks (PyTest / Selenium / Playwright / Cypress)
Microservices Testing
API Testing
Networking / Cable Technologies Knowledge
End-to-End System Validation
Responsibilities:
• Develop automation solutions and test scripts for network platforms
• Build and maintain automation frameworks using Python & JavaScript
• Validate end-to-end network components and behavior
• Develop automation microservices for testing infrastructure
• Collaborate with cross-functional teams and clients to ensure quality delivery
Duration: 12 months (possible extension)
Description:
Job Title: Senior AI Fullstack Engineer
The Position
- We advance science so that we all have more time with the people we love. Client’s Early Clinical Development (ECD) department is seeking a talented and motivated Software Developer reporting to the Director of software engineering at The Clinical Data Insights & Automation team (CDI&A).
- The CDI&A team collaborates with a broad range of stakeholders involved in the clinical development process (e.g., Clinical Science, Clinical Operations, Medical Writing, Quality, Regulatory). It develops industry-leading solutions for highly complex business problems. To manage the design and pilot of these software products, they apply a high degree of ingenuity and creativity while maintaining a finger on the pulses of the rapidly changing tech and healthcare landscapes.
- The Software Engineer will primarily be responsible for designing, developing, and deploying software which interacts with cutting-edge generative AI models and applications in collaboration with AI scientists, full stack developers, and others. Their work will directly impact our ability to create and deliver innovative solutions that leverage AI to solve complex problems and enhance user experiences.
The Opportunity:
- Innovate and develop software applications to support clinical development
- Identify and integrate AI/LLM capabilities to enhance data processing and natural workflows.
- Design intuitive, user-centric interfaces.
- Code Quality and Documentation: Write clean, maintainable, and well-documented code. Participate in code reviews and contribute to best practices in software development.
- Research and Innovation: Stay up-to-date with the latest advancements in generative AI and machine learning. Evaluate new technologies and methodologies to continuously improve our solutions.
- Collaborate with Cross-Functional Teams: Work closely with data scientists, engineers, and product managers to integrate generative AI capabilities into our products and services.
- Deployment and Monitoring: Develop and maintain robust deployment pipelines for AI-enhanced applications. Monitor pipeline performance in production and implement necessary improvements.
Who You Are:
- An experienced full stack developer capable of bringing your expertise to our existing and upcoming AI applications/projects as both a leader and individual contributor.
- Someone with a clear understanding of the current landscape of AI & AI-based applications, including potential benefits, limitations, and standard of practice.
Minimum Requirements:
- Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field.
- 5+ years of full stack development experience
- Strong proficiency in either a front-end framework (Vue.js, React, or similar) and a backend web frameworks in Python and/or JavaScript (Django, FastAPI, Flask, Next.js, or similar)
- 4+ years experience with front-end frameworks (preferably Vue.js)
- 2+ years of developing and deploying AI/ML solutions or applications
- Experience designing and developing RESTful APIs (with e.g. Python FastAPI).
- Familiarity with prompt engineering
- Proficiency with containerized workflows and architectures (Podman, Docker, Kubernetes)
- Strong automated software testing skills (Python unittest, jest, Playwright)
- Familiar with Agile methodologies
- Excellent analytical and problem-solving skills with a track record of tackling complex technical challenges.
- Leading system design and implementing scalable, fault-tolerant solutions for complex, distributed computing challenges.
- Strong interpersonal and communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
- Experience with cloud platforms (e.g. AWS) and modern data platforms (e.g., Snowflake).
- Experience implementing chatbots, retrieval-augmented generation (RAG) systems, and integrating LLMs into applications (AI-assisted automation)
Preferred Qualifications:
- Experience building AI agents, fine-tuning LLM models, and evaluating bias and fairness with LLM systems
- Experience in developing Microsoft Word add-ins using Office.js.
- Experience with web technologies like JWT, WebSockets, etc.
- Experience with Huggingface, Langchain, TensorFlow, PyTorch, or similar.
- Familiarity with DevOps, infrastructure, and continuous integration concepts.
- Familiarity with CRDT technologies like Yjs.
- Experience with using NLP/LLMs on clinical text.
- Basic knowledge of clinical drug development
About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Recruiter Details:
Name: Prateek Chaturvedi
Email:
Internal Id: 26-06298
Job Title: Senior Data Engineer
Location: Chicago, IL (Hybrid)
Department: Data & Analytics
Reports To: Head of Data Engineering / Data Platform Lead
Role Overview
We are seeking a highly skilled Senior Data Engineer with strong Python development expertise and deep experience in Snowflake to design, build, and optimize scalable enterprise data solutions. This role is based in Chicago, IL and will support regulatory and risk data initiatives in a highly governed environment.
The ideal candidate has hands-on experience building modern cloud data platforms and is familiar with risk management frameworks, BCBS 239 principles, and Governance, Risk & Compliance (GRC) requirements within financial services.
Key Responsibilities
Data Engineering & Architecture
Design, develop, and maintain scalable data pipelines using Python.
Build and optimize data models, transformations, and data marts within Snowflake.
Develop robust ELT/ETL frameworks for structured and semi-structured data.
Optimize Snowflake performance, cost efficiency, clustering, and workload management.
Implement automation, monitoring, and CI/CD for data pipelines.
Risk & Regulatory Data Management
Support regulatory reporting aligned with BCBS 239 (risk data aggregation and reporting).
Ensure data traceability, lineage, reconciliation, and auditability.
Implement controls aligned with Governance, Risk & Compliance (GRC) frameworks.
Partner with Risk, Finance, Compliance, and Audit teams to deliver accurate and governed data assets.
Data Governance & Quality
Develop and enforce data quality validation frameworks.
Maintain metadata, lineage documentation, and data catalog integration.
Implement data access controls and security best practices.
Technical Leadership
Provide mentorship and code reviews for data engineering team members.
Promote engineering best practices and documentation standards.
Collaborate cross-functionally with architects, analysts, and business stakeholders.
Required Qualifications
7+ years of experience in Data Engineering or Data Platform development.
Strong Python programming expertise (Pandas, PySpark, Airflow, etc.).
Hands-on experience with Snowflake (data modeling, Snowpipe, Streams & Tasks, performance tuning).
Advanced SQL skills and deep understanding of data warehousing concepts.
Experience supporting BCBS 239 compliance or similar regulatory reporting frameworks.
Experience working within Governance, Risk & Compliance (GRC) structures.
Experience in cloud environments (AWS, Azure, or GCP).
Strong understanding of data lineage, controls, reconciliation, and audit requirements.
Preferred Qualifications
Experience in banking, capital markets, or financial services.
Knowledge of credit risk, market risk, liquidity risk, or regulatory reporting domains.
Experience with data governance tools (Collibra, Alation, etc.).
Familiarity with DevOps practices, Docker, Kubernetes.
Experience building enterprise data platforms in highly regulated environments.
Key Competencies
Strong problem-solving and analytical thinking.
Ability to operate in a regulated, audit-driven environment.
Excellent communication and stakeholder management skills.
Detail-oriented with a focus on data accuracy and integrity.
Leadership mindset with hands-on technical capability.
Position: Lead JavaScript Engineer/Architect
Location: Charlotte, NC
Duration: 6 Months - CTH
Key skills: JavaScript, TypeScript, Node; Python (at least basic); to be able to design a trading system, performance tuning etc.
Job Description:
We are looking for an Architect/Lead Software Engineer to join our team. You will work with our product, design, and engineering teams to plan, design, and develop customer facing applications for credit cards. We offer an opportunity to work in a collaborative and inclusive environment with people who value their work and who welcome fresh ideas.
Key Responsibilities:
- Perform complex application programming activities with an emphasis on backend systems development: Node.JS, TypeScript, JavaScript, Python, RESTful APIs, Data Pipelines and more
- Lead the definition of system architecture and detailed solution design that are scalable and extensible
- Collaborate with Product Owners, Designers, and other engineers on different permutations to find the best solution possible
- Own the quality of code and do your own testing. Automate feature testing and contribute UI testing framework
- Become a subject matter expert for our mobile applications backend and middleware
- Deliver amazing solutions to production that knock everyone’s socks off
- Mentor developers on the team
- Aid technical team as needed
- Assist in interviewing and building out technical team
- Suggest improvements to optimize delivery
Basic Qualifications:
- Minimum B.S. / M.S. Computer Science or related discipline from accredited college or University
- At least 8+ years of experience designing, developing, and delivering backend applications with Node.JS, TypeScript, JavaScript, Python, Restful APIs, Data Pipelines and related backend frameworks
- At least 8 years of experience building internet facing applications
- At least 8 years of experience with known Cloud and/or OpenShift, preferably AWS
- Proficient in following concepts: object-oriented programming, software engineering techniques, quality engineering, parallel programming, databases, etc.
- Proficient in building and consuming RESTful APIs
- Proficient in managing multiple tasks and consistently meet established timelines
- Experience integrating APIs with front-end and/or mobile-specific frameworks
- Strong collaboration skills
- Excellent written and verbal communications skills
We Are Hiring: Databricks Lead Data Engineer – Director Equivalent Role
Location: Atlanta, USA
Work Model: Hybrid – 3 to 4 days in office per week (mandatory)
Eligibility: US Citizens and Green Card (GC) holders only
How to Apply
If you are interested in this position and have the required skills, please send across your resume at:
; ;
Paves Technologies is seeking a highly experienced Databricks Lead Data Engineer – Lead Level (Director Equivalent Role) to drive enterprise-scale data architecture, governance, and advanced analytics initiatives on Azure Cloud. This is a senior leadership role requiring deep Databricks expertise, strong data modeling capabilities, and hands-on architectural ownership across PySpark based distributed systems.
Role Overview
The ideal candidate will bring 10-12 + years of overall data engineering experience, including strong hands-on expertise with Azure Databricks, PySpark, Python, and Azure Cloud data services. You will define architecture standards, lead modernization initiatives, and implement scalable Medallion Architecture (Bronze, Silver, Gold layers) to support enterprise analytics and business intelligence.
Key Responsibilities
- Lead end-to-end architecture and implementation of enterprise-scale data platforms using Azure Databricks on Azure Cloud.
- Design and implement Medallion Architecture (Bronze, Silver, Gold layers) using Delta Lake best practices.
- Build scalable PySpark-based ETL/ELT pipelines across ingestion (Bronze), transformation (Silver), and curated analytics (Gold) layers.
- Develop advanced data transformations using Python, PySpark, Spark SQL, and advanced SQL constructs.
- Architect robust data models (dimensional, star schema, normalized models) aligned to analytics and reporting needs.
- Drive adoption of advanced Databricks capabilities including Unity Catalog, Declarative Pipelines, Delta Lake optimization, and governance frameworks.
- Establish best practices for partitioning strategies, file compaction, Z-ordering, caching, broadcast joins, and query optimization.
- Define and standardize reusable Azure Cloud data platform tools, templates, CI/CD frameworks, and infrastructure automation.
- Work across Azure ecosystem components such as Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure DevOps, networking, and security services.
- Ensure high standards for data quality, RBAC, lineage tracking, governance, and production stability.
- Provide architectural leadership and mentorship to data engineering teams.
Required Experience & Skills
- 10–12+ years of overall experience in Data Engineering.
- Minimum 3+ years of strong hands-on Databricks experience.
- Mandatory Certifications:
- Databricks Certified Data Engineer Associate
- Databricks Certified Data Engineer Professional
- Deep hands-on expertise in PySpark, Python programming, and distributed Spark processing.
- Strong experience designing and implementing Medallion Architecture (Bronze/Silver/Gold layers).
- Advanced knowledge of Data Modeling, Data Analysis, and complex SQL (window functions, CTEs, execution plan tuning).
- Strong understanding of Delta Lake architecture, schema evolution, partition strategies, performance optimization, and data governance.
- Well-versed in enterprise Azure Cloud data platforms, reusable accelerators, CI/CD templates, and governance standards.
- Proven experience architecting scalable, secure, cloud-native data solutions.
- Strong leadership, stakeholder management, and executive communication skills.
How to Apply
If you are interested in this position and have the required skills, please send across your resume at:
; ;
Akkodis is seeking a Platform Software Engineer role is a Full-Time with a client located in Allentown, Cincinnati, Chicago, (Occasionally Onsite). Ideally looking for applicants to have a solid background in embedded systems/Payroll, Python/Django, AWS, API, React. would come as a big plus.
Salary Range: $165k-$190k/Annum + Benefits, The salary may be negotiable based on experience, education, geographic location, and other factors.
Key Responsibilities
Customer Collaboration & Developer Relations
- Serve as the primary technical interface for customers, partners, and indirect channel teams.
- Host technical discussions, requirement? Gathering sessions, and architecture reviews directly with customers.
- Provide developer support, guidance, and best practices for integration and implementation.
- Represent the embedded team in developer? Facing demos, product enablement, and partner technical workshops.
- Translate customer needs into actionable engineering tasks, ensuring platform capabilities align with business goals.
Platform Customization & Embedded Engineering
- Lead the design and implementation of custom features, enhancements, and integrations across our platform.
- Develop application? Layer components and service extensions using Python, Django, and REST? Based APIs.
- Build and integrate customer? Facing portal/UI components in React.
- Leverage AWS services to build scalable, cloud-backed integrations.
Architecture, API & Systems Integration
- Own the documentation and development of APIs, SDKs, and interface design documents (IDDs).
- Ensure seamless integration between on?device components, microservices, and customer systems.
Technical Troubleshooting & Tier?3 Support
- Diagnose and resolve complex issues.
- Provide senior? Level technical escalation support for customers and internal teams.
- Lead root?cause analysis and drive long? Term corrective improvements across the platform.
Project Delivery & Leadership
- Lead customer? Specific development initiatives from ideation through deployment.
- Own timelines, deliverables, and technical direction for customization projects.
- Mentor junior engineers and influence cross? Team engineering best practices.
Required Skills & Qualifications
- Expertise in Python, with experience building backend services or integration layers (Django strongly preferred).
- Proficiency in React for developing customer?facing interfaces or partner tools.
- Experience with AWS (Lambda, API Gateway, S3, CloudWatch, IAM, or related services).
- Strong experience with embedded systems development.
- Experience with API design, interface documentation, and integration workflows.
- Excellent communication skills with the ability to convey complex technical concepts to diverse audiences, including customers and indirect channel partners.
- Proven success in customer-facing engineering, developer support, or solutions engineering roles.
- Bachelor’s degree in Computer Engineering, Electrical Engineering, Computer Science, or related field.
Preferred Qualifications
- Experience in Developer Relations, technical evangelism, or technical account management.
- Experience supporting indirect channel partners, VARs, ISVs, or system integrators.
- Background in pre?sales engineering, partner enablement, or customer?led solution design.
If you are interested in this role, then please click APPLY NOW. For other opportunities available at Akkodis, or any questions, feel free to contact me at
Equal Opportunity Employer/Veterans/Disabled
Benefits offerings include but are not limited to:
• 401(k) with match
• Medical insurance
• Dental Insurance
• Vision assistance
• Paid Holidays Off
To read our Candidate Privacy Information Statement, which explains how we will use your information, please visit Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:
· The California Fair Chance Act
· Los Angeles City Fair Chance Ordinance
· Los Angeles County Fair Chance Ordinance for Employers
· San Francisco Fair Chance Ordinance
This is a multi-year contract with our direct client.
No third parties!
The Early Clinical Development (ECD) department with our South San Francisco, CA client is seeking a talented and motivated Senior AI Full Stack Engineer reporting to the Director of software engineering at The Clinical Data Insights & Automation team (CDI&A). The CDI&A team collaborates with a broad range of stakeholders involved in the clinical development process (e.g., Clinical Science, Clinical Operations, Medical Writing, Quality, Regulatory). It develops industry-leading solutions for highly complex business problems. To manage the design and pilot of these software products, they apply a high degree of ingenuity and creativity while maintaining a finger on the pulses of the rapidly changing tech and healthcare landscapes.
The Software Engineer will primarily be responsible for designing, developing, and deploying software which interacts with cutting-edge generative AI models and applications in collaboration with AI scientists, full stack developers, and others. Their work will directly impact our ability to create and deliver innovative solutions that leverage AI to solve complex problems and enhance user experiences.
The Opportunity:
- Innovate and develop software applications to support clinical development
- Identify and integrate AI/LLM capabilities to enhance data processing and natural workflows.
- Design intuitive, user-centric interfaces.
- Code Quality and Documentation: Write clean, maintainable, and well-documented code. Participate in code reviews and contribute to best practices in software development.
- Research and Innovation: Stay up-to-date with the latest advancements in generative AI and machine learning. Evaluate new technologies and methodologies to continuously improve our solutions.
- Collaborate with Cross-Functional Teams: Work closely with data scientists, engineers, and product managers to integrate generative AI capabilities into our products and services.
- Deployment and Monitoring: Develop and maintain robust deployment pipelines for AI-enhanced applications. Monitor pipeline performance in production and implement necessary improvements.
Who You Are:
- An experienced full stack developer capable of bringing your expertise to our existing and upcoming AI applications/projects as both a leader and individual contributor.
- Someone with a clear understanding of the current landscape of AI & AI-based applications, including potential benefits, limitations, and standard of practice.
Minimum Requirements:
- Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field.
- 5+ years of full stack development experience
- Strong proficiency in either a front-end framework (js, React, or similar) and a backend web frameworks in Python and/or JavaScript (Django, FastAPI, Flask, Next.js, or similar)
- 4+ years experience with front-end frameworks (preferably js)
- 2+ years of developing and deploying AI/ML solutions or applications
- Experience designing and developing RESTful APIs (with e.g. Python FastAPI).
- Familiarity with prompt engineering
- Proficiency with containerized workflows and architectures (Podman, Docker, Kubernetes)
- Strong automated software testing skills (Python unittest, jest, Playwright)
- Familiar with Agile methodologies
- Excellent analytical and problem-solving skills with a track record of tackling complex technical challenges.
- Leading system design and implementing scalable, fault-tolerant solutions for complex, distributed computing challenges.
- Strong interpersonal and communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
- Experience with cloud platforms (e.g. AWS) and modern data platforms (e.g., Snowflake).
- Experience implementing chatbots, retrieval-augmented generation (RAG) systems, and integrating LLMs into applications (AI-assisted automation)
Preferred Qualifications:
- Experience building AI agents, fine-tuning LLM models, and evaluating bias and fairness with LLM systems
- Experience in developing Microsoft Word add-ins using js.
- Experience with web technologies like JWT, WebSockets, etc.
- Experience with Huggingface, Langchain, TensorFlow, PyTorch, or similar.
- Familiarity with DevOps, infrastructure, and continuous integration concepts.
- Familiarity with CRDT technologies like Yjs.
- Experience with using NLP/LLMs on clinical text.
- Basic knowledge of clinical drug development
We're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally transformative to the way goods - and eventually people - move around the planet. We are a team of mission-driven engineers with experience across aerospace, robotics and self-driving cars working to make this future a reality.
As a Radar Systems Engineer, you will be a part of our Radar Engineering team. The Radar Engineering team is comprised of a small cross functional team of motivated and experienced engineers; we're responsible for designing, building, and testing cutting edge phased array radar systems from concept to certified product. We enjoy a culture of sharing information and collaboration. Phased array radar systems have historically been reserved for specialized applications, but we're making this technology affordable to enable Detect and Avoid for widespread commercial applications. This role will focus on new advanced operational modes. The passion for revolutionary technology to make aviation safer motivates us to come in every day.
Responsibilities
In your role as a Radar Systems Engineer, you will be responsible for analyzing phased array radar systems and developing radar processing algorithms to enable short, long range object tracking, and radar image generation. You will be involved in all phases of development from conception to production, designing your algorithms in Matlab, Python, and implementation in C++ on the target hardware. You will drive the system-level requirements of the phased array radar system, and drive trade studies collaborating with the cross functional teams. You will support the integration of the radar on the aircraft and support data collection and analysis during flight testing. You will be the owner of real-time processing of radar algorithms on an FPGA, DSP-based platform.
Basic Success Criteria
Electrical Engineering fundamentals, typically gained through a Bachelor's Degree of Science or Engineering in Mechanical, Electrical, Aerospace, or a related discipline
8+ years of professional hands-on experience with Radar algorithms, radar system design, radar signal processing, integration, and test of a radar system
Ability to use C++, Matlab and Python (Python preferred)
Ability to troubleshoot, find root cause, and resolve issues
Pulsed and FMCW processing algorithm development
Experience in airborne radar testing and development
Preferred Criteria
Advanced Degree of Science or Electrical Engineering
Experience developing system architectures and managing requirements for certification of Avionics
Creative problem solver that can bring multiple disciplines together, with the ability to assess risk and make design and development decisions without all available data
Experience integrating and troubleshooting various electronic sensors and components
Weather radar experience, airborne or ground-based
Real beam radar imaging, and or SAR processing
This role can be remote, or located at our facility in Mountain View, California.
Must be willing to travel 30% of the time.
The estimated salary range for this position is $180,000 to $260,000/annual salary + cash and stock option awards + benefits. At Reliable Robotics, we strive to provide competitive and rewarding compensation based on experience and expertise, as well as market conditions, location, and pay equity.
In addition to base compensation, Reliable Robotics offers stock options, employee medical, 401k contribution, great co-workers and a casual work environment.
This position requires access to information that is subject to U.S. export controls. An offer of employment will be contingent upon the applicant's capacity to perform in compliance with U.S. export control laws.
All applicants are asked to provide documentation that legally establishes status as a U.S. person or non-U.S. person (and nationalities in the case of a non-U.S. person). Where the applicant is not a U.S. person, meaning not a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident, (iii) refugee under 8 U.S.C. * 1157, or (iv) asylee under 8 U.S.C. * 1158, or not otherwise permitted to access the export-controlled technology without U.S. government authorization, the Company reserves the right not to apply for an export license for such applicants whose access to export-controlled technology or software source code requires authorization and may decline to proceed with the application process and any offer of employment on that basis.
At Reliable Robotics, our goal is to be a diverse and inclusive workforce. As an Equal Opportunity Employer, we do not discriminate on the basis of race, religion, color, creed, ancestry, sex, gender (including pregnancy, childbirth, breastfeeding, or related medical conditions), gender identity, gender expression, sexual orientation, age, non-disqualifying physical or mental disability or medical conditions, national origin, military or veteran status, genetic information, marital status, or any other basis covered by applicable law. All employment and promotion is decided on the basis of qualifications, merit, and business need.
If you require reasonable accommodation in completing an application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to
Compensation Range: $180K - $260K
Apply for this JobLength of Contract: 6 months
Location: Remote (Eastern time zone)
What are the top 3-5 skills, experience or education required for this position:
a. Proficiency in databases (SQL) and coding in R/Python
b. Experience with API development
c. Familiarity with AI techniques and strong curiosity for new technologies
d. Experience managing and curating bioinformatics datasets (BulkRNAseq, Proteomics, scRNAseq, CRISPR)
e. Code management, documentation, and version control (e.g., GitHub)
Job Overview: As a Data Analyst, you'll drive data quality and consistency in our central hub for storing OMICS data, address impactful data loading and curation projects and help improve and automate processes using agentic AI. Working closely with researchers, you'll ensure their data needs are met and help accelerate scientific discovery.
Key Responsibilities:
- Contribute to important data loading and curation projects for the departments Omics data server
- Address data quality and consistency issues in the CRISPR database.
- Apply agentic AI approaches for data loading and querying OMICS data
- Database Interaction: Use PostgreSQL to build, manage, and query large genomic datasets.
- API Development: Design and implement APIs for improved data accessibility and integration across platforms.
- Automation: Use Python and R to automate and optimize data workflows, prioritizing data quality and integrity.
- ETL Process Management: Develop and execute ETL processes to integrate high-value datasets in line with organizational standards.
- Collaboration: Work with cross-functional teams and research scientists to gather requirements, align to common data model standards, and facilitate effective data management.
- Documentation: Maintain comprehensive documentation and version control for reproducibility and teamwork.
Required qualifications:
- Master's degree in computer science, bioinformatics, or a related field, with 3+ years of relevant experience.
- Proven experience working with databases (PostgreSQL proficiency).
- Advanced skills in Python and R for automation and data manipulation.
- Experience handling and curating bioinformatics datasets (BulkRNAseq, Proteomics, scRNAseq, CRISPR).
- Code management, documentation, and usage of Github.
- Curiosity and basic knowledge of AI techniques applicable to data loading and querying.
- Excellent communication skills and a collaborative mindset.
- Demonstrated experience with AWS resources.
- Experience in API
Role: Data Engineer Sr.
Location: Strongsville, OH, 44136
Roles and Responsibilities:
Working within Hadoop Technology Stack and Python programming to build consumer and production apps.
Must Have Technical Skills Required, 5 - 7 years of experience:
1. Hadoop Platform utilities - Hive, Oozie, Yarn, Impala, HDFS, Hbase-Hue, Beeline.
2. Python and Shell Programming (PySpark) - Python 2.7, 3.0
3. DSP (Data Streaming Platform) - Kafka Confluent
4, Core Java - IntelliJ with SBT or Maven
5. Spark - Core, SQL
6. Confluence, Jira
7. Service Now
8. Gitbub, Jenkins, Udeploy, Artifactory