Python Colab Download File Jobs in Usa

We Are Hiring: Databricks Lead Data Engineer – Director Equivalent Role

Location: Atlanta, USA

Work Model: Hybrid – 3 to 4 days in office per week (mandatory)

Eligibility: US Citizens and Green Card (GC) holders only

How to Apply

If you are interested in this position and have the required skills, please send across your resume at:

 ; ;

Paves Technologies is seeking a highly experienced Databricks Lead Data Engineer – Lead Level (Director Equivalent Role) to drive enterprise-scale data architecture, governance, and advanced analytics initiatives on Azure Cloud. This is a senior leadership role requiring deep Databricks expertise, strong data modeling capabilities, and hands-on architectural ownership across PySpark based distributed systems.

Role Overview

The ideal candidate will bring 10-12 + years of overall data engineering experience, including strong hands-on expertise with Azure Databricks, PySpark, Python, and Azure Cloud data services. You will define architecture standards, lead modernization initiatives, and implement scalable Medallion Architecture (Bronze, Silver, Gold layers) to support enterprise analytics and business intelligence.

Key Responsibilities

• Lead end-to-end architecture and implementation of enterprise-scale data platforms using Azure Databricks on Azure Cloud.
• Design and implement Medallion Architecture (Bronze, Silver, Gold layers) using Delta Lake best practices.
• Build scalable PySpark-based ETL/ELT pipelines across ingestion (Bronze), transformation (Silver), and curated analytics (Gold) layers.
• Develop advanced data transformations using Python, PySpark, Spark SQL, and advanced SQL constructs.
• Architect robust data models (dimensional, star schema, normalized models) aligned to analytics and reporting needs.
• Drive adoption of advanced Databricks capabilities including Unity Catalog, Declarative Pipelines, Delta Lake optimization, and governance frameworks.
• Establish best practices for partitioning strategies, file compaction, Z-ordering, caching, broadcast joins, and query optimization.
• Define and standardize reusable Azure Cloud data platform tools, templates, CI/CD frameworks, and infrastructure automation.
• Work across Azure ecosystem components such as Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure DevOps, networking, and security services.
• Ensure high standards for data quality, RBAC, lineage tracking, governance, and production stability.
• Provide architectural leadership and mentorship to data engineering teams.

Required Experience & Skills

• 10–12+ years of overall experience in Data Engineering.
• Minimum 3+ years of strong hands-on Databricks experience.
• Mandatory Certifications:
• Databricks Certified Data Engineer Associate
• Databricks Certified Data Engineer Professional
• Deep hands-on expertise in PySpark, Python programming, and distributed Spark processing.
• Strong experience designing and implementing Medallion Architecture (Bronze/Silver/Gold layers).
• Advanced knowledge of Data Modeling, Data Analysis, and complex SQL (window functions, CTEs, execution plan tuning).
• Strong understanding of Delta Lake architecture, schema evolution, partition strategies, performance optimization, and data governance.
• Well-versed in enterprise Azure Cloud data platforms, reusable accelerators, CI/CD templates, and governance standards.
• Proven experience architecting scalable, secure, cloud-native data solutions.
• Strong leadership, stakeholder management, and executive communication skills.

How to Apply

If you are interested in this position and have the required skills, please send across your resume at:

; ;

Pyramid Systems is seeking an Cloud Logging Engineer (Splunk & AWS) who is responsible for ensuring the availability, performance, and security.

• Advise on cost efficiency for future usage and cost optimization for current infrastructure.
• Automate the management and enforcement of policies.
• Create and maintain documentation related to architecture and operational processes for CLS (Centralized Logging Solution).
• Develop a set of best practices and architecture patterns.
• Help maintain regulatory compliance of the CLS (Centralized Logging Solution) infrastructure.
• Help monitor and maintain CLS performance, availability, and capacity.
• Help maintain application container images.
• Offer solutions for ingestion of logs to Splunk via cloud native solutions.
• Maintain all infrastructure as code.
• Provide operations monitoring of CLS platform to enable proactive issue identification, response, and resolution.
• Recommend and execute improvements to the existing CLS architecture and design with growth and scalability in mind to optimize performance, stability, reliability, and agility.
• Responsible for reporting on current infrastructure status, and planning for future usage.
• Responsible for Beats agent deployments and container infrastructure analysis, optimization, and capacity planning.
• Maintain CI/CD pipelines for configuration deployments to applications.
• Support large-scale deployments with data feeds from multiple on premise and cloud data centers.
• Upgrade, install, configure monitoring solution for AWS for Windows and Linux servers.
• Utilize automation tool such as Terraform, Ansible, AWS Cloud Formation, Azure Resource Manager, or similar.
• Participate in a rotating on call schedule and weekly off hours maintenance.

• Splunk certification required***
• Candidate background eligibility requirements are United States citizen or be a Permanent Resident and have lived in the United States for at least 3 years, clean criminal background and able to obtain a Public Trust (High-Risk) Position.

• Bachelor's degree in computer science, electronics engineering or other engineering or technical discipline OR AWS/Azure Certification (AWS Professional / Specialty Cert. OR Azure Expert / Advanced Cert.) OR 4 years of relevant experience in one of the VAECOT suite of tools (Science Logic, Dynatrace, Turbot, AppDynamics)

• Minimum of three (3) years of experience in leading technical teams to achieve objectives and outcomes.

• Minimum of six (6) years setting up, configuring, and using AWS cloud operational tools to ensure service level agreements and performance targets are met, and continued compliance with policies, standards and guidelines.

• Minimum of three (3) years specific to monitoring Centralized Logging Solution (CLS)/Splunk

• Subject matter expertise with ALL VAEC Cloud Service Providers which currently includes Microsoft Azure and Amazon Web Services (AWS).

• Experience with programming with Splunk language (SPL) or equivalent (e.g., Python, Powershell, AWS or Azure CLI).

• One or more of these Splunk certifications: Splunk Core Certified Power User, Splunk Core Certified Advanced Power User, Splunk Enterprise Certified Admin, Splunk Enterprise Certified Architect, Splunk Enterprise Security Certified Admin, Splunk IT Service Intelligence Certified Admin.

• Knowledge of enterprise logging, with a focus on security event logging.

• Solid understanding of cloud concepts, either using Azure or AWS semantics.

• Experience in one or more of the VAECOT suite of tools, shown below:

VAEC Operational Tools (VAECOT)

Some experience in one or more of the following tools:

Third party tools

* Application Performance Monitoring: Dynatrace, AppDynamics

* Cloud Security: Nessus, NetSkope, Enterprise Security External Change Council, Identity and Assessment Management, Continuous Monitoring as a Service, McAfee, eMASS, Centrify

* Cloud Governance: Turbot

* DevOps/Configuration Management/Help Desk: Ansible, Service Desk, ScienceLogic, ServiceNow, SPLUNK, Jira ServiceDesk, Cloudockit, GitHub

* Containerization: Red Hat OpenShift

* Migration: CloudKey, Version One

* Reporting: Apptio

Cloud Service Provider (CSP) Operational Tools Tools/Services

* AWS Security: System Manager (Explorer and OpsCenter), CloudWatch, Config, CloudTrail, Elasticsearch (Kinesis DataStreams), GuardDuty, Inspector, Key Management Service (KMS), Security Hub, Directory Service, Identity and Access Management, Resource Access Manager, Cognito, Secrets Manager, Certificate Manager, Artifact

* Aws Monitoring and Logging: QuickSight, Eventbridge (AWS Kinesis DataStreams), Simple Notification Service (SMS), Elasticsearch (AWS Kinesis DataStreams), CloudTrail, CloudWatch

* Aws Networking: Virtual Private Cloud (VPC), Route S3, API Gateway, Direct Connect, AppStream 2.0, Transit Gateway, Elastic Loadbalancer, Firewall Manager, WAF & Shield

* AWS Storage: Cloud Tiering Services to S3 from On-Prem, Simple Storage Services (S3), S3 Glacier, Storage Gateway, Elastic File System (EFS), Backup

* Azure Security: Monitor (Log Analytics and ASC), Event Hubs, Security Center (ASC), Information Protection (AIP) , Key Vault, PowerBI, Network Watcher (Performance Monitor), Monitor (Log Analytics and ASC)

* Azure Monitoring and Logging: Information Protection (AIP), Advance Threat Protection, Security Center (ASC), Information Protection (AIP), Key Vault, Active Directory, Role Based Access Control (RBAC), Resource Manager (ARM), Resource Graph (ARG), Active Directory B2C, Key Vault, App Service, Service Trust Portal

* Azure Networking: Virtual Network, Traffic Manager, DNS, Application Gateway, Express Route, Web Apps, FrontDoor, VPN Gateway, Loadbalancer, Firewall

* Azure Storage: NetApp File Service, Storage (Blobs, Disks, Files, Queues, Tables), Storage Archive Access Tier, StorSimple, Files, Backup

Min Exp. : Around 5 years

Focus on python, kafka, AWS event bridge.

Job Description:

RW Eventing Team.

AWS EventBridge: creating new rules and buses through yaml configuration files.

Building and maintaining Lambda in Node.js.

Creating and maintaining APIs in API Gateway and/or Apigee

Code review and collaboration with other developers

Test code through Postman

Review Dynatrace production logs

Create Dynatrace dashboards

Using Jira boards for project management

Git/gitlab for code management.

Focus on python, kafka, AWS event bridge.

Job Title: CAE Engineer – NVH / Durability Engineer

Location: Livonia, MI

Job Summary:

The CAE Analyst II (NVH / Durability) will perform Finite Element Analysis (FEA) to solve NVH / Durability problems to aid engineering in the upfront design of automotive, aerospace, entertainment, and industrial segments. This individual will build FEA models and conduct Computer-Aided Engineering (CAE) analysis supported by sound engineering explanation and hand calculations.

Essential Duties and Responsibilities:

• Build NVH / Durability models for various applications in the automotive, aerospace, and entertainment industries using commercial CAE tools such as Nastran, Abaqus / Optistruct / ANSYS.
• Run NVH / Durability simulations (Linear, Non-linear, Dynamic), postprocess results, and provide engineering solutions.
• Develop and present detailed reports during customer meetings.
• Develop Python scripts for workflow automation.
• Manage analysis files according to company data-retention policies.
• Collaborate with various groups within the CAE department to enhance predictive accuracy and reduce development cycles.
• Able to execute projects with minimum guidance, including direct communication with customers, and develop effective design solutions utilizing CAE tools.
• Effectively handle more than one project simultaneously, ensuring timely and high-quality deliverables.
• Support new technology and process development.

Education and Experience (required):

• Bachelor of Science in Mechanical or Aerospace Engineering with coursework in Finite Element Analysis, Strength of Materials, Mechanical behavior of metals, plastics & composites, Noise & Vibration.
• 1-3 years of NVH & Durability modeling experience in building FEA models using tools such as ANSA, Hypermesh
• Experience in linear, non-linear & dynamic structural FEA modeling, analysis
• Experience in writing process automation using python, or Excel VBA or C functions.
• Experience in performing analysis of complex full vehicle models.
• U.S. Citizen or U.S. Permanent Resident allowing for International Traffic in Arms Regulations (ITAR) compliance.

Skills, Knowledge and Abilities (required):

• Knowledge of mechanical systems, vehicle structure for various load cases & principles for NVH & Durability development for various systems.
• Good attention to detail and ability to use hand calculations and free body diagrams to validate input and results. Ability to communicate verbal and written technical information.
• Excellent problem-solving ability. Take initiative to research solutions when dealing with new problems.
• Software skills in finite element pre-processors, solvers, and post-processors (Altair Hyperworks, ANSA & META).
• Familiarity with FEA/ fatigue simulation software packages (Nastran, Abaqus, nCode etc.)
• Software skills in finite element pre-processors, and post-processors (Altair Hyperworks, ANSA & META).
• Experience with real-world data integration and experimental validation.

Open date: May 28, 2025

Next review date: Thursday, Mar 19, 2026 at 11:59pm (Pacific Time)

Apply by this date to ensure full consideration by the committee.

Final date: Wednesday, May 27, 2026 at 11:59pm (Pacific Time)

Applications will continue to be accepted until this date, but those received after the review date will only be considered if the position has not yet been filled.

UC Berkeley Extension, the professional and continuing education division at the University of California, Berkeley, invites applications for a pool of qualified instructors to teach in-person professional post-baccalaureate courses for our Business, Data, and Innovation Visiting Student Programs. All courses are offered weekdays in-person on the UC Berkeley campus with some online instructional components. The pool will remain in place for nine months; those interested in remaining in the pool beyond the advertised final closing date must reapply. The number of these positions varies from semester to semester, depending on the needs of the department.

We are seeking qualified applicants who possess subject matter expertise and/or interest in the following subjects/specializations (but not limited to).

• 
  
• Accounting Foundations for Business
  
• Applied Economics for Business
  
• Marketing Management
  
• Organization and Management
  

• 
  
• Data Analytics Capstone
  
• Data Visualization
  
• Data Warehousing and Business Intelligence
  
• Introduction to Data Analytics
  
• Python for Data Analysis
  

• 
  
• Artificial Intelligence Foundations
  
• Data Science Capstone
  
• Introduction to Big Data
  
• Introduction to Data Science
  
• Introduction to Machine Learning
  
• Machine Learning and Deep Learning
  

• 
  
• Building a Business Plan
  
• Business Negotiating
  
• Business Process Modeling and Design
  
• Design Thinking and Prototyping
  
• Finance for Entrepreneurs
  
• Innovative Business Models for Entrepreneurs
  
• Leadership and Change Management for Startup Founders
  
• Leadership and Sustainable Strategies for Innovation and Growth
  
• Managing Product and Go-to-Market Strategies
  
• Marketing Research: Concepts and Techniques
  

Instructor duties include but are not limited to:

• 
  
• Complete mandatory training programs by deadlines established by UC Berkeley.
  
• Complete required administrative tasks in a timely manner including: updating and submitting syllabi using approved syllabus template; communicating required texts and materials; communicating classroom technology and support needs, etc.
  
• Make appropriate adjustments to continually improve the syllabus, curriculum and course materials. May be based upon programmatic and/or student feedback.
  
• Prepare and deliver course materials, lectures/presentations, and design learning assessments.
  
• Design interactive and motivational classroom activities to fully engage participants and to reinforce student learning.
  
• Stay current within the subject, discipline or field of practice.
  
• Use subject-matter expertise and leverage additional resources appropriately to enhance the curriculum.
  
• Utilize course support platforms, including the Canvas Learning Management System and Zoom Pro (as applicable).
  
• Communicate teaching objectives and specific learning outcomes to students, and clearly outline/explain the grading policies for the course.
  
• Respond to student questions and learning needs in a timely manner.
  
• Employ culturally competent and other relevant teaching methodologies in the classroom, including teaching non-native speakers and/or students with academic letters of accommodations for disabilities.
  
• Evaluate student achievement of specific learning outcomes and assign grades.
  
• Post final student grades to the transcript system within two weeks of course completion.
  
• Handle student inquiries about final grades and consult with Program Director/Manager as needed.
  
• Retain student records according to University policies.
  

Program: academic-areas/business/#!?tab=full-time-programs

• 
  
• Bachelor's degree (or equivalent international degree)
  

• 
  
• 3 or more years of professional industry work experience since degree, or 3 or more years of teaching experience since degree.
  
• All work must be performed in the United States, whether in person or online.
  
• For those who are not US citizens or permanent residents, a legal permit that allows work in the United States (such as a US visa that allows employment) is required by the start date of the position. Due to the part-time, temporary nature of instructor positions, UC Berkeley Extension is unable to provide US visa/work permits for this position.
  

• 
  
• Advanced degree in subject area preferred.
  
• 5 or more years of professional industry work experience in course subject since degree.
  
• 5 or more years of teaching, training, mentoring, or coaching experience in course subject, within a U.S. corporate environment or at a U.S. college/university institution.
  
• Knowledge of federal and California state laws and regulations as applicable to the course subject.
  
• Experience in creating syllabi, learning objectives, lectures/presentations, learning activities, assignments, assessments, exams, and quizzes.
  
• Experience teaching and/or developing academic content for online courses.
  
• Ability to convey conceptual and complex ideas and information.
  
• Effective verbal/written communication and presentation skills (English).
  
• Ability to collaborate with colleagues and work within a team environment.
  
• Proficiency in (or willingness to learn) instructional and other technology, such as: Learning Management Systems (Canvas); lecture/presentation capture applications (Panopto); online video conferencing (Zoom); Microsoft Office (Word and PowerPoint); file sharing (Google drive or Dropbox); and Google Workspace tools (email, calendar, docs, sheets, slides, etc).
  

• Curriculum Vitae or Resume - Your most recently updated C.V. or Resume.

  
  

• Instructor Information Form - Download the Instructor Information Form PDF to your computer desktop and open it using the Adobe Acrobat application. It is not recommended to use an internet PDF viewer or Google Docs to complete this form. Complete, save, and upload the PDF form to your AP Recruit application.

  
  

• 
  
• References are requested from candidates at the interviewing stage, and references are only contacted for finalists.
  

Help contact:

UC Berkeley is committed to diversity, equity, inclusion, and belonging in our public mission of research, teaching, and service, consistent with UC Regents Policy 4400 and University of California Academic Personnel policy (APM 210 1-d). These values are embedded in our Principles of Community, which reflect our passion for critical inquiry, debate, discovery and innovation, and our deep commitment to contributing to a better world. Every member of the UC Berkeley community has a role in sustaining a safe, caring and humane environment in which these values can thrive.

The University of California, Berkeley is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or protected veteran status.

For more information, please refer to the University of California's Affirmative Action and Nondiscrimination in Employment Policy and the University of California's Anti-Discrimination Policy.

In searches when letters of reference are required all letters will be treated as confidential per University of California policy and California state law. Please refer potential referees, including when letters are provided via a third party (i.e., dossier service or career center), to the UC Berkeley statement of confidentiality prior to submitting their letter.

As a University employee, you will be required to comply with all applicable University policies and/or collective bargaining agreements, as may be amended from time to time. Federal, state, or local government directives may impose additional requirements.

Unless stated otherwise, unambiguously, in the position description, this position does not include sponsorship of a new consular H-1B visa petition that would require payment of the $100,000 supplemental fee.

As a condition of employment, the finalist will be required to disclose if they are subject to any final administrative or judicial decisions within the last seven years determining that they committed any misconduct.

• 
  
• "Misconduct" means any violation of the policies or laws governing conduct at the applicant's previous place of employment, including, but not limited to, violations of policies or laws prohibiting sexual harassment, sexual assault, or other forms of harassment or discrimination, as defined by the employer.
  
• UC Sexual Violence and Sexual Harassment Policy
  
• UC Anti-Discrimination Policy
  
• APM - 035: Affirmative Action and Nondiscrimination in Employment
  

About VIVIO

VIVIO Health, a Public Benefit Corporation, is revolutionizing pharmacy benefits management through data and technology. Our foundational principle - "The Right Drug for the Right Person at the Right Price" - drives everything we do. Since 2016, our evidence-based approach has delivered superior health outcomes while reducing costs for self-insured employers and health plans. By ensuring each patient receives the most appropriate medication for their specific condition at a fair market price, we're replacing the obsolete PBM Model with innovative solutions that work better for everyone.

Why Join VIVIO?

• Innovation: Challenge the status quo and shape healthcare's future
• Impact: Directly influence patient care and help change healthcare delivery
• Collaboration: Work with passionate teammates dedicated to making a difference
• Culture: Enjoy autonomy and reliability in a micromanagement-free environment
• Growth: Expand your opportunities as we expand our business 

Job Description

Position Overview 

We are seeking an exceptional developer with robust Python skills to join our team. You will play a crucial role in building complex business operations logic. You should have a proven track record of building high-quality software, solving complex problems, and thriving in collaborative environments. Experience in regulated cloud environments like HIPAA or PCI is a plus. We expect a self-motivated individual who thrives in a collaborative environment and shares our commitment to enhancing the cost and quality of healthcare. If you're ready to make an impact, we want to hear from you! 

Location: Hayward, CA. This is a Hybrid role with a minimum of 3 in-office days.

Technical Stack:

• Languages: Python, PHP
• Databases: MySQL
• Infrastructure: AWS or other Cloud experience, CICD

Core Responsibilities:

• Design and develop scalable services and core libraries.
• Develop batch processing jobs for data imports, reporting, and external integrations.
• Build and maintain transaction processing systems with complex business rules.
• Integrate third-party APIs and normalize data across multiple healthcare providers.
• Implement HIPAA-compliant data handling, logging, and audit systems
• Write comprehensive tests with proper mocking and maintain CI/CD pipelines.
• Foster best practices in a lean startup setting through code reviews.
• Promote knowledge sharing to build a collaborative culture.
• Optimize architectures and designs through deep understanding of business processes
• Ensure operational excellence through monitoring, documentation, and deployment automation.

Qualifications

Required Qualifications: 

• 5+ years of development experience with production systems
• BS or advanced degree in an engineering discipline or equivalent experience 
• SQL database design and optimization
• Test-driven development and mocking strategies
• Experience with data processing

Preferred Qualifications:

• REST API design and integration experience
• FastAPI or similar framework experience
• CRM customization experience
• ETL pipelines and Batch processing systems experience
• Job orchestration frameworks experience
• File-based and distributed storage systems
• Healthcare/pharmacy technology background
• Strong understanding of building software in regulated environments & security standards such as PCI DSS, ISO 27001, HIPAA, and NIST. 

Other expectations: Hybrid work arrangement with work from office 3 days a week.

Additional Information

Compensation and Benefits:

• Base Salary: $120-$140K/year 
• Bonus Eligible 
• Health benefits, including Medical, Pharmacy, Dental, Vision, and Life insurance   
• Stock Options 
• 401K and company match 
• PTO   
• Opportunity to work for a growing and innovative company.   
• Dynamic and collaborative work environment.   
• The chance to make a real impact with a Public Benefit Corporation. 

VIVIO Health is an Equal Opportunity Employer. All information will be kept confidential according to EEO guidelines. 

Please be advised that job opportunities will only be extended after a candidate submits a completed job application and goes through our interview process, including 1:1 and/or group interviews via phone, video conferencing, and/or in-person. All legitimate correspondence from a VIVIO employee will come from our Smart Recruiter Applicant Tracking System "@ " or "@ " email accounts.