Senior Data Engineer - PySpark
Tasks
- Build and maintain PySpark pipelines
- Collaborate with architecture and analytics teams
- Develop data ingestion and transformation workflows
- Implement data validation and quality checks
- Optimize Spark workloads and processing performance
Perks/Benefits
- Dental insurance
- Disability insurance
- Life insurance
- Medical insurance
- PTO
- Retirement savings
- Vision insurance
Skills/Tech-stack
Databricks | ELT | ETL | PySpark | Python | SQL | Spark
Education
N/A
Roles
Related jobs
-
Analytics Engineer USD 92K-147KAirflow | Business Intelligence | DBT | Data Modeling | Data WarehousingHybrid work model | Remote work optionSenior-level Full TimeRemote, USA R9h ago
-
Senior Software Engineer, Data Infrastructure USD 191K-225KAWS EMR | Apache Airflow | Apache Iceberg | Apache Spark | Data ETLEmployee travel credits | Remote eligibleSenior-level Full TimeUSA - Remote R10h ago
-
Senior Data Engineer USD 143K-229KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data FactoryMentorship | Remote work | Travel as requiredSenior-level Full TimeKansas City, MO, United States R10h ago
-
Senior Analytics Engineer USD 156K-187KAmazon Redshift | BigQuery | CI/CD | Cloud Data | Cloud Data WarehouseBackground check required | Remote-friendly | Startup environmentSenior-level Full TimeUNITED STATES - Remote, CANADA - … R11h ago
-
Senior Staff Software Engineer, Data Infrastructure USD 254K-321KAWS | Apache Airflow | Apache Flink | Apache Iceberg | Apache KafkaFlexible work location | In-person events | Remote workSenior-level Full TimeUnited States - Remote R13h ago
-
Data Engineer USD 130K-140KAPI first | API-first design | Agile | Automated testing | CI/CDPublic trust clearance support | Remote work | US citizen requirementSenior-level Full TimeWork from home, VA, United States R14h ago
-
ETL Engineer USD 100K-130KAWS | Analysis Services | Bootstrap | Data Modeling | Database ArchitectureSenior-level Full TimeWork from home, VA, United States R14h ago
-
AI Developer – Model Creation & Full Stack (Python) USD 130K-165KAWS | Angular | Azure | CI/CD | Deep learningRemote work consideredMid-level Full TimeWork from home, VA, United States R14h ago
-
Data Engineer (UAP, EEB) USD 140K-165KApache Kafka | Apache Spark | CI/CD | Containerization | Data GovernanceSenior-level Full TimeWork from home, VA, United States R14h ago
-
Data Engineer (UAP, EEB) USD 140K-165KApache Spark | CI/CD | Cloud Data | Cloud data ingestion | Cloud platformRemote workSenior-level Full TimeWork from home, VA, United States R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | Batch Processing | DBTAccess to cutting-edge technology | Collaborative culture | Flexible working hours | Generous vacation | Inclusive work environmentSenior-level Full TimeMassachusetts R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | Batch Processing | Business IntelligenceCollaborative company culture | Flexible working hours | Generous vacation and personal leave | Inclusive work environment | Professional developmentSenior-level Full TimeMinnesota R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | Batch Processing | DBTAccess to cutting-edge technology | Collaborative & Innovative Culture | Flexible working hours | Generous vacation and personal leave | Inclusive workplaceSenior-level Full TimeIllinois R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | Batch Processing | DBTCutting-edge technology | Flexible working hours | Generous vacation and personal leave | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeIdaho R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | DBT | Data APIsAccess to cutting-edge technology | Collaborative company culture | Flexible working hours | Generous vacation and personal leave policies | Inclusive work environmentSenior-level Full TimeColumbia R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | Batch Processing | DBTAccess to cutting-edge technology | Flexible working hours | Generous vacation | Inclusive work environment | Personal leaveSenior-level Full TimeColorado R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | Business Intelligence | DBTAccess to cutting-edge technology | Collaborative company culture | Flexible working hours | Generous vacation and personal leave | Inclusive work environmentSenior-level Full TimeFlorida R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | DBT | Data APIsAccess to cutting-edge technology | Collaborative company culture | Flexible working hours | Generous vacation | Inclusive work environmentSenior-level Full TimeConnecticut R14h ago
-
Amazon Kinesis | Amazon Web Services | Apache Flink | Apache Kafka | Batch ProcessingCollaborative company culture | Flexible working hours | Generous vacation | Inclusive work environment | Personal leave policiesSenior-level Full TimeCalifornia R14h ago
-
Amazon Kinesis | Apache Flink | Apache Kafka | Batch Processing | DBTCollaborative culture | Flexible working hours | Generous vacation | Inclusive work environment | Personal leaveSenior-level Full TimeArizona R14h ago
-
Senior Analytics Engineer USD 132K-178KClustering | Code review | DBT | Data Modeling | Data QualityEducational reimbursements | Gym subsidies | Health benefits | Matched 401k | PTOSenior-level Full TimeRemote - US R15h ago
-
Principal Software Engineer - Core GenAI Platform USD 186K-270KBackend Engineering | Cloud Computing | Compliance | Cost Optimization | Data Privacy401k matching | Company-paid life and disability insurance | EAP mental health support | Employee assistance program | Employee stock purchase planSenior-level Full TimeUnited States | Remote R17h ago
-
Agile | Azure | Data Modeling | Data Warehousing | Data pipelineAgile environment | Remote workSenior-level ContractLincoln, United States R17h ago
-
Langchain | Language Models | Large Language Models | MLOps | Machine LearningFreelance project based engagement | Part-time project workMid-level FreelanceNew York, United States - Remote R1d ago
-
Big Data | Feature Engineering | Langchain | MLOps | Machine LearningFreelance work | Part-time projects | Project based workMid-level FreelanceUnited States - Remote R1d ago